Jul 30 10:46:06.886603 ip-10-0-134-172 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 10:46:06.886618 ip-10-0-134-172 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 10:46:06.886630 ip-10-0-134-172 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 10:46:06.886975 ip-10-0-134-172 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 10:46:17.135967 ip-10-0-134-172 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 10:46:17.135989 ip-10-0-134-172 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 908b3aff77df4d939fbb87f543ee3ec0 --
Jul 30 10:48:15.768584 ip-10-0-134-172 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 10:48:16.179370 ip-10-0-134-172 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 10:48:16.179370 ip-10-0-134-172 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 10:48:16.179370 ip-10-0-134-172 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 10:48:16.179370 ip-10-0-134-172 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 10:48:16.179370 ip-10-0-134-172 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 10:48:16.180518 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.180427    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 10:48:16.184936 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184909    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 10:48:16.184936 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184935    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 10:48:16.184936 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184939    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184944    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184948    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184959    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184963    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184966    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184969    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184972    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184974    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184977    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184980    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184983    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184986    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184989    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184991    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184995    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.184998    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185000    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185003    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185006    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 10:48:16.185063 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185008    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185011    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185014    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185017    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185019    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185022    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185025    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185027    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185030    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185033    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185036    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185039    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185042    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185044    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185048    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185051    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185055    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185057    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185060    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185063    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 10:48:16.185609 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185067    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185070    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185073    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185076    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185080    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185083    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185086    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185089    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185092    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185094    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185097    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185100    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185103    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185105    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185108    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185112    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185116    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185119    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185122    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 10:48:16.186191 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185126    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185129    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185132    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185136    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185139    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185142    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185146    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185150    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185153    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185156    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185159    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185162    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185165    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185169    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185172    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185175    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185178    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185181    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185184    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185187    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 10:48:16.186715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185190    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185192    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185195    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185198    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185201    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185204    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185206    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185209    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185213    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185217    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185220    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185223    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185225    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185228    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185231    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185233    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185236    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.185239    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 10:48:16.187238 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186195    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186215    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186222    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186226    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186229    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186232    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186236    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186240    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186243    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186246    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186249    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186252    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186255    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186258    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186261    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186264    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186267    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186270    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186272    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 10:48:16.187800 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186275    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186279    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186282    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186285    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186288    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186290    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186293    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186296    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186316    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186320    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186323    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186326    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186329    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186332    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186336    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186339    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186342    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186344    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186348    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186351    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 10:48:16.188338 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186354    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186358    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186361    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186364    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186367    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186370    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186373    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186376    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186379    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186382    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186385    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186389    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186392    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186396    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186399    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186402    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186405    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186407    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186410    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186413    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 10:48:16.188879 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186416    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186419    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186424    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186431    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186436    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186439    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186442    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186445    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186450    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186453    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186456    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186459    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186462    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186465    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186468    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186471    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186473    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186476    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186479    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 10:48:16.189447 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186482    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186485    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186488    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186490    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186493    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186496    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186499    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186502    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186505    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186508    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186510    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186513    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186516    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186519    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186522    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186525    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186528    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186531    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186534    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186537    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 10:48:16.189947 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.186540    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187006    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187012    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187015    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187018    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187021    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187024    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187027    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187030    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187033    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187036    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187040    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187043    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187046    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187049    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187052    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187054    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187057    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187060    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 10:48:16.190541 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187064    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187069    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187072    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187075    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187079    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187082    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187085    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187087    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187091    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187094    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187097    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187100    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187103    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187106    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187110    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187113    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187117    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187120    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187123    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 10:48:16.191043 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187126    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187129    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187132    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187135    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187138    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187140    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187143    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187146    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187149    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187152    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187155    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187158    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187161    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187164    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187166    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187169    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187172    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187175    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187178    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187180    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 10:48:16.191606 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187183    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187187    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187190    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187193    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187196    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187199    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187202    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187205    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187208    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187212    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187215    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187218    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187221    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187224    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187227    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187230    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187233    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187236    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187239    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187242    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 10:48:16.192134 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187245    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187248    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187251    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187254    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187257    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187263    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187266    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187269    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187272    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187275    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187278    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187281    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187284    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187291    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187294    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187297    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187313    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187318    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187323    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 10:48:16.192671 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187327    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187330    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.187334    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187429    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187438    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187446    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187452    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187457    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187461    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187466    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187472    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187475    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187479    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187483    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187487    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187491    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187494    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187498    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187501    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187504    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187508    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187513    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187516    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 10:48:16.193243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187519    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187523    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187527    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187541    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187544    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187548    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187552    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187556    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187560    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187563    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187567    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187571    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187577    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187580    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187584    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187587    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187590    2583 flags.go:64] FLAG: --enable-server="true"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187593    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187599    2583 flags.go:64] FLAG: --event-burst="100"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187603    2583 flags.go:64] FLAG: --event-qps="50"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187606    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187609    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187613    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187617    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 10:48:16.193872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187621    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187624    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187627    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187631    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187634    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187638    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187641    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187644    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187648    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187651    2583 flags.go:64] FLAG: --feature-gates=""
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187656    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187661    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187665    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187669    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187672    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187676    2583 flags.go:64] FLAG: --help="false"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187679    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187683    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187687    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187690    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187694    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187699    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187702    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 10:48:16.194536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187707    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187710    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187714    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187717    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187720    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187723    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187727    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187730    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187733    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187736    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187740    2583 flags.go:64] FLAG: --lock-file=""
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187743    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187746    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187750    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187756    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187759    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187763    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187766    2583 flags.go:64] FLAG: --logging-format="text"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187770    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187773    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187778    2583 flags.go:64] FLAG: --manifest-url=""
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187781    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187786    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187790    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187795    2583 flags.go:64] FLAG: --max-pods="110"
Jul 30 10:48:16.195166 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187798    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187801    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187805    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187809    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187812    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187816    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187820    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187830    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187834    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187837    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187841    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187844    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187850    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187854    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187857    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187860    2583 flags.go:64] FLAG: --port="10250"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187864    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187867    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-028f1960c31fa0e3c"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187870    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187874    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187877    2583 flags.go:64] FLAG: --register-node="true"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187881    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187885    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187889    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 30 10:48:16.195863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187893    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187895    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187899    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187903    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187908    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187911    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187915    2583 flags.go:64] FLAG: --runonce="false"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187920    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187923    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187927    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187930    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187934    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187937    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187941    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187944    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187948    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187952    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187956    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187959    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187962    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187966    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187969    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187975    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187978    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187981    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 10:48:16.196515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187986    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187989    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187992    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187995    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.187999    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.188002    2583 flags.go:64] FLAG: --v="2"
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.188007    2583 flags.go:64] FLAG: --version="false"
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.188012    2583 flags.go:64] FLAG: --vmodule=""
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.188020    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.188023    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188181    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188187    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188191    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188195    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188199    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188203    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188206    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188208    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188212    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188215    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188220    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 10:48:16.197233 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188224    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188227    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188231    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188235    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188238    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188241    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188244    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188247    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188250    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188252    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188255    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188258    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188261    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188264    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188267    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188271    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188274    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188277    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188280    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188283    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 10:48:16.197938 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188286    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188289    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188293    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188296    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188312    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188317    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188320    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188323    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188326    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188329    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188332    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188335    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188338    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188342    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188345    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188349    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188352    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188356    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188359    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 10:48:16.198495 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188361    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188364    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188367    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188370    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188373    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188376    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188379    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188382    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188385    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188388    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188391    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188394    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188396    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188399    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188402    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188407    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188409    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188412    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188417    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188420    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 10:48:16.199011 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188423    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188426    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188429    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188433    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188437    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188441    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188444    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188447    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188451    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188454    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188457    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188460    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188463    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188466    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188469    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188472    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188475    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188478    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188481    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 10:48:16.199715 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188484    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188487    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188489    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188492    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188495    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188498    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188500    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188503    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188508    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.188511    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.189344    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.196914    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.196937    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.198033    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 10:48:16.200557 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.198042    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198117    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198124    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198127    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198130    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198134    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198137    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198140    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198144    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198147    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198150    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198153    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198155    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198158    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198161    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198164    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198167    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198169    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198172    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198175    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 10:48:16.201013 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198178    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198181    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198183    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198186    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198189    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198191    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198194    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198197    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198200    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198202    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198206    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198210    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198215    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198220    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198223    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198226    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198229    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198232    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198235    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 10:48:16.201640 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198237    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198250    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198255    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198259    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198262    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198265    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198267    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198271    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198274    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198276    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198279    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198282    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198286    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198290    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198293    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198297    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198301    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198306    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198310    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198315    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 10:48:16.202147 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198320    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198323    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198326    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198329    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198332    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198335    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198338    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198341    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198344    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198347    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198349    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198352    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198355    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198358    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198361    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198365    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198368    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198370    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198373    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198376    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 10:48:16.202701 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198379    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198381    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198384    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198387    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198390    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198392    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198395    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198398    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198401    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198403    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198406    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198409    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198414    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198418    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198421    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198425    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198428    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198431    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198434    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 10:48:16.203245 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198437    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198439    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.198445    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198596    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198602    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198606    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198609    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198612    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198615    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198619    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198622    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198636    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198640    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198643    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198646    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 10:48:16.203777 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198649    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198652    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198655    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198657    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198660    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198663    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198666    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198669    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198671    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198674    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198677    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198680    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198684    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198687    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198690    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198693    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198696    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198699    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198702    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198705    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 10:48:16.204187 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198707    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198710    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198713    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198716    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198719    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198721    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198724    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198728    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198731    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198733    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198736    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198739    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198741    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198744    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198747    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198750    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198753    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198755    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198760    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 10:48:16.204736 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198764    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198768    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198772    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198776    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198780    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198783    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198787    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198790    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198792    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198795    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198798    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198801    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198804    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198807    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198810    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198813    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198816    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198819    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198822    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198824    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 10:48:16.205246 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198827    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198831    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198833    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198836    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198839    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198842    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198845    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198848    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198850    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198853    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198856    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198859    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198861    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198864    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198867    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198872    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198875    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198878    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198881    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198883    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 10:48:16.205817 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198886    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198889    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198892    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198896    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198900    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198903    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198906    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:16.198909    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.198914    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.199074    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.202640    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.204043    2583 server.go:1019] "Starting client certificate rotation"
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.204161    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 10:48:16.206364 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.204199    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 10:48:16.206834 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.206816    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 10:48:16.210002 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.209976    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 10:48:16.220170 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.220144    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 30 10:48:16.222651 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.222632    2583 log.go:25] "Validated CRI v1 image API"
Jul 30 10:48:16.223580 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.223562    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 10:48:16.226322 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.226292    2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7afecde1-6634-44c4-9b57-5f99ff608131:/dev/nvme0n1p3 a1a98268-f759-4b22-a87c-ad038464e8bd:/dev/nvme0n1p4]
Jul 30 10:48:16.226395 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.226320    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 10:48:16.232809 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.232664    2583 manager.go:216] Machine: {Timestamp:2026-07-30 10:48:16.230364559 +0000 UTC m=+0.339006044 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099859 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f6038a218d80fac6f936fa6dd1e9f SystemUUID:ec2f6038-a218-d80f-ac6f-936fa6dd1e9f BootID:908b3aff-77df-4d93-9fbb-87f543ee3ec0 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:59:61:d7:0f:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:59:61:d7:0f:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:8e:97:b8:49:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 10:48:16.232809 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.232805    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 10:48:16.232919 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.232911    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 10:48:16.235378 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.235334    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 10:48:16.235548 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.235381    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-172.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 10:48:16.236429 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.236415    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 10:48:16.236474 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.236432    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 10:48:16.236474 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.236441    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 10:48:16.237152 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.237139    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 10:48:16.238257 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.238242    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 10:48:16.241056 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.241036    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 10:48:16.241213 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.241202    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 10:48:16.241260 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.241237    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 10:48:16.241260 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.241248    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 10:48:16.241334 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.241280    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 10:48:16.241334 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.241291    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 30 10:48:16.241334 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.241324    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 10:48:16.241729 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.241714    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 10:48:16.241795 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.241740    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 10:48:16.245152 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.244105    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 10:48:16.248296 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.248276    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 10:48:16.248420 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.248328    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 10:48:16.249696 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249683    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 10:48:16.249751 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249700    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 10:48:16.249751 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249707    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 10:48:16.249751 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249713    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 10:48:16.249751 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249754    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 10:48:16.249875 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249760    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 10:48:16.249875 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249769    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 10:48:16.249875 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249775    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 10:48:16.249875 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249783    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 10:48:16.249875 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249789    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 10:48:16.249875 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249799    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 10:48:16.249875 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249805    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 10:48:16.249875 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249826    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 10:48:16.249875 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.249832    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 10:48:16.255316 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.255266    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-172.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 10:48:16.255316 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.255304    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 10:48:16.255479 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.255319    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 10:48:16.257998 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.257983    2583 server.go:1268] "Started kubelet"
Jul 30 10:48:16.258116 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.258063    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 10:48:16.258178 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.258100    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 10:48:16.258178 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.258172    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 10:48:16.258943 ip-10-0-134-172 systemd[1]: Started Kubernetes Kubelet.
Jul 30 10:48:16.259418 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.259402    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 10:48:16.260625 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.260607    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 10:48:16.262431 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.262411    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 10:48:16.263062 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.263037    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 10:48:16.263343 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.262290    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-172.ec2.internal.18c70b915e6b5c77  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-172.ec2.internal,UID:ip-10-0-134-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-172.ec2.internal,},FirstTimestamp:2026-07-30 10:48:16.257948791 +0000 UTC m=+0.366590278,LastTimestamp:2026-07-30 10:48:16.257948791 +0000 UTC m=+0.366590278,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-172.ec2.internal,}"
Jul 30 10:48:16.266263 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.266243    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 10:48:16.266263 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.266258    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 10:48:16.266414 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.266403    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:16.266946 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.266884    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 10:48:16.266946 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.266887    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 10:48:16.266946 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.266937    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 10:48:16.267134 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.267098    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 10:48:16.267134 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.267109    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 10:48:16.267269 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.267238    2583 factory.go:55] Registering systemd factory
Jul 30 10:48:16.267334 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.267282    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 30 10:48:16.267569 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.267545    2583 factory.go:153] Registering CRI-O factory
Jul 30 10:48:16.267569 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.267567    2583 factory.go:223] Registration of the crio container factory successfully
Jul 30 10:48:16.267700 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.267626    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 10:48:16.267700 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.267653    2583 factory.go:103] Registering Raw factory
Jul 30 10:48:16.267700 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.267668    2583 manager.go:1196] Started watching for new ooms in manager
Jul 30 10:48:16.268366 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.268169    2583 manager.go:349] Starting recovery of all containers
Jul 30 10:48:16.276065 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.276015    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 10:48:16.280918 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.280889    2583 manager.go:354] Recovery completed
Jul 30 10:48:16.283165 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.283139    2583 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 30 10:48:16.287077 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.287061    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 10:48:16.289008 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.288976    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 10:48:16.289115 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.289029    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 10:48:16.289115 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.289045    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientPID"
Jul 30 10:48:16.289688 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.289668    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 10:48:16.289760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.289688    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 10:48:16.289760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.289711    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 10:48:16.289859 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.289709    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 10:48:16.291696 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.291681    2583 policy_none.go:49] "None policy: Start"
Jul 30 10:48:16.292083 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.292073    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 10:48:16.292123 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.292091    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 10:48:16.293057 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.293045    2583 policy_none.go:47] "Start"
Jul 30 10:48:16.295186 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.295169    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 10:48:16.295270 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.295197    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 10:48:16.295270 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.295209    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientPID"
Jul 30 10:48:16.303635 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.303610    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fg8g9"
Jul 30 10:48:16.308122 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.308097    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-172.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 10:48:16.308697 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.308596    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-172.ec2.internal.18c70b91604550d7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-172.ec2.internal,UID:ip-10-0-134-172.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-172.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-172.ec2.internal,},FirstTimestamp:2026-07-30 10:48:16.289009879 +0000 UTC m=+0.397651368,LastTimestamp:2026-07-30 10:48:16.289009879 +0000 UTC m=+0.397651368,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-172.ec2.internal,}"
Jul 30 10:48:16.308793 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.308722    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 10:48:16.320563 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.320372    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fg8g9"
Jul 30 10:48:16.331199 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.331168    2583 manager.go:337] "Starting Device Plugin manager"
Jul 30 10:48:16.331374 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.331212    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 10:48:16.331374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.331224    2583 server.go:87] "Starting device plugin registration server"
Jul 30 10:48:16.331630 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.331613    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 10:48:16.331715 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.331632    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 10:48:16.331764 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.331738    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 10:48:16.331857 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.331820    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 10:48:16.331857 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.331834    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 10:48:16.332383 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.332358    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 10:48:16.332461 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.332416    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:16.432897 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.432805    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 10:48:16.434270 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.434009    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 10:48:16.434270 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.434045    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 10:48:16.434270 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.434059    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientPID"
Jul 30 10:48:16.434270 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.434087    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.451579 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.451549    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.451738 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.451588    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-172.ec2.internal\": node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:16.454392 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.454356    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 10:48:16.454536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.454404    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 10:48:16.454536 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.454428    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 10:48:16.454536 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.454467    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 10:48:16.458128 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.458106    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 10:48:16.522511 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.522470    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:16.555026 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.554979    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-172.ec2.internal"]
Jul 30 10:48:16.555211 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.555082    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 10:48:16.556216 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.556199    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 10:48:16.556314 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.556231    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 10:48:16.556314 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.556263    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientPID"
Jul 30 10:48:16.557409 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.557395    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 10:48:16.557522 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.557506    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.557572 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.557540    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 10:48:16.558246 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.558215    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 10:48:16.558343 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.558262    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 10:48:16.558343 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.558274    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientPID"
Jul 30 10:48:16.558343 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.558222    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 10:48:16.558343 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.558342    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 10:48:16.558500 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.558352    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientPID"
Jul 30 10:48:16.559375 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.559361    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.559432 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.559389    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 10:48:16.560118 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.560102    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 10:48:16.560210 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.560129    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 10:48:16.560210 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.560139    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientPID"
Jul 30 10:48:16.592377 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.592350    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-172.ec2.internal\" not found" node="ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.597052 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.597028    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-172.ec2.internal\" not found" node="ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.623539 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.623499    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:16.668860 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.668816    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2960ea1080f9c7d72dc9341ff51046ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal\" (UID: \"2960ea1080f9c7d72dc9341ff51046ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.668860 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.668864    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/208b60a38e7d4f9f8a8c29e7bc8ed82e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-172.ec2.internal\" (UID: \"208b60a38e7d4f9f8a8c29e7bc8ed82e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.669046 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.668885    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2960ea1080f9c7d72dc9341ff51046ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal\" (UID: \"2960ea1080f9c7d72dc9341ff51046ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.723746 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.723660    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:16.769962 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.769930    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2960ea1080f9c7d72dc9341ff51046ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal\" (UID: \"2960ea1080f9c7d72dc9341ff51046ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.770074 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.769974    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/208b60a38e7d4f9f8a8c29e7bc8ed82e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-172.ec2.internal\" (UID: \"208b60a38e7d4f9f8a8c29e7bc8ed82e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.770074 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.770010    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2960ea1080f9c7d72dc9341ff51046ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal\" (UID: \"2960ea1080f9c7d72dc9341ff51046ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.770074 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.770058    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2960ea1080f9c7d72dc9341ff51046ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal\" (UID: \"2960ea1080f9c7d72dc9341ff51046ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.770074 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.770057    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2960ea1080f9c7d72dc9341ff51046ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal\" (UID: \"2960ea1080f9c7d72dc9341ff51046ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.770217 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.770073    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/208b60a38e7d4f9f8a8c29e7bc8ed82e-config\") pod \"kube-apiserver-proxy-ip-10-0-134-172.ec2.internal\" (UID: \"208b60a38e7d4f9f8a8c29e7bc8ed82e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.824777 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.824737    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:16.894728 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.894690    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.900869 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:16.900845    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:16.925319 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:16.925269    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:17.028325 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:17.028210    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:17.128705 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:17.128669    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:17.170606 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.170577    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 10:48:17.203296 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.203223    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 10:48:17.203706 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.203460    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 10:48:17.203706 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.203475    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 10:48:17.228849 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:17.228806    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:17.325114 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.324979    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 10:43:16 +0000 UTC" deadline="2027-12-28 22:54:21.753406418 +0000 UTC"
Jul 30 10:48:17.325114 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.325047    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12396h6m4.428363615s"
Jul 30 10:48:17.329138 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:17.329111    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:17.399644 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.399593    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 10:48:17.401199 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.401175    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 10:48:17.401379 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.401216    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 10:48:17.401379 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.401231    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeHasSufficientPID"
Jul 30 10:48:17.429398 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:17.429366    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:17.463708 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:17.463670    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2960ea1080f9c7d72dc9341ff51046ca.slice/crio-1a52be77b7a3d789fd190d5b6ada28dd75aa05baf4c5f76fed597fa131608739 WatchSource:0}: Error finding container 1a52be77b7a3d789fd190d5b6ada28dd75aa05baf4c5f76fed597fa131608739: Status 404 returned error can't find the container with id 1a52be77b7a3d789fd190d5b6ada28dd75aa05baf4c5f76fed597fa131608739
Jul 30 10:48:17.470101 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.470083    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 10:48:17.530296 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:17.530249    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-172.ec2.internal\" not found"
Jul 30 10:48:17.599119 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.599043    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 10:48:17.600992 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.600970    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 10:48:17.668790 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.668746    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:17.700248 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.700215    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 10:48:17.701389 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.701367    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-172.ec2.internal"
Jul 30 10:48:17.719088 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:17.719061    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 10:48:17.926730 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:17.926692    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208b60a38e7d4f9f8a8c29e7bc8ed82e.slice/crio-e3e445315905fb682ae8df4a2d2817701f249adf17fabda7b724765795a4886f WatchSource:0}: Error finding container e3e445315905fb682ae8df4a2d2817701f249adf17fabda7b724765795a4886f: Status 404 returned error can't find the container with id e3e445315905fb682ae8df4a2d2817701f249adf17fabda7b724765795a4886f
Jul 30 10:48:18.242726 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.242631    2583 apiserver.go:52] "Watching apiserver"
Jul 30 10:48:18.251459 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.251425    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 10:48:18.253658 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.253625    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-4dhsb","openshift-multus/multus-4tqt2","openshift-multus/network-metrics-daemon-zxmk8","kube-system/konnectivity-agent-wqnvf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal","openshift-multus/multus-additional-cni-plugins-9vxjg","openshift-network-diagnostics/network-check-target-2k9m9","openshift-network-operator/iptables-alerter-c568g","openshift-ovn-kubernetes/ovnkube-node-lq9dc","kube-system/global-pull-secret-syncer-lhgvv","kube-system/kube-apiserver-proxy-ip-10-0-134-172.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw","openshift-cluster-node-tuning-operator/tuned-8v5pk","openshift-dns/node-resolver-sjhld"]
Jul 30 10:48:18.254979 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.254949    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:18.255117 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.255051    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:18.256196 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.256172    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.257350 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.257322    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:18.257454 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.257398    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:18.258917 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.258898    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4dhsb"
Jul 30 10:48:18.260360 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.260047    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:18.261318 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.261288    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.262572 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.262548    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c568g"
Jul 30 10:48:18.263875 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.263857    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.264948 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.264921    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 10:48:18.265601 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.265581    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:18.265702 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.265671    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:18.266428 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.266405    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 10:48:18.267168 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.267147    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.267550 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.267533    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 10:48:18.267896 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.267872    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 10:48:18.268550 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.268524    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.268550 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.268544    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 10:48:18.269863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.269841    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sjhld"
Jul 30 10:48:18.270547 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.270526    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 10:48:18.270688 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.270648    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 10:48:18.274180 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.274146    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 10:48:18.274351 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.274254    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 10:48:18.274351 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.274270    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 10:48:18.274513 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.274493    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 10:48:18.274570 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.274524    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 10:48:18.274625 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.274580    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 10:48:18.274742 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.274726    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 10:48:18.274843 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.274802    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dhsm7\""
Jul 30 10:48:18.275788 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.275592    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 10:48:18.275788 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.275628    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 10:48:18.275788 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.275640    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 10:48:18.275788 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.275785    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 10:48:18.276018 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.275923    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rgfwk\""
Jul 30 10:48:18.276018 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.276013    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 10:48:18.276107 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.275928    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zkcqp\""
Jul 30 10:48:18.277855 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.277829    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-host\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.277958 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.277881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-device-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.277958 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.277919    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dd6r\" (UniqueName: \"kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r\") pod \"network-check-target-2k9m9\" (UID: \"704b9252-e4e1-4e0b-a54c-9a6dcc914d63\") " pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:18.278068 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.277955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c2fa329-943e-4c24-964b-215e2b6c8e44-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.278068 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.277986    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.278194 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69e964c4-9eb3-434b-b409-dcba82cb4343-cni-binary-copy\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.278256 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-socket-dir-parent\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.278349 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278252    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-run-k8s-cni-cncf-io\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.278409 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-hostroot\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.278461 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278425    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.278521 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278484    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-socket-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.278576 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-kubelet\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.278640 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-env-overrides\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.278694 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278660    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:18.278769 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278749    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:18.278823 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-system-cni-dir\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.278877 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-modprobe-d\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.278877 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278868    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-tmp\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.278996 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.278978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-var-lib-kubelet\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.279103 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-conf-dir\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.279103 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-cni-netd\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.279199 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqk44\" (UniqueName: \"kubernetes.io/projected/77082cc8-9009-41dd-94b1-7e056b4ef169-kube-api-access-fqk44\") pod \"node-ca-4dhsb\" (UID: \"77082cc8-9009-41dd-94b1-7e056b4ef169\") " pod="openshift-image-registry/node-ca-4dhsb"
Jul 30 10:48:18.279199 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a647f52c-c1f7-42e3-aee3-9d0876f03ba2-agent-certs\") pod \"konnectivity-agent-wqnvf\" (UID: \"a647f52c-c1f7-42e3-aee3-9d0876f03ba2\") " pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:18.279295 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-var-lib-kubelet\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.279295 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279271    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-sys\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.279418 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279334    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-registration-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.279418 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279392    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwhzc\" (UniqueName: \"kubernetes.io/projected/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-kube-api-access-lwhzc\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.279511 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279424    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-run-multus-certs\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.279511 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279473    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzjqj\" (UniqueName: \"kubernetes.io/projected/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-kube-api-access-kzjqj\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.279511 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279500    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-kubernetes\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.279651 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-sysctl-d\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.279651 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-sysctl-conf\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.279651 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279603    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dca16b48-de30-4ef9-a52e-4f838449edeb-iptables-alerter-script\") pod \"iptables-alerter-c568g\" (UID: \"dca16b48-de30-4ef9-a52e-4f838449edeb\") " pod="openshift-network-operator/iptables-alerter-c568g"
Jul 30 10:48:18.279789 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dca16b48-de30-4ef9-a52e-4f838449edeb-host-slash\") pod \"iptables-alerter-c568g\" (UID: \"dca16b48-de30-4ef9-a52e-4f838449edeb\") " pod="openshift-network-operator/iptables-alerter-c568g"
Jul 30 10:48:18.279789 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279704    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-var-lib-cni-bin\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.279789 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279747    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7329a22-fb04-44b6-9746-fac8c5e02216-dbus\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:18.279925 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279785    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.279925 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-sysconfig\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.279925 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279851    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf6vn\" (UniqueName: \"kubernetes.io/projected/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-kube-api-access-xf6vn\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.279925 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279901    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-system-cni-dir\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.280113 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-cni-dir\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.280113 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.279979    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-var-lib-cni-multus\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.280113 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280011    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-etc-kubernetes\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.280113 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-var-lib-openvswitch\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.280113 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-etc-openvswitch\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.280113 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280108    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-log-socket\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.280418 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280142    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-ovnkube-script-lib\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.280418 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280245    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a647f52c-c1f7-42e3-aee3-9d0876f03ba2-konnectivity-ca\") pod \"konnectivity-agent-wqnvf\" (UID: \"a647f52c-c1f7-42e3-aee3-9d0876f03ba2\") " pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:18.280418 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280283    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-cnibin\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.280418 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c2fa329-943e-4c24-964b-215e2b6c8e44-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.280418 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280385    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-run-netns\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.280651 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.280651 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-cni-bin\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.280651 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280483    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mk2v\" (UniqueName: \"kubernetes.io/projected/4c2fa329-943e-4c24-964b-215e2b6c8e44-kube-api-access-4mk2v\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.280651 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-os-release\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.280651 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-run\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.280651 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.280651 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280614    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-run-systemd\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.281038 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280650    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-ovn-node-metrics-cert\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.281038 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-os-release\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.281038 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280723    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdf6m\" (UniqueName: \"kubernetes.io/projected/dca16b48-de30-4ef9-a52e-4f838449edeb-kube-api-access-pdf6m\") pod \"iptables-alerter-c568g\" (UID: \"dca16b48-de30-4ef9-a52e-4f838449edeb\") " pod="openshift-network-operator/iptables-alerter-c568g"
Jul 30 10:48:18.281038 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280773    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-systemd\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.281038 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280806    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-cnibin\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.281038 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-sys-fs\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.281038 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.280982    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 10:48:18.281038 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281005    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-run-openvswitch\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281043    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-node-log\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281072    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-lib-modules\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281094    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-run-netns\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281144    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-systemd-units\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281186    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgp4q\" (UniqueName: \"kubernetes.io/projected/6eee8b57-b110-4823-ba5d-4aa4a7420380-kube-api-access-xgp4q\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281220    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77082cc8-9009-41dd-94b1-7e056b4ef169-serviceca\") pod \"node-ca-4dhsb\" (UID: \"77082cc8-9009-41dd-94b1-7e056b4ef169\") " pod="openshift-image-registry/node-ca-4dhsb"
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281249    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-tuned\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281267    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281282    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7329a22-fb04-44b6-9746-fac8c5e02216-kubelet-config\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281341    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77082cc8-9009-41dd-94b1-7e056b4ef169-host\") pod \"node-ca-4dhsb\" (UID: \"77082cc8-9009-41dd-94b1-7e056b4ef169\") " pod="openshift-image-registry/node-ca-4dhsb"
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281406    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b64dz\""
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281426    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 10:48:18.281463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c2fa329-943e-4c24-964b-215e2b6c8e44-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.282398 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281495    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-daemon-config\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.282398 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77qv5\" (UniqueName: \"kubernetes.io/projected/69e964c4-9eb3-434b-b409-dcba82cb4343-kube-api-access-77qv5\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.282398 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281552    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 10:48:18.282398 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281566    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-slash\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.282398 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281610    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-run-ovn\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.282398 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-ovnkube-config\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.282398 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.281723    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 10:48:18.282398 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.282141    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pb95p\""
Jul 30 10:48:18.282398 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.282372    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 10:48:18.282398 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.282384    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m7j5j\""
Jul 30 10:48:18.282821 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.282553    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pg7ns\""
Jul 30 10:48:18.283385 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.283357    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 10:48:18.292840 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.292812    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-shpkg\""
Jul 30 10:48:18.293316 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.293206    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 10:48:18.293609 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.293587    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7xsrz\""
Jul 30 10:48:18.326640 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.326611    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 10:48:18.347387 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.347347    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mt84x"
Jul 30 10:48:18.362018 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.361977    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mt84x"
Jul 30 10:48:18.367858 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.367829    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 10:48:18.382810 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.382771    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dd6r\" (UniqueName: \"kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r\") pod \"network-check-target-2k9m9\" (UID: \"704b9252-e4e1-4e0b-a54c-9a6dcc914d63\") " pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:18.382810 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.382820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c2fa329-943e-4c24-964b-215e2b6c8e44-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.383075 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.382850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.383075 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.382877    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69e964c4-9eb3-434b-b409-dcba82cb4343-cni-binary-copy\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.383075 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.382905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-socket-dir-parent\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.383075 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.382929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-run-k8s-cni-cncf-io\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.383075 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.382953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-hostroot\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.383075 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383002    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.383075 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383028    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-socket-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.383075 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-kubelet\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-env-overrides\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383115    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383140    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-system-cni-dir\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-modprobe-d\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383203    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-tmp\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-var-lib-kubelet\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-conf-dir\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-cni-netd\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383313    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqk44\" (UniqueName: \"kubernetes.io/projected/77082cc8-9009-41dd-94b1-7e056b4ef169-kube-api-access-fqk44\") pod \"node-ca-4dhsb\" (UID: \"77082cc8-9009-41dd-94b1-7e056b4ef169\") " pod="openshift-image-registry/node-ca-4dhsb"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383337    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a647f52c-c1f7-42e3-aee3-9d0876f03ba2-agent-certs\") pod \"konnectivity-agent-wqnvf\" (UID: \"a647f52c-c1f7-42e3-aee3-9d0876f03ba2\") " pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383354    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-var-lib-kubelet\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383374    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-sys\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-registration-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwhzc\" (UniqueName: \"kubernetes.io/projected/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-kube-api-access-lwhzc\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-run-multus-certs\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.383526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzjqj\" (UniqueName: \"kubernetes.io/projected/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-kube-api-access-kzjqj\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.383582    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.383688    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs podName:6eee8b57-b110-4823-ba5d-4aa4a7420380 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:18.883635204 +0000 UTC m=+2.992276696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs") pod "network-metrics-daemon-zxmk8" (UID: "6eee8b57-b110-4823-ba5d-4aa4a7420380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383729    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-hostroot\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383800    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-var-lib-kubelet\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383834    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383850    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-conf-dir\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383891    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-kubelet\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.383983    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-socket-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384033    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-cni-netd\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384068    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-kubernetes\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384067    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-sysctl-d\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384126    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-sys\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-sysctl-conf\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384171    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-registration-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384203    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dca16b48-de30-4ef9-a52e-4f838449edeb-iptables-alerter-script\") pod \"iptables-alerter-c568g\" (UID: \"dca16b48-de30-4ef9-a52e-4f838449edeb\") " pod="openshift-network-operator/iptables-alerter-c568g"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384232    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dca16b48-de30-4ef9-a52e-4f838449edeb-host-slash\") pod \"iptables-alerter-c568g\" (UID: \"dca16b48-de30-4ef9-a52e-4f838449edeb\") " pod="openshift-network-operator/iptables-alerter-c568g"
Jul 30 10:48:18.384374 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-var-lib-cni-bin\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384285    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7329a22-fb04-44b6-9746-fac8c5e02216-dbus\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384346    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-env-overrides\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-sysconfig\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384385    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-run-multus-certs\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6vn\" (UniqueName: \"kubernetes.io/projected/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-kube-api-access-xf6vn\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384436    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c2fa329-943e-4c24-964b-215e2b6c8e44-cni-binary-copy\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384434    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-system-cni-dir\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.384469    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-cni-dir\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384498    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-system-cni-dir\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384515    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-socket-dir-parent\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.384526    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret podName:d7329a22-fb04-44b6-9746-fac8c5e02216 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:18.884508228 +0000 UTC m=+2.993149705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret") pod "global-pull-secret-syncer-lhgvv" (UID: "d7329a22-fb04-44b6-9746-fac8c5e02216") : object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-cni-dir\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384577    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-kubernetes\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.385267 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-var-lib-cni-multus\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384588    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-run-k8s-cni-cncf-io\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384700    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-sysctl-d\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384714    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-modprobe-d\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384776    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-var-lib-kubelet\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384784    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-etc-kubernetes\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384778    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-var-lib-cni-multus\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384473    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-system-cni-dir\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384840    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-sysconfig\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384852    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384904    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dca16b48-de30-4ef9-a52e-4f838449edeb-host-slash\") pod \"iptables-alerter-c568g\" (UID: \"dca16b48-de30-4ef9-a52e-4f838449edeb\") " pod="openshift-network-operator/iptables-alerter-c568g"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.384961    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-var-lib-cni-bin\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-var-lib-openvswitch\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-etc-openvswitch\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-log-socket\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-ovnkube-script-lib\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385088    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d7329a22-fb04-44b6-9746-fac8c5e02216-dbus\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385096    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69e964c4-9eb3-434b-b409-dcba82cb4343-cni-binary-copy\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.386177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a647f52c-c1f7-42e3-aee3-9d0876f03ba2-konnectivity-ca\") pod \"konnectivity-agent-wqnvf\" (UID: \"a647f52c-c1f7-42e3-aee3-9d0876f03ba2\") " pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385117    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-etc-openvswitch\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-cnibin\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385144    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-log-socket\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-etc-kubernetes\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c2fa329-943e-4c24-964b-215e2b6c8e44-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-run-netns\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385203    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-sysctl-conf\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385208    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-cnibin\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385216    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-cni-bin\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385271    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dca16b48-de30-4ef9-a52e-4f838449edeb-iptables-alerter-script\") pod \"iptables-alerter-c568g\" (UID: \"dca16b48-de30-4ef9-a52e-4f838449edeb\") " pod="openshift-network-operator/iptables-alerter-c568g"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385291    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mk2v\" (UniqueName: \"kubernetes.io/projected/4c2fa329-943e-4c24-964b-215e2b6c8e44-kube-api-access-4mk2v\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385169    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-var-lib-openvswitch\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385321    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlbpk\" (UniqueName: \"kubernetes.io/projected/1d9343d5-be95-4cc3-a06e-fed71ab42557-kube-api-access-jlbpk\") pod \"node-resolver-sjhld\" (UID: \"1d9343d5-be95-4cc3-a06e-fed71ab42557\") " pod="openshift-dns/node-resolver-sjhld"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385362    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-cni-bin\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385366    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-os-release\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.387073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-run\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385419    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-run-systemd\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385473    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-ovn-node-metrics-cert\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385501    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-os-release\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdf6m\" (UniqueName: \"kubernetes.io/projected/dca16b48-de30-4ef9-a52e-4f838449edeb-kube-api-access-pdf6m\") pod \"iptables-alerter-c568g\" (UID: \"dca16b48-de30-4ef9-a52e-4f838449edeb\") " pod="openshift-network-operator/iptables-alerter-c568g"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-systemd\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-cnibin\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-sys-fs\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385644    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-run-openvswitch\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385699    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-node-log\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-lib-modules\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385735    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-run-ovn-kubernetes\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c2fa329-943e-4c24-964b-215e2b6c8e44-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385777    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-ovnkube-script-lib\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-run-netns\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.387983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385789    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-cnibin\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a647f52c-c1f7-42e3-aee3-9d0876f03ba2-konnectivity-ca\") pod \"konnectivity-agent-wqnvf\" (UID: \"a647f52c-c1f7-42e3-aee3-9d0876f03ba2\") " pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385801    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-node-log\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385801    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-run-openvswitch\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-host-run-netns\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385697    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-run-netns\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385850    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-run\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385854    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-run-systemd\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385858    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69e964c4-9eb3-434b-b409-dcba82cb4343-os-release\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385901    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-systemd\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385907    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-sys-fs\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385902    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-lib-modules\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385939    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-systemd-units\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385950    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c2fa329-943e-4c24-964b-215e2b6c8e44-os-release\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgp4q\" (UniqueName: \"kubernetes.io/projected/6eee8b57-b110-4823-ba5d-4aa4a7420380-kube-api-access-xgp4q\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.385990    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-systemd-units\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386025    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77082cc8-9009-41dd-94b1-7e056b4ef169-serviceca\") pod \"node-ca-4dhsb\" (UID: \"77082cc8-9009-41dd-94b1-7e056b4ef169\") " pod="openshift-image-registry/node-ca-4dhsb"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386147    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d9343d5-be95-4cc3-a06e-fed71ab42557-hosts-file\") pod \"node-resolver-sjhld\" (UID: \"1d9343d5-be95-4cc3-a06e-fed71ab42557\") " pod="openshift-dns/node-resolver-sjhld"
Jul 30 10:48:18.388760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-tuned\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7329a22-fb04-44b6-9746-fac8c5e02216-kubelet-config\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386320    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77082cc8-9009-41dd-94b1-7e056b4ef169-host\") pod \"node-ca-4dhsb\" (UID: \"77082cc8-9009-41dd-94b1-7e056b4ef169\") " pod="openshift-image-registry/node-ca-4dhsb"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c2fa329-943e-4c24-964b-215e2b6c8e44-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-daemon-config\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77qv5\" (UniqueName: \"kubernetes.io/projected/69e964c4-9eb3-434b-b409-dcba82cb4343-kube-api-access-77qv5\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386426    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-slash\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-run-ovn\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-ovnkube-config\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386505    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d9343d5-be95-4cc3-a06e-fed71ab42557-tmp-dir\") pod \"node-resolver-sjhld\" (UID: \"1d9343d5-be95-4cc3-a06e-fed71ab42557\") " pod="openshift-dns/node-resolver-sjhld"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386530    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-host\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386552    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77082cc8-9009-41dd-94b1-7e056b4ef169-serviceca\") pod \"node-ca-4dhsb\" (UID: \"77082cc8-9009-41dd-94b1-7e056b4ef169\") " pod="openshift-image-registry/node-ca-4dhsb"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386556    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-device-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386606    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-device-dir\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386653    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-run-ovn\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386683    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d7329a22-fb04-44b6-9746-fac8c5e02216-kubelet-config\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.386730    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77082cc8-9009-41dd-94b1-7e056b4ef169-host\") pod \"node-ca-4dhsb\" (UID: \"77082cc8-9009-41dd-94b1-7e056b4ef169\") " pod="openshift-image-registry/node-ca-4dhsb"
Jul 30 10:48:18.389359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.387249    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c2fa329-943e-4c24-964b-215e2b6c8e44-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.389903 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.387391    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-host\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.389903 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.387415    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-ovnkube-config\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.389903 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.387455    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-host-slash\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.389903 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.387739    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69e964c4-9eb3-434b-b409-dcba82cb4343-multus-daemon-config\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.389903 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.387811    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-tmp\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.389903 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.387923    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a647f52c-c1f7-42e3-aee3-9d0876f03ba2-agent-certs\") pod \"konnectivity-agent-wqnvf\" (UID: \"a647f52c-c1f7-42e3-aee3-9d0876f03ba2\") " pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:18.389903 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.388763    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-etc-tuned\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.389903 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.388798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-ovn-node-metrics-cert\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.414146 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.414113    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdf6m\" (UniqueName: \"kubernetes.io/projected/dca16b48-de30-4ef9-a52e-4f838449edeb-kube-api-access-pdf6m\") pod \"iptables-alerter-c568g\" (UID: \"dca16b48-de30-4ef9-a52e-4f838449edeb\") " pod="openshift-network-operator/iptables-alerter-c568g"
Jul 30 10:48:18.414748 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.414725    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77qv5\" (UniqueName: \"kubernetes.io/projected/69e964c4-9eb3-434b-b409-dcba82cb4343-kube-api-access-77qv5\") pod \"multus-4tqt2\" (UID: \"69e964c4-9eb3-434b-b409-dcba82cb4343\") " pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.417714 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.417688    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 10:48:18.417714 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.417717    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 10:48:18.417902 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.417731    2583 projected.go:196] Error preparing data for projected volume kube-api-access-8dd6r for pod openshift-network-diagnostics/network-check-target-2k9m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:18.417902 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.417829    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r podName:704b9252-e4e1-4e0b-a54c-9a6dcc914d63 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:18.917783838 +0000 UTC m=+3.026425324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8dd6r" (UniqueName: "kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r") pod "network-check-target-2k9m9" (UID: "704b9252-e4e1-4e0b-a54c-9a6dcc914d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:18.420538 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.420510    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwhzc\" (UniqueName: \"kubernetes.io/projected/aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d-kube-api-access-lwhzc\") pod \"ovnkube-node-lq9dc\" (UID: \"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d\") " pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.420663 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.420566    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mk2v\" (UniqueName: \"kubernetes.io/projected/4c2fa329-943e-4c24-964b-215e2b6c8e44-kube-api-access-4mk2v\") pod \"multus-additional-cni-plugins-9vxjg\" (UID: \"4c2fa329-943e-4c24-964b-215e2b6c8e44\") " pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.422875 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.422852    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgp4q\" (UniqueName: \"kubernetes.io/projected/6eee8b57-b110-4823-ba5d-4aa4a7420380-kube-api-access-xgp4q\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:18.423406 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.423382    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf6vn\" (UniqueName: \"kubernetes.io/projected/77dcdfde-65ee-43cd-ac7e-2e5f78f8e378-kube-api-access-xf6vn\") pod \"tuned-8v5pk\" (UID: \"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378\") " pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.424241 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.424214    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqk44\" (UniqueName: \"kubernetes.io/projected/77082cc8-9009-41dd-94b1-7e056b4ef169-kube-api-access-fqk44\") pod \"node-ca-4dhsb\" (UID: \"77082cc8-9009-41dd-94b1-7e056b4ef169\") " pod="openshift-image-registry/node-ca-4dhsb"
Jul 30 10:48:18.426507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.426479    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzjqj\" (UniqueName: \"kubernetes.io/projected/0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a-kube-api-access-kzjqj\") pod \"aws-ebs-csi-driver-node-dnvkw\" (UID: \"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.460033 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.459967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-172.ec2.internal" event={"ID":"208b60a38e7d4f9f8a8c29e7bc8ed82e","Type":"ContainerStarted","Data":"e3e445315905fb682ae8df4a2d2817701f249adf17fabda7b724765795a4886f"}
Jul 30 10:48:18.461502 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.461473    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal" event={"ID":"2960ea1080f9c7d72dc9341ff51046ca","Type":"ContainerStarted","Data":"1a52be77b7a3d789fd190d5b6ada28dd75aa05baf4c5f76fed597fa131608739"}
Jul 30 10:48:18.487255 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.487212    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlbpk\" (UniqueName: \"kubernetes.io/projected/1d9343d5-be95-4cc3-a06e-fed71ab42557-kube-api-access-jlbpk\") pod \"node-resolver-sjhld\" (UID: \"1d9343d5-be95-4cc3-a06e-fed71ab42557\") " pod="openshift-dns/node-resolver-sjhld"
Jul 30 10:48:18.487500 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.487280    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d9343d5-be95-4cc3-a06e-fed71ab42557-hosts-file\") pod \"node-resolver-sjhld\" (UID: \"1d9343d5-be95-4cc3-a06e-fed71ab42557\") " pod="openshift-dns/node-resolver-sjhld"
Jul 30 10:48:18.487500 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.487303    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d9343d5-be95-4cc3-a06e-fed71ab42557-tmp-dir\") pod \"node-resolver-sjhld\" (UID: \"1d9343d5-be95-4cc3-a06e-fed71ab42557\") " pod="openshift-dns/node-resolver-sjhld"
Jul 30 10:48:18.487500 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.487415    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d9343d5-be95-4cc3-a06e-fed71ab42557-hosts-file\") pod \"node-resolver-sjhld\" (UID: \"1d9343d5-be95-4cc3-a06e-fed71ab42557\") " pod="openshift-dns/node-resolver-sjhld"
Jul 30 10:48:18.487743 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.487665    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d9343d5-be95-4cc3-a06e-fed71ab42557-tmp-dir\") pod \"node-resolver-sjhld\" (UID: \"1d9343d5-be95-4cc3-a06e-fed71ab42557\") " pod="openshift-dns/node-resolver-sjhld"
Jul 30 10:48:18.503890 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.503807    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 10:48:18.508243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.508197    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlbpk\" (UniqueName: \"kubernetes.io/projected/1d9343d5-be95-4cc3-a06e-fed71ab42557-kube-api-access-jlbpk\") pod \"node-resolver-sjhld\" (UID: \"1d9343d5-be95-4cc3-a06e-fed71ab42557\") " pod="openshift-dns/node-resolver-sjhld"
Jul 30 10:48:18.568474 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.568431    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:18.576324 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.576289    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4dhsb"
Jul 30 10:48:18.588447 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.588415    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:18.592402 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.592378    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9vxjg"
Jul 30 10:48:18.601227 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.601192    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c568g"
Jul 30 10:48:18.607986 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.607950    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4tqt2"
Jul 30 10:48:18.615864 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.615838    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw"
Jul 30 10:48:18.622320 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.622286    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8v5pk"
Jul 30 10:48:18.629197 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.629173    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sjhld"
Jul 30 10:48:18.865446 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:18.865259    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4722fa_f9aa_4b42_9d5f_c922bdc0fb9d.slice/crio-41f22b12f2ab71d6eb952ce84b2871e79ec4ffe1ba7adf3ccd6329f47888cebe WatchSource:0}: Error finding container 41f22b12f2ab71d6eb952ce84b2871e79ec4ffe1ba7adf3ccd6329f47888cebe: Status 404 returned error can't find the container with id 41f22b12f2ab71d6eb952ce84b2871e79ec4ffe1ba7adf3ccd6329f47888cebe
Jul 30 10:48:18.867094 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:18.867062    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2fa329_943e_4c24_964b_215e2b6c8e44.slice/crio-73077ab1e3260331b5681c50f38411dbc9f1fc9b1b7fc95b066791ad55a6de90 WatchSource:0}: Error finding container 73077ab1e3260331b5681c50f38411dbc9f1fc9b1b7fc95b066791ad55a6de90: Status 404 returned error can't find the container with id 73077ab1e3260331b5681c50f38411dbc9f1fc9b1b7fc95b066791ad55a6de90
Jul 30 10:48:18.870424 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:18.870338    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d9343d5_be95_4cc3_a06e_fed71ab42557.slice/crio-aee09577d394c570a5d3cb47a7bf2118b6bf136adb2b2c5d27005dbe6b8d3113 WatchSource:0}: Error finding container aee09577d394c570a5d3cb47a7bf2118b6bf136adb2b2c5d27005dbe6b8d3113: Status 404 returned error can't find the container with id aee09577d394c570a5d3cb47a7bf2118b6bf136adb2b2c5d27005dbe6b8d3113
Jul 30 10:48:18.873116 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:18.873088    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca16b48_de30_4ef9_a52e_4f838449edeb.slice/crio-b1f25944338176b32694637e9a1ed14cb36abf20f5231127e28f5bf073e88abf WatchSource:0}: Error finding container b1f25944338176b32694637e9a1ed14cb36abf20f5231127e28f5bf073e88abf: Status 404 returned error can't find the container with id b1f25944338176b32694637e9a1ed14cb36abf20f5231127e28f5bf073e88abf
Jul 30 10:48:18.873775 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:18.873751    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77dcdfde_65ee_43cd_ac7e_2e5f78f8e378.slice/crio-969bb17a22a1860f78dff891d858f01d8c7115c631268fd5a3464b3093eb3763 WatchSource:0}: Error finding container 969bb17a22a1860f78dff891d858f01d8c7115c631268fd5a3464b3093eb3763: Status 404 returned error can't find the container with id 969bb17a22a1860f78dff891d858f01d8c7115c631268fd5a3464b3093eb3763
Jul 30 10:48:18.874704 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:18.874668    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda647f52c_c1f7_42e3_aee3_9d0876f03ba2.slice/crio-bd6a9610235ce6eb207ca57cf7cf845d37f11a942f1a079a669a51950e4ff8f8 WatchSource:0}: Error finding container bd6a9610235ce6eb207ca57cf7cf845d37f11a942f1a079a669a51950e4ff8f8: Status 404 returned error can't find the container with id bd6a9610235ce6eb207ca57cf7cf845d37f11a942f1a079a669a51950e4ff8f8
Jul 30 10:48:18.876663 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:18.876620    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e964c4_9eb3_434b_b409_dcba82cb4343.slice/crio-93002a8f593cda8ad99afeb1ebdc5b323eae66da4b6a77e1e3e352a4dd10961f WatchSource:0}: Error finding container 93002a8f593cda8ad99afeb1ebdc5b323eae66da4b6a77e1e3e352a4dd10961f: Status 404 returned error can't find the container with id 93002a8f593cda8ad99afeb1ebdc5b323eae66da4b6a77e1e3e352a4dd10961f
Jul 30 10:48:18.876895 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:18.876874    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0125e3_efe4_4f62_b2d7_5a4b0ab80e3a.slice/crio-8dc690230c3a7306585d06deca9517590ff1270882bbe6d6ba9c9bda77774c38 WatchSource:0}: Error finding container 8dc690230c3a7306585d06deca9517590ff1270882bbe6d6ba9c9bda77774c38: Status 404 returned error can't find the container with id 8dc690230c3a7306585d06deca9517590ff1270882bbe6d6ba9c9bda77774c38
Jul 30 10:48:18.878664 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:18.878235    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77082cc8_9009_41dd_94b1_7e056b4ef169.slice/crio-d431dfc0dd84d4999c943fb11ddb08641ea1201c13bd2c4f251656585cad11b0 WatchSource:0}: Error finding container d431dfc0dd84d4999c943fb11ddb08641ea1201c13bd2c4f251656585cad11b0: Status 404 returned error can't find the container with id d431dfc0dd84d4999c943fb11ddb08641ea1201c13bd2c4f251656585cad11b0
Jul 30 10:48:18.891109 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.891065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:18.891208 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.891108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:18.891286 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.891236    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:18.891286 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.891251    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:18.891400 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.891307    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs podName:6eee8b57-b110-4823-ba5d-4aa4a7420380 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:19.891286544 +0000 UTC m=+3.999928018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs") pod "network-metrics-daemon-zxmk8" (UID: "6eee8b57-b110-4823-ba5d-4aa4a7420380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:18.891400 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.891327    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret podName:d7329a22-fb04-44b6-9746-fac8c5e02216 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:19.891317354 +0000 UTC m=+3.999958827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret") pod "global-pull-secret-syncer-lhgvv" (UID: "d7329a22-fb04-44b6-9746-fac8c5e02216") : object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:18.992359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:18.992323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dd6r\" (UniqueName: \"kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r\") pod \"network-check-target-2k9m9\" (UID: \"704b9252-e4e1-4e0b-a54c-9a6dcc914d63\") " pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:18.992525 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.992508    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 10:48:18.992570 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.992526    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 10:48:18.992570 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.992536    2583 projected.go:196] Error preparing data for projected volume kube-api-access-8dd6r for pod openshift-network-diagnostics/network-check-target-2k9m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:18.992651 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:18.992587    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r podName:704b9252-e4e1-4e0b-a54c-9a6dcc914d63 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:19.992570082 +0000 UTC m=+4.101211558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dd6r" (UniqueName: "kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r") pod "network-check-target-2k9m9" (UID: "704b9252-e4e1-4e0b-a54c-9a6dcc914d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:19.324149 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.323998    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 10:48:19.364740 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.364400    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 10:43:18 +0000 UTC" deadline="2028-04-26 08:19:30.884599426 +0000 UTC"
Jul 30 10:48:19.364740 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.364654    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15261h31m11.519951985s"
Jul 30 10:48:19.489361 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.489245    2583 generic.go:356] "Generic (PLEG): container finished" podID="2960ea1080f9c7d72dc9341ff51046ca" containerID="caa01548c2f6ffdb8834b48545cc85cdafd4f1f34440c788e0fe9d4b2d1a0b89" exitCode=0
Jul 30 10:48:19.489535 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.489390    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal" event={"ID":"2960ea1080f9c7d72dc9341ff51046ca","Type":"ContainerDied","Data":"caa01548c2f6ffdb8834b48545cc85cdafd4f1f34440c788e0fe9d4b2d1a0b89"}
Jul 30 10:48:19.499341 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.497054    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4dhsb" event={"ID":"77082cc8-9009-41dd-94b1-7e056b4ef169","Type":"ContainerStarted","Data":"d431dfc0dd84d4999c943fb11ddb08641ea1201c13bd2c4f251656585cad11b0"}
Jul 30 10:48:19.512324 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.505149    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqnvf" event={"ID":"a647f52c-c1f7-42e3-aee3-9d0876f03ba2","Type":"ContainerStarted","Data":"bd6a9610235ce6eb207ca57cf7cf845d37f11a942f1a079a669a51950e4ff8f8"}
Jul 30 10:48:19.512324 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.508869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c568g" event={"ID":"dca16b48-de30-4ef9-a52e-4f838449edeb","Type":"ContainerStarted","Data":"b1f25944338176b32694637e9a1ed14cb36abf20f5231127e28f5bf073e88abf"}
Jul 30 10:48:19.521836 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.521800    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vxjg" event={"ID":"4c2fa329-943e-4c24-964b-215e2b6c8e44","Type":"ContainerStarted","Data":"73077ab1e3260331b5681c50f38411dbc9f1fc9b1b7fc95b066791ad55a6de90"}
Jul 30 10:48:19.530464 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.530429    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8v5pk" event={"ID":"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378","Type":"ContainerStarted","Data":"969bb17a22a1860f78dff891d858f01d8c7115c631268fd5a3464b3093eb3763"}
Jul 30 10:48:19.540393 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.540355    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw" event={"ID":"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a","Type":"ContainerStarted","Data":"8dc690230c3a7306585d06deca9517590ff1270882bbe6d6ba9c9bda77774c38"}
Jul 30 10:48:19.560814 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.560775    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4tqt2" event={"ID":"69e964c4-9eb3-434b-b409-dcba82cb4343","Type":"ContainerStarted","Data":"93002a8f593cda8ad99afeb1ebdc5b323eae66da4b6a77e1e3e352a4dd10961f"}
Jul 30 10:48:19.569844 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.569808    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sjhld" event={"ID":"1d9343d5-be95-4cc3-a06e-fed71ab42557","Type":"ContainerStarted","Data":"aee09577d394c570a5d3cb47a7bf2118b6bf136adb2b2c5d27005dbe6b8d3113"}
Jul 30 10:48:19.579705 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.579668    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc" event={"ID":"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d","Type":"ContainerStarted","Data":"41f22b12f2ab71d6eb952ce84b2871e79ec4ffe1ba7adf3ccd6329f47888cebe"}
Jul 30 10:48:19.901533 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.901486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:19.901738 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:19.901546    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:19.901738 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:19.901718    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:19.901849 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:19.901788    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs podName:6eee8b57-b110-4823-ba5d-4aa4a7420380 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:21.901767163 +0000 UTC m=+6.010408662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs") pod "network-metrics-daemon-zxmk8" (UID: "6eee8b57-b110-4823-ba5d-4aa4a7420380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:19.902248 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:19.902231    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:19.902345 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:19.902292    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret podName:d7329a22-fb04-44b6-9746-fac8c5e02216 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:21.902274976 +0000 UTC m=+6.010916454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret") pod "global-pull-secret-syncer-lhgvv" (UID: "d7329a22-fb04-44b6-9746-fac8c5e02216") : object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:20.002286 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:20.002161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dd6r\" (UniqueName: \"kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r\") pod \"network-check-target-2k9m9\" (UID: \"704b9252-e4e1-4e0b-a54c-9a6dcc914d63\") " pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:20.002489 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:20.002435    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 10:48:20.002489 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:20.002460    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 10:48:20.002489 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:20.002475    2583 projected.go:196] Error preparing data for projected volume kube-api-access-8dd6r for pod openshift-network-diagnostics/network-check-target-2k9m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:20.002654 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:20.002540    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r podName:704b9252-e4e1-4e0b-a54c-9a6dcc914d63 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:22.002520542 +0000 UTC m=+6.111162017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dd6r" (UniqueName: "kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r") pod "network-check-target-2k9m9" (UID: "704b9252-e4e1-4e0b-a54c-9a6dcc914d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:20.365175 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:20.365102    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 10:43:18 +0000 UTC" deadline="2028-05-14 20:52:24.459671232 +0000 UTC"
Jul 30 10:48:20.365175 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:20.365171    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15706h4m4.094504749s"
Jul 30 10:48:20.455378 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:20.455341    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:20.455569 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:20.455505    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:20.455970 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:20.455935    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:20.456082 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:20.456058    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:20.456149 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:20.456133    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:20.456234 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:20.456215    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:20.596813 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:20.596721    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal" event={"ID":"2960ea1080f9c7d72dc9341ff51046ca","Type":"ContainerStarted","Data":"2eac67ce7b200949c06845f3786d3208ce25e8196b0571e625105a84c57ea0bc"}
Jul 30 10:48:20.625942 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:20.625872    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-172.ec2.internal" podStartSLOduration=3.62584782 podStartE2EDuration="3.62584782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:20.624212506 +0000 UTC m=+4.732854002" watchObservedRunningTime="2026-07-30 10:48:20.62584782 +0000 UTC m=+4.734489316"
Jul 30 10:48:21.920527 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:21.920481    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:21.920989 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:21.920540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:21.920989 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:21.920700    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:21.920989 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:21.920769    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs podName:6eee8b57-b110-4823-ba5d-4aa4a7420380 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:25.920743005 +0000 UTC m=+10.029384478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs") pod "network-metrics-daemon-zxmk8" (UID: "6eee8b57-b110-4823-ba5d-4aa4a7420380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:21.920989 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:21.920963    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:21.921218 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:21.921011    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret podName:d7329a22-fb04-44b6-9746-fac8c5e02216 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:25.920998943 +0000 UTC m=+10.029640417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret") pod "global-pull-secret-syncer-lhgvv" (UID: "d7329a22-fb04-44b6-9746-fac8c5e02216") : object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:22.021255 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:22.020955    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dd6r\" (UniqueName: \"kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r\") pod \"network-check-target-2k9m9\" (UID: \"704b9252-e4e1-4e0b-a54c-9a6dcc914d63\") " pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:22.021255 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:22.021119    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 10:48:22.021255 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:22.021141    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 10:48:22.021255 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:22.021154    2583 projected.go:196] Error preparing data for projected volume kube-api-access-8dd6r for pod openshift-network-diagnostics/network-check-target-2k9m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:22.021255 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:22.021218    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r podName:704b9252-e4e1-4e0b-a54c-9a6dcc914d63 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:26.021201161 +0000 UTC m=+10.129842634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dd6r" (UniqueName: "kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r") pod "network-check-target-2k9m9" (UID: "704b9252-e4e1-4e0b-a54c-9a6dcc914d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:22.455848 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:22.455808    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:22.456029 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:22.455808    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:22.456029 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:22.455965    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:22.456029 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:22.456022    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:22.456295 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:22.456061    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:22.456295 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:22.456107    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:24.455384 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:24.455346    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:24.455858 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:24.455347    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:24.455858 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:24.455496    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:24.455858 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:24.455496    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:24.455858 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:24.455588    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:24.455858 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:24.455672    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:25.955960 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:25.955919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:25.955960 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:25.955970    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:25.956528 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:25.956092    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:25.956528 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:25.956176    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret podName:d7329a22-fb04-44b6-9746-fac8c5e02216 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:33.956152786 +0000 UTC m=+18.064794272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret") pod "global-pull-secret-syncer-lhgvv" (UID: "d7329a22-fb04-44b6-9746-fac8c5e02216") : object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:25.956528 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:25.956096    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:25.956528 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:25.956265    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs podName:6eee8b57-b110-4823-ba5d-4aa4a7420380 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:33.956245201 +0000 UTC m=+18.064886684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs") pod "network-metrics-daemon-zxmk8" (UID: "6eee8b57-b110-4823-ba5d-4aa4a7420380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:26.057318 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:26.057108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dd6r\" (UniqueName: \"kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r\") pod \"network-check-target-2k9m9\" (UID: \"704b9252-e4e1-4e0b-a54c-9a6dcc914d63\") " pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:26.057318 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:26.057289    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 10:48:26.057318 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:26.057316    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 10:48:26.057318 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:26.057330    2583 projected.go:196] Error preparing data for projected volume kube-api-access-8dd6r for pod openshift-network-diagnostics/network-check-target-2k9m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:26.057709 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:26.057393    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r podName:704b9252-e4e1-4e0b-a54c-9a6dcc914d63 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:34.057375504 +0000 UTC m=+18.166016973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dd6r" (UniqueName: "kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r") pod "network-check-target-2k9m9" (UID: "704b9252-e4e1-4e0b-a54c-9a6dcc914d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:26.456376 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:26.456344    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:26.456537 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:26.456468    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:26.457129 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:26.456870    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:26.457129 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:26.456964    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:26.457129 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:26.457014    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:26.457129 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:26.457093    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:28.455196 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:28.455161    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:28.455678 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:28.455301    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:28.455753 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:28.455679    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:28.455787 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:28.455769    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:28.455920 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:28.455898    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:28.456008 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:28.455988    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:30.455069 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:30.455029    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:30.455566 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:30.455030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:30.455566 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:30.455186    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:30.455566 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:30.455262    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:30.455566 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:30.455394    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:30.455566 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:30.455531    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:32.455144 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:32.455106    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:32.455614 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:32.455107    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:32.455614 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:32.455269    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:32.455614 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:32.455374    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:32.455614 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:32.455448    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:32.455614 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:32.455527    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:34.019111 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:34.019067    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:34.019639 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:34.019118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:34.019639 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:34.019272    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:34.019639 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:34.019274    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:34.019639 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:34.019334    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs podName:6eee8b57-b110-4823-ba5d-4aa4a7420380 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:50.019312533 +0000 UTC m=+34.127954022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs") pod "network-metrics-daemon-zxmk8" (UID: "6eee8b57-b110-4823-ba5d-4aa4a7420380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:34.019639 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:34.019350    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret podName:d7329a22-fb04-44b6-9746-fac8c5e02216 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:50.019343833 +0000 UTC m=+34.127985302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret") pod "global-pull-secret-syncer-lhgvv" (UID: "d7329a22-fb04-44b6-9746-fac8c5e02216") : object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:34.120426 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:34.120387    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dd6r\" (UniqueName: \"kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r\") pod \"network-check-target-2k9m9\" (UID: \"704b9252-e4e1-4e0b-a54c-9a6dcc914d63\") " pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:34.120577 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:34.120533    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 10:48:34.120577 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:34.120548    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 10:48:34.120577 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:34.120557    2583 projected.go:196] Error preparing data for projected volume kube-api-access-8dd6r for pod openshift-network-diagnostics/network-check-target-2k9m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:34.120710 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:34.120609    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r podName:704b9252-e4e1-4e0b-a54c-9a6dcc914d63 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:50.120595657 +0000 UTC m=+34.229237140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dd6r" (UniqueName: "kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r") pod "network-check-target-2k9m9" (UID: "704b9252-e4e1-4e0b-a54c-9a6dcc914d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:34.454718 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:34.454633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:34.454879 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:34.454633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:34.454879 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:34.454776    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:34.454879 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:34.454796    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:34.455062 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:34.454880    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:34.455062 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:34.454966    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:36.456329 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:36.456287    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:36.456329 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:36.456312    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:36.456890 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:36.456401    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:36.456890 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:36.456479    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:36.456890 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:36.456564    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:36.456890 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:36.456723    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:38.455525 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.455196    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:38.456356 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.455192    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:38.456356 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:38.455641    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:38.456356 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.455194    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:38.456356 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:38.455688    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:38.456356 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:38.455777    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:38.637805 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.637772    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4dhsb" event={"ID":"77082cc8-9009-41dd-94b1-7e056b4ef169","Type":"ContainerStarted","Data":"e9314db64fd0888085815e0f2cf497de38b42f49e80acc503e81e7832f3649b3"}
Jul 30 10:48:38.639529 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.639503    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqnvf" event={"ID":"a647f52c-c1f7-42e3-aee3-9d0876f03ba2","Type":"ContainerStarted","Data":"f3d994114d8c058ab24e6b5349cb3e9859abea336b59952d03c9ddaaae412c4d"}
Jul 30 10:48:38.641065 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.641041    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c2fa329-943e-4c24-964b-215e2b6c8e44" containerID="b02644a64cd1f89e2201bcdad4db50ca442a422ec4c3464308509a6915e1e423" exitCode=0
Jul 30 10:48:38.641176 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.641109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vxjg" event={"ID":"4c2fa329-943e-4c24-964b-215e2b6c8e44","Type":"ContainerDied","Data":"b02644a64cd1f89e2201bcdad4db50ca442a422ec4c3464308509a6915e1e423"}
Jul 30 10:48:38.647922 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.647835    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8v5pk" event={"ID":"77dcdfde-65ee-43cd-ac7e-2e5f78f8e378","Type":"ContainerStarted","Data":"350852a7f14f9623e6390b38616c17d623c7c6a82ef69667f987f712ae60c3a7"}
Jul 30 10:48:38.649743 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.649716    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw" event={"ID":"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a","Type":"ContainerStarted","Data":"1362e2ac9ce7b1f6b67daf12a2cb240ff4ee886539c336c779550ec42217a5a5"}
Jul 30 10:48:38.651532 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.651494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4tqt2" event={"ID":"69e964c4-9eb3-434b-b409-dcba82cb4343","Type":"ContainerStarted","Data":"db902b5fdc280cbd514eca648bffe2a23e735e264086b08b53480ff88935bbb6"}
Jul 30 10:48:38.653257 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.653208    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sjhld" event={"ID":"1d9343d5-be95-4cc3-a06e-fed71ab42557","Type":"ContainerStarted","Data":"4a9fa53f4cd72b1412728202fa5c7cadd1f345938ccc8f60de106e322a04fa41"}
Jul 30 10:48:38.656283 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.656257    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc" event={"ID":"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d","Type":"ContainerStarted","Data":"39e8da69ef2620264fb159f86c10f71d22e226312da7a441684a4f18db653bb9"}
Jul 30 10:48:38.656368 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.656354    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc" event={"ID":"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d","Type":"ContainerStarted","Data":"abf2579aff975e553a7ae4125d8119f0c1fb36d4c5bb7781c7fa230cd71513f6"}
Jul 30 10:48:38.656424 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.656414    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc" event={"ID":"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d","Type":"ContainerStarted","Data":"ab2ad7961239f220d91d10ee80dadf9191769b40fa0573b35c21cb50ae997b7c"}
Jul 30 10:48:38.656479 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.656462    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc" event={"ID":"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d","Type":"ContainerStarted","Data":"2d9bc2072cf11ec8ea8220f7e35718980145f7c910e6bc697102f6a586720b3b"}
Jul 30 10:48:38.656531 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.656505    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc" event={"ID":"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d","Type":"ContainerStarted","Data":"bd6c903efdad89e95a0be65fc4c3e178cea4061af3a735ab9ca79127a46e2c5f"}
Jul 30 10:48:38.657531 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.657479    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4dhsb" podStartSLOduration=3.496827178 podStartE2EDuration="22.657462301s" totalImagesPullingTime="19.160635123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:38.657257572 +0000 UTC m=+22.765899066" watchObservedRunningTime="2026-07-30 10:48:38.657462301 +0000 UTC m=+22.766103795"
Jul 30 10:48:38.658285 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.658255    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-172.ec2.internal" event={"ID":"208b60a38e7d4f9f8a8c29e7bc8ed82e","Type":"ContainerStarted","Data":"f5360c933ffb2cf5cf31d7e0b3a91e430d5097d479f723d69623361772b80ada"}
Jul 30 10:48:38.675786 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.675738    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wqnvf" podStartSLOduration=2.5101808009999997 podStartE2EDuration="21.675720219s" totalImagesPullingTime="19.165539418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:38.675326231 +0000 UTC m=+22.783967722" watchObservedRunningTime="2026-07-30 10:48:38.675720219 +0000 UTC m=+22.784361711"
Jul 30 10:48:38.764466 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.764404    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4tqt2" podStartSLOduration=2.543931199 podStartE2EDuration="21.764381885s" totalImagesPullingTime="19.220450686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:38.764306849 +0000 UTC m=+22.872948341" watchObservedRunningTime="2026-07-30 10:48:38.764381885 +0000 UTC m=+22.873023375"
Jul 30 10:48:38.817657 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.817606    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8v5pk" podStartSLOduration=2.627294625 podStartE2EDuration="21.8175873s" totalImagesPullingTime="19.190292675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:38.817538287 +0000 UTC m=+22.926179779" watchObservedRunningTime="2026-07-30 10:48:38.8175873 +0000 UTC m=+22.926228804"
Jul 30 10:48:38.843466 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.843368    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sjhld" podStartSLOduration=2.672445083 podStartE2EDuration="21.843352021s" totalImagesPullingTime="19.170906938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:38.843133521 +0000 UTC m=+22.951775214" watchObservedRunningTime="2026-07-30 10:48:38.843352021 +0000 UTC m=+22.951993513"
Jul 30 10:48:38.865013 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:38.864939    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-172.ec2.internal" podStartSLOduration=20.864915633 podStartE2EDuration="20.864915633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:38.864644042 +0000 UTC m=+22.973285528" watchObservedRunningTime="2026-07-30 10:48:38.864915633 +0000 UTC m=+22.973557127"
Jul 30 10:48:39.531612 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:39.531566    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 10:48:39.662554 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:39.662514    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c568g" event={"ID":"dca16b48-de30-4ef9-a52e-4f838449edeb","Type":"ContainerStarted","Data":"5c9c841d36479a23f3496ca531058a1cd9d6be5c6e8dccca57660c301dc1a23c"}
Jul 30 10:48:39.664702 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:39.664669    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw" event={"ID":"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a","Type":"ContainerStarted","Data":"90cefba2c6e3415ac21535b8199531086034c95928cf207e22635474637c27bf"}
Jul 30 10:48:39.668504 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:39.668444    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc" event={"ID":"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d","Type":"ContainerStarted","Data":"0370abcd2e8de54cd757f0d2ffab3b7754a3e54df569dfce4d7d29288ffc38ca"}
Jul 30 10:48:39.679403 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:39.679353    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c568g" podStartSLOduration=3.503781096 podStartE2EDuration="22.679336142s" totalImagesPullingTime="19.175555046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:39.679081676 +0000 UTC m=+23.787723171" watchObservedRunningTime="2026-07-30 10:48:39.679336142 +0000 UTC m=+23.787977634"
Jul 30 10:48:40.344410 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:40.344304    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T10:48:39.531588361Z","UUID":"04c7fa3c-a89a-46c9-ab66-3283b50e435d","Handler":null,"Name":"","Endpoint":""}
Jul 30 10:48:40.346711 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:40.346471    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 10:48:40.346711 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:40.346520    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 10:48:40.454989 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:40.454942    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:40.454989 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:40.454973    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:40.455274 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:40.454951    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:40.455274 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:40.455085    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:40.455274 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:40.455196    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:40.455449 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:40.455296    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:41.676264 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:41.676184    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc" event={"ID":"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d","Type":"ContainerStarted","Data":"a8bc5ff79f85bb2bd2a5fb29c0b26f1b8f207398b17dce78c900422f03194d5a"}
Jul 30 10:48:41.678398 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:41.678367    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw" event={"ID":"0c0125e3-efe4-4f62-b2d7-5a4b0ab80e3a","Type":"ContainerStarted","Data":"be3b9a07eff9ac5623d63dc255b308c8341125d7eb227297a52be650cbf3b93e"}
Jul 30 10:48:41.699711 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:41.699649    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnvkw" podStartSLOduration=3.340981703 podStartE2EDuration="24.699629203s" totalImagesPullingTime="21.3586475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:41.699393964 +0000 UTC m=+25.808035456" watchObservedRunningTime="2026-07-30 10:48:41.699629203 +0000 UTC m=+25.808270696"
Jul 30 10:48:42.394959 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:42.394763    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:42.395486 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:42.395455    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:42.455380 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:42.455338    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:42.455553 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:42.455342    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:42.455553 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:42.455476    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:42.455650 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:42.455575    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:42.455650 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:42.455342    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:42.455745 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:42.455664    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:42.680703 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:42.680668    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:42.681298 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:42.681281    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wqnvf"
Jul 30 10:48:43.686819 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:43.686619    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc" event={"ID":"aa4722fa-f9aa-4b42-9d5f-c922bdc0fb9d","Type":"ContainerStarted","Data":"29f5f223c5193e2b18976c808e7a66f170c04dab2be8130bae12e3250a3211d8"}
Jul 30 10:48:43.687732 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:43.686916    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:43.688607 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:43.688582    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c2fa329-943e-4c24-964b-215e2b6c8e44" containerID="ffdb1870d2752a2155fef4ed9dce413183ccd17a57fe7c84853407fee8738d0a" exitCode=0
Jul 30 10:48:43.688763 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:43.688679    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vxjg" event={"ID":"4c2fa329-943e-4c24-964b-215e2b6c8e44","Type":"ContainerDied","Data":"ffdb1870d2752a2155fef4ed9dce413183ccd17a57fe7c84853407fee8738d0a"}
Jul 30 10:48:43.703131 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:43.703106    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:43.715619 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:43.715568    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc" podStartSLOduration=8.468822497 podStartE2EDuration="27.715551931s" totalImagesPullingTime="19.246729434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:43.713783673 +0000 UTC m=+27.822425164" watchObservedRunningTime="2026-07-30 10:48:43.715551931 +0000 UTC m=+27.824193424"
Jul 30 10:48:44.455493 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:44.455420    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:44.455652 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:44.455419    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:44.455652 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:44.455548    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:44.455652 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:44.455546    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:44.455765 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:44.455656    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:44.455765 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:44.455744    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:44.691351 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:44.691326    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:44.691834 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:44.691393    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:44.706238 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:44.706156    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:48:45.238186 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:45.238113    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zxmk8"]
Jul 30 10:48:45.238403 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:45.238338    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:45.238486 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:45.238463    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:45.238807 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:45.238782    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhgvv"]
Jul 30 10:48:45.238894 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:45.238875    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:45.238962 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:45.238945    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:45.250057 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:45.249981    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2k9m9"]
Jul 30 10:48:45.250198 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:45.250102    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:45.250277 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:45.250200    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:45.695481 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:45.695448    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c2fa329-943e-4c24-964b-215e2b6c8e44" containerID="d3cffccc98ac13ef781d4895a34f21e27af4e985ed82c02bd9490d02203e2554" exitCode=0
Jul 30 10:48:45.696038 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:45.695523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vxjg" event={"ID":"4c2fa329-943e-4c24-964b-215e2b6c8e44","Type":"ContainerDied","Data":"d3cffccc98ac13ef781d4895a34f21e27af4e985ed82c02bd9490d02203e2554"}
Jul 30 10:48:46.455575 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:46.455540    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:46.457868 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:46.455984    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:47.455619 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:47.455449    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:47.456081 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:47.455478    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:47.456081 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:47.455718    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:47.456081 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:47.455765    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:47.703211 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:47.703169    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c2fa329-943e-4c24-964b-215e2b6c8e44" containerID="dfd0fe01ed155d270d64e6c92b9bc44eb98ea2a78df822c209b5c2bc6cf28c3e" exitCode=0
Jul 30 10:48:47.703396 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:47.703261    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vxjg" event={"ID":"4c2fa329-943e-4c24-964b-215e2b6c8e44","Type":"ContainerDied","Data":"dfd0fe01ed155d270d64e6c92b9bc44eb98ea2a78df822c209b5c2bc6cf28c3e"}
Jul 30 10:48:48.455661 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:48.455622    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:48.456094 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:48.455758    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:49.454969 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:49.454938    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:49.455167 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:49.455053    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:49.455167 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:49.455110    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:49.455311 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:49.455202    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:50.036455 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:50.036416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:50.036455 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:50.036455    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:50.036997 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:50.036562    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:50.036997 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:50.036588    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:50.036997 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:50.036635    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs podName:6eee8b57-b110-4823-ba5d-4aa4a7420380 nodeName:}" failed. No retries permitted until 2026-07-30 10:49:22.036611923 +0000 UTC m=+66.145253393 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs") pod "network-metrics-daemon-zxmk8" (UID: "6eee8b57-b110-4823-ba5d-4aa4a7420380") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 10:48:50.036997 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:50.036661    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret podName:d7329a22-fb04-44b6-9746-fac8c5e02216 nodeName:}" failed. No retries permitted until 2026-07-30 10:49:22.036642919 +0000 UTC m=+66.145284390 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret") pod "global-pull-secret-syncer-lhgvv" (UID: "d7329a22-fb04-44b6-9746-fac8c5e02216") : object "kube-system"/"original-pull-secret" not registered
Jul 30 10:48:50.137293 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:50.137252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dd6r\" (UniqueName: \"kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r\") pod \"network-check-target-2k9m9\" (UID: \"704b9252-e4e1-4e0b-a54c-9a6dcc914d63\") " pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:50.137479 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:50.137448    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 10:48:50.137479 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:50.137478    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 10:48:50.137602 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:50.137495    2583 projected.go:196] Error preparing data for projected volume kube-api-access-8dd6r for pod openshift-network-diagnostics/network-check-target-2k9m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:50.137602 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:50.137572    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r podName:704b9252-e4e1-4e0b-a54c-9a6dcc914d63 nodeName:}" failed. No retries permitted until 2026-07-30 10:49:22.137550927 +0000 UTC m=+66.246192419 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8dd6r" (UniqueName: "kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r") pod "network-check-target-2k9m9" (UID: "704b9252-e4e1-4e0b-a54c-9a6dcc914d63") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 10:48:50.458654 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:50.458626    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:50.458824 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:50.458738    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lhgvv" podUID="d7329a22-fb04-44b6-9746-fac8c5e02216"
Jul 30 10:48:51.455093 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.455052    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:51.455093 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.455087    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:51.455671 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:51.455204    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zxmk8" podUID="6eee8b57-b110-4823-ba5d-4aa4a7420380"
Jul 30 10:48:51.455671 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:51.455327    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2k9m9" podUID="704b9252-e4e1-4e0b-a54c-9a6dcc914d63"
Jul 30 10:48:51.689805 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.689775    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-172.ec2.internal" event="NodeReady"
Jul 30 10:48:51.689979 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.689902    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 10:48:51.738977 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.738946    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-whxpf"]
Jul 30 10:48:51.740493 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.740470    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:51.742544 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.742498    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cphfs"]
Jul 30 10:48:51.743440 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.743416    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 10:48:51.743891 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.743725    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 10:48:51.743891 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.743791    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6l9vk\""
Jul 30 10:48:51.744640 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.744604    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cphfs"
Jul 30 10:48:51.747494 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.747008    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 10:48:51.747494 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.747241    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 10:48:51.747726 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.747645    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 10:48:51.747895 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.747872    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6r58j\""
Jul 30 10:48:51.756126 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.755982    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whxpf"]
Jul 30 10:48:51.756212 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.756142    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cphfs"]
Jul 30 10:48:51.849493 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.849465    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdfmk\" (UniqueName: \"kubernetes.io/projected/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-kube-api-access-bdfmk\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:51.849598 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.849517    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:51.849598 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.849541    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17e6ec27-1efb-4385-81ea-4d92e5fc21d5-cert\") pod \"ingress-canary-cphfs\" (UID: \"17e6ec27-1efb-4385-81ea-4d92e5fc21d5\") " pod="openshift-ingress-canary/ingress-canary-cphfs"
Jul 30 10:48:51.849598 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.849578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-tmp-dir\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:51.849598 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.849597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd57j\" (UniqueName: \"kubernetes.io/projected/17e6ec27-1efb-4385-81ea-4d92e5fc21d5-kube-api-access-hd57j\") pod \"ingress-canary-cphfs\" (UID: \"17e6ec27-1efb-4385-81ea-4d92e5fc21d5\") " pod="openshift-ingress-canary/ingress-canary-cphfs"
Jul 30 10:48:51.849717 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.849613    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-config-volume\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:51.950438 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.950397    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdfmk\" (UniqueName: \"kubernetes.io/projected/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-kube-api-access-bdfmk\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:51.950612 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.950465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:51.950612 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.950493    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17e6ec27-1efb-4385-81ea-4d92e5fc21d5-cert\") pod \"ingress-canary-cphfs\" (UID: \"17e6ec27-1efb-4385-81ea-4d92e5fc21d5\") " pod="openshift-ingress-canary/ingress-canary-cphfs"
Jul 30 10:48:51.950612 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.950528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-tmp-dir\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:51.950612 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.950557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd57j\" (UniqueName: \"kubernetes.io/projected/17e6ec27-1efb-4385-81ea-4d92e5fc21d5-kube-api-access-hd57j\") pod \"ingress-canary-cphfs\" (UID: \"17e6ec27-1efb-4385-81ea-4d92e5fc21d5\") " pod="openshift-ingress-canary/ingress-canary-cphfs"
Jul 30 10:48:51.950766 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.950609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-config-volume\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:51.950766 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:51.950631    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 10:48:51.950766 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:51.950699    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls podName:6914ae44-a8e1-41f1-9e58-b50c7f8d1543 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:52.450676094 +0000 UTC m=+36.559317570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls") pod "dns-default-whxpf" (UID: "6914ae44-a8e1-41f1-9e58-b50c7f8d1543") : secret "dns-default-metrics-tls" not found
Jul 30 10:48:51.951077 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.951053    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-tmp-dir\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:51.951271 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.951252    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-config-volume\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:51.954807 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.954782    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17e6ec27-1efb-4385-81ea-4d92e5fc21d5-cert\") pod \"ingress-canary-cphfs\" (UID: \"17e6ec27-1efb-4385-81ea-4d92e5fc21d5\") " pod="openshift-ingress-canary/ingress-canary-cphfs"
Jul 30 10:48:51.962986 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.962958    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd57j\" (UniqueName: \"kubernetes.io/projected/17e6ec27-1efb-4385-81ea-4d92e5fc21d5-kube-api-access-hd57j\") pod \"ingress-canary-cphfs\" (UID: \"17e6ec27-1efb-4385-81ea-4d92e5fc21d5\") " pod="openshift-ingress-canary/ingress-canary-cphfs"
Jul 30 10:48:51.963159 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:51.963122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdfmk\" (UniqueName: \"kubernetes.io/projected/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-kube-api-access-bdfmk\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:52.059609 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:52.059501    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cphfs"
Jul 30 10:48:52.202716 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:52.202481    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cphfs"]
Jul 30 10:48:52.206958 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:52.206916    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e6ec27_1efb_4385_81ea_4d92e5fc21d5.slice/crio-784047e62955130905018229aeab952fb55e52ebea7c721e9be2a687ab86d879 WatchSource:0}: Error finding container 784047e62955130905018229aeab952fb55e52ebea7c721e9be2a687ab86d879: Status 404 returned error can't find the container with id 784047e62955130905018229aeab952fb55e52ebea7c721e9be2a687ab86d879
Jul 30 10:48:52.453945 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:52.453906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:52.454088 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:52.454065    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 10:48:52.454145 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:52.454132    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls podName:6914ae44-a8e1-41f1-9e58-b50c7f8d1543 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:53.454115203 +0000 UTC m=+37.562756673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls") pod "dns-default-whxpf" (UID: "6914ae44-a8e1-41f1-9e58-b50c7f8d1543") : secret "dns-default-metrics-tls" not found
Jul 30 10:48:52.454650 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:52.454631    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:48:52.457356 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:52.457332    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 10:48:52.716658 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:52.716550    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c2fa329-943e-4c24-964b-215e2b6c8e44" containerID="39fa63179a8c7d9260068c01b86415cacb390b4367490b088b937a887f1f0b59" exitCode=0
Jul 30 10:48:52.716658 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:52.716593    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vxjg" event={"ID":"4c2fa329-943e-4c24-964b-215e2b6c8e44","Type":"ContainerDied","Data":"39fa63179a8c7d9260068c01b86415cacb390b4367490b088b937a887f1f0b59"}
Jul 30 10:48:52.718284 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:52.717962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cphfs" event={"ID":"17e6ec27-1efb-4385-81ea-4d92e5fc21d5","Type":"ContainerStarted","Data":"784047e62955130905018229aeab952fb55e52ebea7c721e9be2a687ab86d879"}
Jul 30 10:48:53.455707 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:53.455634    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:48:53.455964 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:53.455821    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:48:53.460190 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:53.460161    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bwnnn\""
Jul 30 10:48:53.460624 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:53.460205    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gvflt\""
Jul 30 10:48:53.460624 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:53.460211    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 10:48:53.460624 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:53.460161    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 10:48:53.460624 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:53.460282    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 10:48:53.462095 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:53.462071    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:53.462214 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:53.462199    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 10:48:53.462289 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:53.462274    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls podName:6914ae44-a8e1-41f1-9e58-b50c7f8d1543 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:55.462255005 +0000 UTC m=+39.570896488 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls") pod "dns-default-whxpf" (UID: "6914ae44-a8e1-41f1-9e58-b50c7f8d1543") : secret "dns-default-metrics-tls" not found
Jul 30 10:48:53.724924 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:53.724824    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c2fa329-943e-4c24-964b-215e2b6c8e44" containerID="7e6ae43ca4a7c240e60c6b4b867d9e44e1ef362243d6b18137de9a813bd70cb9" exitCode=0
Jul 30 10:48:53.724924 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:53.724909    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vxjg" event={"ID":"4c2fa329-943e-4c24-964b-215e2b6c8e44","Type":"ContainerDied","Data":"7e6ae43ca4a7c240e60c6b4b867d9e44e1ef362243d6b18137de9a813bd70cb9"}
Jul 30 10:48:54.730622 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:54.730429    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9vxjg" event={"ID":"4c2fa329-943e-4c24-964b-215e2b6c8e44","Type":"ContainerStarted","Data":"6c2deda6ca47fff6a0e11af0b1cd4ebb918773e0fcad70da8808ca8fb7507b4f"}
Jul 30 10:48:54.731798 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:54.731773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cphfs" event={"ID":"17e6ec27-1efb-4385-81ea-4d92e5fc21d5","Type":"ContainerStarted","Data":"429e14c22d73bdc8ecf6cd9285c84f32b0f0c95692c905f57b48097828135e09"}
Jul 30 10:48:54.756435 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:54.756377    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9vxjg" podStartSLOduration=7.968731871 podStartE2EDuration="37.756361346s" totalImagesPullingTime="29.787629475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:54.754438276 +0000 UTC m=+38.863079767" watchObservedRunningTime="2026-07-30 10:48:54.756361346 +0000 UTC m=+38.865002874"
Jul 30 10:48:54.771813 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:54.771760    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cphfs" podStartSLOduration=1.687401113 podStartE2EDuration="3.77174148s" totalImagesPullingTime="2.084340367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:48:54.771065517 +0000 UTC m=+38.879707010" watchObservedRunningTime="2026-07-30 10:48:54.77174148 +0000 UTC m=+38.880382976"
Jul 30 10:48:55.478340 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:55.478303    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:55.478552 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:55.478424    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 10:48:55.478552 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:55.478482    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls podName:6914ae44-a8e1-41f1-9e58-b50c7f8d1543 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:59.478467672 +0000 UTC m=+43.587109146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls") pod "dns-default-whxpf" (UID: "6914ae44-a8e1-41f1-9e58-b50c7f8d1543") : secret "dns-default-metrics-tls" not found
Jul 30 10:48:57.501805 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.501767    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vjn6k"]
Jul 30 10:48:57.541910 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.541873    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vjn6k"]
Jul 30 10:48:57.542083 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.541993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.545661 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.545627    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 10:48:57.546878 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.546859    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 10:48:57.546878 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.546879    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 10:48:57.547061 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.546897    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 10:48:57.547061 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.546897    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tdvpn\""
Jul 30 10:48:57.694827 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.694785    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/611358e3-65fa-451a-b33b-fa0096360f05-data-volume\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.695013 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.694857    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.695013 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.694888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/611358e3-65fa-451a-b33b-fa0096360f05-crio-socket\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.695013 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.694909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttl57\" (UniqueName: \"kubernetes.io/projected/611358e3-65fa-451a-b33b-fa0096360f05-kube-api-access-ttl57\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.695013 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.694962    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.796346 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.796217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.796346 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.796300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/611358e3-65fa-451a-b33b-fa0096360f05-crio-socket\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.796346 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.796317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttl57\" (UniqueName: \"kubernetes.io/projected/611358e3-65fa-451a-b33b-fa0096360f05-kube-api-access-ttl57\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.796346 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:57.796319    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 10:48:57.796637 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.796356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.796637 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.796383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/611358e3-65fa-451a-b33b-fa0096360f05-data-volume\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.796637 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:57.796407    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm podName:611358e3-65fa-451a-b33b-fa0096360f05 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:58.29638557 +0000 UTC m=+42.405027061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjn6k" (UID: "611358e3-65fa-451a-b33b-fa0096360f05") : configmap "kube-rbac-proxy" not found
Jul 30 10:48:57.796637 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:57.796483    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 10:48:57.796637 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:57.796545    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls podName:611358e3-65fa-451a-b33b-fa0096360f05 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:58.296527876 +0000 UTC m=+42.405169346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjn6k" (UID: "611358e3-65fa-451a-b33b-fa0096360f05") : secret "insights-runtime-extractor-tls" not found
Jul 30 10:48:57.796637 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.796538    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/611358e3-65fa-451a-b33b-fa0096360f05-crio-socket\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.796882 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.796655    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/611358e3-65fa-451a-b33b-fa0096360f05-data-volume\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:57.808018 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:57.807982    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttl57\" (UniqueName: \"kubernetes.io/projected/611358e3-65fa-451a-b33b-fa0096360f05-kube-api-access-ttl57\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:58.254292 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.254256    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7przc"]
Jul 30 10:48:58.276285 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.276256    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7przc"]
Jul 30 10:48:58.276415 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.276330    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7przc"
Jul 30 10:48:58.279458 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.279433    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bsr9h\""
Jul 30 10:48:58.279458 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.279434    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 30 10:48:58.280491 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.280476    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 30 10:48:58.299970 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.299939    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:58.300180 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.299997    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:58.300180 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:58.300086    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 10:48:58.300180 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:58.300121    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 10:48:58.300180 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:58.300170    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm podName:611358e3-65fa-451a-b33b-fa0096360f05 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:59.300149183 +0000 UTC m=+43.408790670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjn6k" (UID: "611358e3-65fa-451a-b33b-fa0096360f05") : configmap "kube-rbac-proxy" not found
Jul 30 10:48:58.300382 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:58.300188    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls podName:611358e3-65fa-451a-b33b-fa0096360f05 nodeName:}" failed. No retries permitted until 2026-07-30 10:48:59.300180003 +0000 UTC m=+43.408821473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjn6k" (UID: "611358e3-65fa-451a-b33b-fa0096360f05") : secret "insights-runtime-extractor-tls" not found
Jul 30 10:48:58.400388 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.400347    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9qlf\" (UniqueName: \"kubernetes.io/projected/d819f1a4-1c57-4c38-beef-8521eb6e5fdf-kube-api-access-g9qlf\") pod \"migrator-6865c9967-7przc\" (UID: \"d819f1a4-1c57-4c38-beef-8521eb6e5fdf\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7przc"
Jul 30 10:48:58.501748 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.501716    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9qlf\" (UniqueName: \"kubernetes.io/projected/d819f1a4-1c57-4c38-beef-8521eb6e5fdf-kube-api-access-g9qlf\") pod \"migrator-6865c9967-7przc\" (UID: \"d819f1a4-1c57-4c38-beef-8521eb6e5fdf\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7przc"
Jul 30 10:48:58.524904 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.524834    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9qlf\" (UniqueName: \"kubernetes.io/projected/d819f1a4-1c57-4c38-beef-8521eb6e5fdf-kube-api-access-g9qlf\") pod \"migrator-6865c9967-7przc\" (UID: \"d819f1a4-1c57-4c38-beef-8521eb6e5fdf\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7przc"
Jul 30 10:48:58.585009 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.584962    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7przc"
Jul 30 10:48:58.726673 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.726640    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7przc"]
Jul 30 10:48:58.729686 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:48:58.729658    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd819f1a4_1c57_4c38_beef_8521eb6e5fdf.slice/crio-2c28e5fa61a144eef33f571d7c88119cedccd81376309168df44b834f999ebac WatchSource:0}: Error finding container 2c28e5fa61a144eef33f571d7c88119cedccd81376309168df44b834f999ebac: Status 404 returned error can't find the container with id 2c28e5fa61a144eef33f571d7c88119cedccd81376309168df44b834f999ebac
Jul 30 10:48:58.741165 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:58.741136    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7przc" event={"ID":"d819f1a4-1c57-4c38-beef-8521eb6e5fdf","Type":"ContainerStarted","Data":"2c28e5fa61a144eef33f571d7c88119cedccd81376309168df44b834f999ebac"}
Jul 30 10:48:59.308853 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:59.308813    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:59.309071 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:59.308985    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 10:48:59.309071 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:59.309034    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 10:48:59.309071 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:59.308985    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:48:59.309071 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:59.309059    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls podName:611358e3-65fa-451a-b33b-fa0096360f05 nodeName:}" failed. No retries permitted until 2026-07-30 10:49:01.309039592 +0000 UTC m=+45.417681065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjn6k" (UID: "611358e3-65fa-451a-b33b-fa0096360f05") : secret "insights-runtime-extractor-tls" not found
Jul 30 10:48:59.309335 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:59.309091    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm podName:611358e3-65fa-451a-b33b-fa0096360f05 nodeName:}" failed. No retries permitted until 2026-07-30 10:49:01.309079607 +0000 UTC m=+45.417721077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjn6k" (UID: "611358e3-65fa-451a-b33b-fa0096360f05") : configmap "kube-rbac-proxy" not found
Jul 30 10:48:59.510390 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:59.510352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:48:59.510609 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:59.510513    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 10:48:59.510609 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:48:59.510581    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls podName:6914ae44-a8e1-41f1-9e58-b50c7f8d1543 nodeName:}" failed. No retries permitted until 2026-07-30 10:49:07.510561315 +0000 UTC m=+51.619202802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls") pod "dns-default-whxpf" (UID: "6914ae44-a8e1-41f1-9e58-b50c7f8d1543") : secret "dns-default-metrics-tls" not found
Jul 30 10:48:59.694620 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:48:59.694594    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sjhld_1d9343d5-be95-4cc3-a06e-fed71ab42557/dns-node-resolver/0.log"
Jul 30 10:49:00.295081 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:00.295053    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4dhsb_77082cc8-9009-41dd-94b1-7e056b4ef169/node-ca/0.log"
Jul 30 10:49:00.750027 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:00.749990    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7przc" event={"ID":"d819f1a4-1c57-4c38-beef-8521eb6e5fdf","Type":"ContainerStarted","Data":"78b230b550b8248a91b93a0c9a546c64638488c999a8340bdf40017518e7fb85"}
Jul 30 10:49:00.750412 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:00.750040    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7przc" event={"ID":"d819f1a4-1c57-4c38-beef-8521eb6e5fdf","Type":"ContainerStarted","Data":"12037a01937112da4c1a2719cd6d3e05a052ab1bfe36bbdee566533c73eadff6"}
Jul 30 10:49:00.768021 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:00.767972    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7przc" podStartSLOduration=1.036431624 podStartE2EDuration="2.767954242s" totalImagesPullingTime="1.731522618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:00.76740622 +0000 UTC m=+44.876047712" watchObservedRunningTime="2026-07-30 10:49:00.767954242 +0000 UTC m=+44.876595767"
Jul 30 10:49:01.313504 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:01.313476    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cphfs_17e6ec27-1efb-4385-81ea-4d92e5fc21d5/serve-healthcheck-canary/0.log"
Jul 30 10:49:01.325691 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:01.325661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:49:01.325788 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:01.325717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:49:01.325833 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:49:01.325784    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 10:49:01.325833 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:49:01.325825    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 10:49:01.325908 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:49:01.325850    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm podName:611358e3-65fa-451a-b33b-fa0096360f05 nodeName:}" failed. No retries permitted until 2026-07-30 10:49:05.325834392 +0000 UTC m=+49.434475861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vjn6k" (UID: "611358e3-65fa-451a-b33b-fa0096360f05") : configmap "kube-rbac-proxy" not found
Jul 30 10:49:01.325908 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:49:01.325867    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls podName:611358e3-65fa-451a-b33b-fa0096360f05 nodeName:}" failed. No retries permitted until 2026-07-30 10:49:05.325855432 +0000 UTC m=+49.434496902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjn6k" (UID: "611358e3-65fa-451a-b33b-fa0096360f05") : secret "insights-runtime-extractor-tls" not found
Jul 30 10:49:05.355241 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:05.355196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:49:05.355627 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:05.355298    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:49:05.355627 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:49:05.355375    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 10:49:05.355627 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:49:05.355443    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls podName:611358e3-65fa-451a-b33b-fa0096360f05 nodeName:}" failed. No retries permitted until 2026-07-30 10:49:13.355426451 +0000 UTC m=+57.464067920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vjn6k" (UID: "611358e3-65fa-451a-b33b-fa0096360f05") : secret "insights-runtime-extractor-tls" not found
Jul 30 10:49:05.355797 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:05.355779    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/611358e3-65fa-451a-b33b-fa0096360f05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:49:07.573710 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:07.573681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:49:07.575862 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:07.575841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6914ae44-a8e1-41f1-9e58-b50c7f8d1543-metrics-tls\") pod \"dns-default-whxpf\" (UID: \"6914ae44-a8e1-41f1-9e58-b50c7f8d1543\") " pod="openshift-dns/dns-default-whxpf"
Jul 30 10:49:07.652952 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:07.652912    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whxpf"
Jul 30 10:49:07.798656 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:07.798625    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whxpf"]
Jul 30 10:49:07.801429 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:07.801400    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6914ae44_a8e1_41f1_9e58_b50c7f8d1543.slice/crio-7441f9bea6c8a6776e343616d310e5addd979867416ee997b68dcd79a0d18247 WatchSource:0}: Error finding container 7441f9bea6c8a6776e343616d310e5addd979867416ee997b68dcd79a0d18247: Status 404 returned error can't find the container with id 7441f9bea6c8a6776e343616d310e5addd979867416ee997b68dcd79a0d18247
Jul 30 10:49:08.771564 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:08.771520    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whxpf" event={"ID":"6914ae44-a8e1-41f1-9e58-b50c7f8d1543","Type":"ContainerStarted","Data":"7441f9bea6c8a6776e343616d310e5addd979867416ee997b68dcd79a0d18247"}
Jul 30 10:49:10.778463 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:10.778423    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whxpf" event={"ID":"6914ae44-a8e1-41f1-9e58-b50c7f8d1543","Type":"ContainerStarted","Data":"36e86b1691076e8027b3a42b24ca55dde2a1c32e46274c89ed0a4f96e758f024"}
Jul 30 10:49:10.778896 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:10.778487    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whxpf" event={"ID":"6914ae44-a8e1-41f1-9e58-b50c7f8d1543","Type":"ContainerStarted","Data":"02a623ffc4c91ae68c49384c3bbc5618b37e96b1117d687ae09518be3abb28c0"}
Jul 30 10:49:10.778896 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:10.778569    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-whxpf"
Jul 30 10:49:10.797359 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:10.797305    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-whxpf" podStartSLOduration=17.579349944 podStartE2EDuration="19.797288782s" totalImagesPullingTime="2.217938838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:10.796741588 +0000 UTC m=+54.905383081" watchObservedRunningTime="2026-07-30 10:49:10.797288782 +0000 UTC m=+54.905930266"
Jul 30 10:49:13.419302 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:13.419268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:49:13.421477 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:13.421455    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/611358e3-65fa-451a-b33b-fa0096360f05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vjn6k\" (UID: \"611358e3-65fa-451a-b33b-fa0096360f05\") " pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:49:13.451438 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:13.451401    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vjn6k"
Jul 30 10:49:13.579777 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:13.579741    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vjn6k"]
Jul 30 10:49:13.582739 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:13.582717    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611358e3_65fa_451a_b33b_fa0096360f05.slice/crio-03c431d13753d6b2a07a0c85e1d3f369270d50fe695905ba5039e154cdad15bd WatchSource:0}: Error finding container 03c431d13753d6b2a07a0c85e1d3f369270d50fe695905ba5039e154cdad15bd: Status 404 returned error can't find the container with id 03c431d13753d6b2a07a0c85e1d3f369270d50fe695905ba5039e154cdad15bd
Jul 30 10:49:13.787368 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:13.787275    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjn6k" event={"ID":"611358e3-65fa-451a-b33b-fa0096360f05","Type":"ContainerStarted","Data":"03c431d13753d6b2a07a0c85e1d3f369270d50fe695905ba5039e154cdad15bd"}
Jul 30 10:49:16.715910 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:16.715860    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lq9dc"
Jul 30 10:49:19.807314 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:19.807280    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjn6k" event={"ID":"611358e3-65fa-451a-b33b-fa0096360f05","Type":"ContainerStarted","Data":"cc1446e44887c44b0a4f2b8033b5cb9c823ae2567a5ad1b38ff954cc57e5634d"}
Jul 30 10:49:20.783450 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.783421    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-whxpf"
Jul 30 10:49:20.881106 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.881044    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z"]
Jul 30 10:49:20.892123 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.892074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z"
Jul 30 10:49:20.893644 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.893606    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z"]
Jul 30 10:49:20.895319 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.895291    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 30 10:49:20.896520 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.896491    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2xdcb\""
Jul 30 10:49:20.897073 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.897048    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 30 10:49:20.898933 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.897853    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 30 10:49:20.898933 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.898281    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 30 10:49:20.975162 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.975130    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-v7cph"]
Jul 30 10:49:20.975371 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.975287    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f0d8bda-6ea9-42f0-87e0-f623f265e653-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z\" (UID: \"4f0d8bda-6ea9-42f0-87e0-f623f265e653\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z"
Jul 30 10:49:20.975371 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.975356    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpk6m\" (UniqueName: \"kubernetes.io/projected/4f0d8bda-6ea9-42f0-87e0-f623f265e653-kube-api-access-hpk6m\") pod \"managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z\" (UID: \"4f0d8bda-6ea9-42f0-87e0-f623f265e653\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z"
Jul 30 10:49:20.979306 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.979277    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v7cph"
Jul 30 10:49:20.982424 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.982397    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55f47d7f4d-gkzb6"]
Jul 30 10:49:20.982596 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.982478    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 30 10:49:20.982918 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.982895    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-59nvv\""
Jul 30 10:49:20.983029 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.982933    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 30 10:49:20.986380 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.986358    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:20.994142 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.994098    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 10:49:20.994330 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.994189    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zpkjw\""
Jul 30 10:49:20.994330 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.994297    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 10:49:20.994953 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.994929    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 10:49:20.996953 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:20.996930    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-v7cph"]
Jul 30 10:49:21.011824 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.011787    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55f47d7f4d-gkzb6"]
Jul 30 10:49:21.016847 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.016815    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 10:49:21.076696 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.076599    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv5hv\" (UniqueName: \"kubernetes.io/projected/5aabefd5-8f82-4873-a4fb-80604f949f4d-kube-api-access-pv5hv\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.076696 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.076652    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5aabefd5-8f82-4873-a4fb-80604f949f4d-registry-certificates\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.076696 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.076690    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5aabefd5-8f82-4873-a4fb-80604f949f4d-image-registry-private-configuration\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.076945 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.076732    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a79e56d-1272-47c9-a57a-59278aab3818-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-v7cph\" (UID: \"6a79e56d-1272-47c9-a57a-59278aab3818\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v7cph"
Jul 30 10:49:21.076945 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.076805    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f0d8bda-6ea9-42f0-87e0-f623f265e653-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z\" (UID: \"4f0d8bda-6ea9-42f0-87e0-f623f265e653\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z"
Jul 30 10:49:21.076945 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.076856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5aabefd5-8f82-4873-a4fb-80604f949f4d-trusted-ca\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.076945 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.076916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpk6m\" (UniqueName: \"kubernetes.io/projected/4f0d8bda-6ea9-42f0-87e0-f623f265e653-kube-api-access-hpk6m\") pod \"managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z\" (UID: \"4f0d8bda-6ea9-42f0-87e0-f623f265e653\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z"
Jul 30 10:49:21.077285 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.077263    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5aabefd5-8f82-4873-a4fb-80604f949f4d-registry-tls\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.077399 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.077296    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5aabefd5-8f82-4873-a4fb-80604f949f4d-installation-pull-secrets\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.077399 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.077336    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5aabefd5-8f82-4873-a4fb-80604f949f4d-ca-trust-extracted\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.077515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.077401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a79e56d-1272-47c9-a57a-59278aab3818-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v7cph\" (UID: \"6a79e56d-1272-47c9-a57a-59278aab3818\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v7cph"
Jul 30 10:49:21.077515 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.077444    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5aabefd5-8f82-4873-a4fb-80604f949f4d-bound-sa-token\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.079796 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.079762    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4f0d8bda-6ea9-42f0-87e0-f623f265e653-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z\" (UID: \"4f0d8bda-6ea9-42f0-87e0-f623f265e653\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z"
Jul 30 10:49:21.090344 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.090308    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpk6m\" (UniqueName: \"kubernetes.io/projected/4f0d8bda-6ea9-42f0-87e0-f623f265e653-kube-api-access-hpk6m\") pod \"managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z\" (UID: \"4f0d8bda-6ea9-42f0-87e0-f623f265e653\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z"
Jul 30 10:49:21.178369 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.178332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5aabefd5-8f82-4873-a4fb-80604f949f4d-trusted-ca\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.178572 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.178428    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5aabefd5-8f82-4873-a4fb-80604f949f4d-registry-tls\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.178572 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.178452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5aabefd5-8f82-4873-a4fb-80604f949f4d-installation-pull-secrets\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.178572 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.178486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5aabefd5-8f82-4873-a4fb-80604f949f4d-ca-trust-extracted\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.178572 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.178512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a79e56d-1272-47c9-a57a-59278aab3818-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v7cph\" (UID: \"6a79e56d-1272-47c9-a57a-59278aab3818\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v7cph"
Jul 30 10:49:21.178572 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.178536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5aabefd5-8f82-4873-a4fb-80604f949f4d-bound-sa-token\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.178832 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.178577    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5hv\" (UniqueName: \"kubernetes.io/projected/5aabefd5-8f82-4873-a4fb-80604f949f4d-kube-api-access-pv5hv\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.178832 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.178604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5aabefd5-8f82-4873-a4fb-80604f949f4d-registry-certificates\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.178832 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.178640    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5aabefd5-8f82-4873-a4fb-80604f949f4d-image-registry-private-configuration\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.178832 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.178671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a79e56d-1272-47c9-a57a-59278aab3818-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-v7cph\" (UID: \"6a79e56d-1272-47c9-a57a-59278aab3818\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v7cph"
Jul 30 10:49:21.179446 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.179422    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6a79e56d-1272-47c9-a57a-59278aab3818-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-v7cph\" (UID: \"6a79e56d-1272-47c9-a57a-59278aab3818\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v7cph"
Jul 30 10:49:21.179537 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.179463    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5aabefd5-8f82-4873-a4fb-80604f949f4d-ca-trust-extracted\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.179615 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.179540    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5aabefd5-8f82-4873-a4fb-80604f949f4d-trusted-ca\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.179615 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.179552    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5aabefd5-8f82-4873-a4fb-80604f949f4d-registry-certificates\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.181470 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.181424    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6a79e56d-1272-47c9-a57a-59278aab3818-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v7cph\" (UID: \"6a79e56d-1272-47c9-a57a-59278aab3818\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v7cph"
Jul 30 10:49:21.182032 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.181999    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5aabefd5-8f82-4873-a4fb-80604f949f4d-registry-tls\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.182117 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.182048    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5aabefd5-8f82-4873-a4fb-80604f949f4d-image-registry-private-configuration\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.182252 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.182215    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5aabefd5-8f82-4873-a4fb-80604f949f4d-installation-pull-secrets\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.191776 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.191706    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5aabefd5-8f82-4873-a4fb-80604f949f4d-bound-sa-token\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.194984 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.194953    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv5hv\" (UniqueName: \"kubernetes.io/projected/5aabefd5-8f82-4873-a4fb-80604f949f4d-kube-api-access-pv5hv\") pod \"image-registry-55f47d7f4d-gkzb6\" (UID: \"5aabefd5-8f82-4873-a4fb-80604f949f4d\") " pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:21.214245 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.214194    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z"
Jul 30 10:49:21.290415 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.290381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v7cph"
Jul 30 10:49:21.298476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:21.298437    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:22.086844 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.086808    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:49:22.086844 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.086851    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:49:22.089915 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.089885    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 10:49:22.090828 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.090814    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 10:49:22.100574 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.100540    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d7329a22-fb04-44b6-9746-fac8c5e02216-original-pull-secret\") pod \"global-pull-secret-syncer-lhgvv\" (UID: \"d7329a22-fb04-44b6-9746-fac8c5e02216\") " pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:49:22.100574 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.100570    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6eee8b57-b110-4823-ba5d-4aa4a7420380-metrics-certs\") pod \"network-metrics-daemon-zxmk8\" (UID: \"6eee8b57-b110-4823-ba5d-4aa4a7420380\") " pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:49:22.164686 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.164648    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lhgvv"
Jul 30 10:49:22.188177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.188141    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dd6r\" (UniqueName: \"kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r\") pod \"network-check-target-2k9m9\" (UID: \"704b9252-e4e1-4e0b-a54c-9a6dcc914d63\") " pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:49:22.190901 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.190874    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 10:49:22.202067 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.202040    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 10:49:22.212086 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.212058    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dd6r\" (UniqueName: \"kubernetes.io/projected/704b9252-e4e1-4e0b-a54c-9a6dcc914d63-kube-api-access-8dd6r\") pod \"network-check-target-2k9m9\" (UID: \"704b9252-e4e1-4e0b-a54c-9a6dcc914d63\") " pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:49:22.270957 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.270928    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gvflt\""
Jul 30 10:49:22.277282 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.277254    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bwnnn\""
Jul 30 10:49:22.278259 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.278236    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zxmk8"
Jul 30 10:49:22.285388 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.285361    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:49:22.688504 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.688413    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55f47d7f4d-gkzb6"]
Jul 30 10:49:22.694109 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:22.694008    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aabefd5_8f82_4873_a4fb_80604f949f4d.slice/crio-926e6333933aef8be4ed1ece9b46a4315b162e842919161e948eceb7535d6c77 WatchSource:0}: Error finding container 926e6333933aef8be4ed1ece9b46a4315b162e842919161e948eceb7535d6c77: Status 404 returned error can't find the container with id 926e6333933aef8be4ed1ece9b46a4315b162e842919161e948eceb7535d6c77
Jul 30 10:49:22.702220 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.702191    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zxmk8"]
Jul 30 10:49:22.707384 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:22.707293    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eee8b57_b110_4823_ba5d_4aa4a7420380.slice/crio-d0a09c4da7a65e0f18f56de108ace2c6cb76a287d8ee8304c31adddd20d03fc5 WatchSource:0}: Error finding container d0a09c4da7a65e0f18f56de108ace2c6cb76a287d8ee8304c31adddd20d03fc5: Status 404 returned error can't find the container with id d0a09c4da7a65e0f18f56de108ace2c6cb76a287d8ee8304c31adddd20d03fc5
Jul 30 10:49:22.824945 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.824907    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6" event={"ID":"5aabefd5-8f82-4873-a4fb-80604f949f4d","Type":"ContainerStarted","Data":"b3b9e5dd639e453b2d8b712dd3743dd44d87a5832706e83d0cf28bd018f070f2"}
Jul 30 10:49:22.825125 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.824981    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6" event={"ID":"5aabefd5-8f82-4873-a4fb-80604f949f4d","Type":"ContainerStarted","Data":"926e6333933aef8be4ed1ece9b46a4315b162e842919161e948eceb7535d6c77"}
Jul 30 10:49:22.825125 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.825016    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:22.826140 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.826119    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxmk8" event={"ID":"6eee8b57-b110-4823-ba5d-4aa4a7420380","Type":"ContainerStarted","Data":"d0a09c4da7a65e0f18f56de108ace2c6cb76a287d8ee8304c31adddd20d03fc5"}
Jul 30 10:49:22.827578 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.827558    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjn6k" event={"ID":"611358e3-65fa-451a-b33b-fa0096360f05","Type":"ContainerStarted","Data":"a91821c16899720b15f7d4ce8ac1a0169e866b735ef5837b923f34b0c9bf606a"}
Jul 30 10:49:22.846957 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.846903    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6" podStartSLOduration=2.846890031 podStartE2EDuration="2.846890031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:22.845825038 +0000 UTC m=+66.954466544" watchObservedRunningTime="2026-07-30 10:49:22.846890031 +0000 UTC m=+66.955531555"
Jul 30 10:49:22.920737 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.920698    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z"]
Jul 30 10:49:22.923104 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.923070    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2k9m9"]
Jul 30 10:49:22.924637 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:22.924535    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f0d8bda_6ea9_42f0_87e0_f623f265e653.slice/crio-808b644b5dc19013be0c48d79e80f172fb1ba330149e54f841ebc22bcb916464 WatchSource:0}: Error finding container 808b644b5dc19013be0c48d79e80f172fb1ba330149e54f841ebc22bcb916464: Status 404 returned error can't find the container with id 808b644b5dc19013be0c48d79e80f172fb1ba330149e54f841ebc22bcb916464
Jul 30 10:49:22.926901 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:22.926784    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704b9252_e4e1_4e0b_a54c_9a6dcc914d63.slice/crio-4df47df04d93af5c6afe2d0588c81ee825af6563c8c353d2aa9fdfdb6db9b471 WatchSource:0}: Error finding container 4df47df04d93af5c6afe2d0588c81ee825af6563c8c353d2aa9fdfdb6db9b471: Status 404 returned error can't find the container with id 4df47df04d93af5c6afe2d0588c81ee825af6563c8c353d2aa9fdfdb6db9b471
Jul 30 10:49:22.931697 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.931677    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lhgvv"]
Jul 30 10:49:22.934436 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:22.934408    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-v7cph"]
Jul 30 10:49:22.935092 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:22.935072    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7329a22_fb04_44b6_9746_fac8c5e02216.slice/crio-50772ae6a4fe801c729f0dc5ebc7ffc207724d91037cb03b8f3bc79cc67c1254 WatchSource:0}: Error finding container 50772ae6a4fe801c729f0dc5ebc7ffc207724d91037cb03b8f3bc79cc67c1254: Status 404 returned error can't find the container with id 50772ae6a4fe801c729f0dc5ebc7ffc207724d91037cb03b8f3bc79cc67c1254
Jul 30 10:49:22.937552 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:22.937531    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a79e56d_1272_47c9_a57a_59278aab3818.slice/crio-e949ee121cc24736ce0f9240b0e3c1214ff96a9b3dfc85023b169772d59f6528 WatchSource:0}: Error finding container e949ee121cc24736ce0f9240b0e3c1214ff96a9b3dfc85023b169772d59f6528: Status 404 returned error can't find the container with id e949ee121cc24736ce0f9240b0e3c1214ff96a9b3dfc85023b169772d59f6528
Jul 30 10:49:23.835579 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:23.835017    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v7cph" event={"ID":"6a79e56d-1272-47c9-a57a-59278aab3818","Type":"ContainerStarted","Data":"e949ee121cc24736ce0f9240b0e3c1214ff96a9b3dfc85023b169772d59f6528"}
Jul 30 10:49:23.837036 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:23.836975    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2k9m9" event={"ID":"704b9252-e4e1-4e0b-a54c-9a6dcc914d63","Type":"ContainerStarted","Data":"4df47df04d93af5c6afe2d0588c81ee825af6563c8c353d2aa9fdfdb6db9b471"}
Jul 30 10:49:23.838834 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:23.838787    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z" event={"ID":"4f0d8bda-6ea9-42f0-87e0-f623f265e653","Type":"ContainerStarted","Data":"808b644b5dc19013be0c48d79e80f172fb1ba330149e54f841ebc22bcb916464"}
Jul 30 10:49:23.841024 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:23.840953    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhgvv" event={"ID":"d7329a22-fb04-44b6-9746-fac8c5e02216","Type":"ContainerStarted","Data":"50772ae6a4fe801c729f0dc5ebc7ffc207724d91037cb03b8f3bc79cc67c1254"}
Jul 30 10:49:24.856153 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:24.856067    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxmk8" event={"ID":"6eee8b57-b110-4823-ba5d-4aa4a7420380","Type":"ContainerStarted","Data":"876f908732867435e617c51c2cd827fffb22d93f7d303a45f1044004c13728d8"}
Jul 30 10:49:24.856153 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:24.856141    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zxmk8" event={"ID":"6eee8b57-b110-4823-ba5d-4aa4a7420380","Type":"ContainerStarted","Data":"ded416e57dda6af54d8749887011e28a0760be725b62a7be2e6ade3741964ec4"}
Jul 30 10:49:24.877334 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:24.876575    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zxmk8" podStartSLOduration=67.40983954 podStartE2EDuration="1m8.876552657s" totalImagesPullingTime="1.466713117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:24.876540208 +0000 UTC m=+68.985181703" watchObservedRunningTime="2026-07-30 10:49:24.876552657 +0000 UTC m=+68.985194150"
Jul 30 10:49:27.668597 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:27.668559    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht"]
Jul 30 10:49:27.671299 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:27.671275    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht"
Jul 30 10:49:27.674203 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:27.674181    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 30 10:49:27.674498 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:27.674480    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9bnpj\""
Jul 30 10:49:27.680762 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:27.680730    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht"]
Jul 30 10:49:27.732873 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:27.732837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fd88a5a8-8182-4e34-9092-8e016ce6988c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-cvcht\" (UID: \"fd88a5a8-8182-4e34-9092-8e016ce6988c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht"
Jul 30 10:49:27.833221 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:27.833181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fd88a5a8-8182-4e34-9092-8e016ce6988c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-cvcht\" (UID: \"fd88a5a8-8182-4e34-9092-8e016ce6988c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht"
Jul 30 10:49:27.835947 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:27.835920    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fd88a5a8-8182-4e34-9092-8e016ce6988c-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-cvcht\" (UID: \"fd88a5a8-8182-4e34-9092-8e016ce6988c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht"
Jul 30 10:49:27.981646 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:27.981567    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht"
Jul 30 10:49:29.530477 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:29.530441    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-gqrgs"]
Jul 30 10:49:29.532192 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:29.532172    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-gqrgs"
Jul 30 10:49:29.535496 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:29.535473    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 10:49:29.535764 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:29.535737    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 10:49:29.535907 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:29.535886    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xc6ns\""
Jul 30 10:49:29.546458 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:29.546425    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-gqrgs"]
Jul 30 10:49:29.647094 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:29.647055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfxj9\" (UniqueName: \"kubernetes.io/projected/9df88ad9-d211-4e41-8b67-d05c9e9510e8-kube-api-access-pfxj9\") pod \"downloads-7c97dc4555-gqrgs\" (UID: \"9df88ad9-d211-4e41-8b67-d05c9e9510e8\") " pod="openshift-console/downloads-7c97dc4555-gqrgs"
Jul 30 10:49:29.747523 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:29.747480    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfxj9\" (UniqueName: \"kubernetes.io/projected/9df88ad9-d211-4e41-8b67-d05c9e9510e8-kube-api-access-pfxj9\") pod \"downloads-7c97dc4555-gqrgs\" (UID: \"9df88ad9-d211-4e41-8b67-d05c9e9510e8\") " pod="openshift-console/downloads-7c97dc4555-gqrgs"
Jul 30 10:49:29.758399 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:29.758366    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfxj9\" (UniqueName: \"kubernetes.io/projected/9df88ad9-d211-4e41-8b67-d05c9e9510e8-kube-api-access-pfxj9\") pod \"downloads-7c97dc4555-gqrgs\" (UID: \"9df88ad9-d211-4e41-8b67-d05c9e9510e8\") " pod="openshift-console/downloads-7c97dc4555-gqrgs"
Jul 30 10:49:29.841859 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:29.841773    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-gqrgs"
Jul 30 10:49:30.708449 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:30.708416    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-gqrgs"]
Jul 30 10:49:30.723658 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:30.723622    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht"]
Jul 30 10:49:30.915999 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:30.915966    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd88a5a8_8182_4e34_9092_8e016ce6988c.slice/crio-b44e9539ebbdf261f1d2ad15364f49a9a646069eb079e8cea325ab868d9a37de WatchSource:0}: Error finding container b44e9539ebbdf261f1d2ad15364f49a9a646069eb079e8cea325ab868d9a37de: Status 404 returned error can't find the container with id b44e9539ebbdf261f1d2ad15364f49a9a646069eb079e8cea325ab868d9a37de
Jul 30 10:49:30.916318 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:30.916293    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df88ad9_d211_4e41_8b67_d05c9e9510e8.slice/crio-1181d0c7f6a1753f3d3f4b141bccd7a4f96e33de5acb209ba3eca05a90115d3d WatchSource:0}: Error finding container 1181d0c7f6a1753f3d3f4b141bccd7a4f96e33de5acb209ba3eca05a90115d3d: Status 404 returned error can't find the container with id 1181d0c7f6a1753f3d3f4b141bccd7a4f96e33de5acb209ba3eca05a90115d3d
Jul 30 10:49:31.891667 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.891556    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v7cph" event={"ID":"6a79e56d-1272-47c9-a57a-59278aab3818","Type":"ContainerStarted","Data":"93bfd3c9c4653cd391759162c8c81450e5e41a416c94119d0a46030b80fcf63b"}
Jul 30 10:49:31.893749 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.893716    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-gqrgs" event={"ID":"9df88ad9-d211-4e41-8b67-d05c9e9510e8","Type":"ContainerStarted","Data":"1181d0c7f6a1753f3d3f4b141bccd7a4f96e33de5acb209ba3eca05a90115d3d"}
Jul 30 10:49:31.895612 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.895586    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2k9m9" event={"ID":"704b9252-e4e1-4e0b-a54c-9a6dcc914d63","Type":"ContainerStarted","Data":"965fd0d123918909532a7f1cd0b477c8dafd35629205966293f519e8735cd420"}
Jul 30 10:49:31.896149 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.895989    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:49:31.898430 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.898399    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vjn6k" event={"ID":"611358e3-65fa-451a-b33b-fa0096360f05","Type":"ContainerStarted","Data":"9944050a7ec2fda8634a0072a51f9c2c591a28ef22b042d75412b10e611a7809"}
Jul 30 10:49:31.901185 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.901159    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z" event={"ID":"4f0d8bda-6ea9-42f0-87e0-f623f265e653","Type":"ContainerStarted","Data":"7a9ba551fe521a9d7c65969f4b366a1f581de135efeefa2f876bc28c2623b570"}
Jul 30 10:49:31.903124 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.903097    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lhgvv" event={"ID":"d7329a22-fb04-44b6-9746-fac8c5e02216","Type":"ContainerStarted","Data":"c72220d387ab7b2c0b32103218f2444e0d97cad035580deab4e3bc0a23d01ced"}
Jul 30 10:49:31.905301 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.905277    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht" event={"ID":"fd88a5a8-8182-4e34-9092-8e016ce6988c","Type":"ContainerStarted","Data":"b44e9539ebbdf261f1d2ad15364f49a9a646069eb079e8cea325ab868d9a37de"}
Jul 30 10:49:31.910287 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.910214    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v7cph" podStartSLOduration=3.875581167 podStartE2EDuration="11.910137132s" totalImagesPullingTime="8.034555965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:31.909046801 +0000 UTC m=+76.017688296" watchObservedRunningTime="2026-07-30 10:49:31.910137132 +0000 UTC m=+76.018778619"
Jul 30 10:49:31.926711 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.926626    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lhgvv" podStartSLOduration=66.945447153 podStartE2EDuration="1m14.926603257s" totalImagesPullingTime="7.981156104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:31.925431532 +0000 UTC m=+76.034073051" watchObservedRunningTime="2026-07-30 10:49:31.926603257 +0000 UTC m=+76.035244751"
Jul 30 10:49:31.941508 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.941448    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c7dfc7d8d-gvj6z" podStartSLOduration=3.9389652870000003 podStartE2EDuration="11.941432865s" totalImagesPullingTime="8.002467578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:31.941405997 +0000 UTC m=+76.050047493" watchObservedRunningTime="2026-07-30 10:49:31.941432865 +0000 UTC m=+76.050074357"
Jul 30 10:49:31.959074 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.959013    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2k9m9" podStartSLOduration=68.333986363 podStartE2EDuration="1m15.958991541s" totalImagesPullingTime="7.625005178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:48:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:31.958455742 +0000 UTC m=+76.067097236" watchObservedRunningTime="2026-07-30 10:49:31.958991541 +0000 UTC m=+76.067633035"
Jul 30 10:49:31.980797 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:31.980342    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vjn6k" podStartSLOduration=18.197473583 podStartE2EDuration="34.98031986s" totalImagesPullingTime="16.782846277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 10:48:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:31.979924566 +0000 UTC m=+76.088566059" watchObservedRunningTime="2026-07-30 10:49:31.98031986 +0000 UTC m=+76.088961353"
Jul 30 10:49:32.910956 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:32.910920    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht" event={"ID":"fd88a5a8-8182-4e34-9092-8e016ce6988c","Type":"ContainerStarted","Data":"65938995b296930922b1c335c3eb988fc7fa94a52f2f8f617e8d02c5323bddc8"}
Jul 30 10:49:32.911800 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:32.911765    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht"
Jul 30 10:49:32.917947 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:32.917921    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht"
Jul 30 10:49:32.927562 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:32.927512    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cvcht" podStartSLOduration=4.472675421 podStartE2EDuration="5.927492444s" totalImagesPullingTime="1.454817023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:32.926626886 +0000 UTC m=+77.035268382" watchObservedRunningTime="2026-07-30 10:49:32.927492444 +0000 UTC m=+77.036133934"
Jul 30 10:49:34.657575 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.657533    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8554b4d84f-ttdlb"]
Jul 30 10:49:34.663361 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.663332    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.666000 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.665975    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 10:49:34.666000 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.665968    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 10:49:34.666203 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.666165    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 10:49:34.667190 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.666990    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-drg7x\""
Jul 30 10:49:34.667190 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.667042    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 10:49:34.667190 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.667164    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 10:49:34.673281 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.672990    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8554b4d84f-ttdlb"]
Jul 30 10:49:34.788113 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.788075    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-serving-cert\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.788303 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.788152    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-oauth-config\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.788303 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.788245    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-service-ca\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.788425 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.788298    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2djq7\" (UniqueName: \"kubernetes.io/projected/6d089c60-d74c-4159-8682-ec4f3c73c45d-kube-api-access-2djq7\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.788425 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.788365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-config\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.788425 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.788405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-oauth-serving-cert\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.889462 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.889405    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-oauth-config\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.889462 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.889454    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-service-ca\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.889725 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.889487    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2djq7\" (UniqueName: \"kubernetes.io/projected/6d089c60-d74c-4159-8682-ec4f3c73c45d-kube-api-access-2djq7\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.889725 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.889517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-config\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.889725 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.889540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-oauth-serving-cert\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.889725 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.889565    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-serving-cert\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.890687 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.890658    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-service-ca\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.890806 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.890765    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-config\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.890872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.890849    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-oauth-serving-cert\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.892491 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.892462    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-serving-cert\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.892618 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.892540    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-oauth-config\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.902652 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.902618    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2djq7\" (UniqueName: \"kubernetes.io/projected/6d089c60-d74c-4159-8682-ec4f3c73c45d-kube-api-access-2djq7\") pod \"console-8554b4d84f-ttdlb\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") " pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:34.976347 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:34.976237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:35.126926 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:35.126891    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8554b4d84f-ttdlb"]
Jul 30 10:49:35.130953 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:35.130922    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d089c60_d74c_4159_8682_ec4f3c73c45d.slice/crio-3678b8d22a1b399757c6fc4aa3699e11c418ec62e8b56e84affa4fe5ee527d01 WatchSource:0}: Error finding container 3678b8d22a1b399757c6fc4aa3699e11c418ec62e8b56e84affa4fe5ee527d01: Status 404 returned error can't find the container with id 3678b8d22a1b399757c6fc4aa3699e11c418ec62e8b56e84affa4fe5ee527d01
Jul 30 10:49:35.924584 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:35.924544    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8554b4d84f-ttdlb" event={"ID":"6d089c60-d74c-4159-8682-ec4f3c73c45d","Type":"ContainerStarted","Data":"3678b8d22a1b399757c6fc4aa3699e11c418ec62e8b56e84affa4fe5ee527d01"}
Jul 30 10:49:38.939964 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:38.939919    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8554b4d84f-ttdlb" event={"ID":"6d089c60-d74c-4159-8682-ec4f3c73c45d","Type":"ContainerStarted","Data":"0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5"}
Jul 30 10:49:38.959418 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:38.959355    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8554b4d84f-ttdlb" podStartSLOduration=1.666120668 podStartE2EDuration="4.959334198s" totalImagesPullingTime="3.29321353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:38.958448954 +0000 UTC m=+83.067090458" watchObservedRunningTime="2026-07-30 10:49:38.959334198 +0000 UTC m=+83.067975690"
Jul 30 10:49:40.098861 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.098823    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"]
Jul 30 10:49:40.102634 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.102601    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.105417 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.105370    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 30 10:49:40.105417 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.105398    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 10:49:40.105662 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.105374    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 10:49:40.106429 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.106405    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 30 10:49:40.106528 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.106435    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9w68k\""
Jul 30 10:49:40.106720 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.106693    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 10:49:40.113322 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.113293    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"]
Jul 30 10:49:40.116774 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.116738    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dk9w9"]
Jul 30 10:49:40.116958 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.116884    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.119805 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.119782    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 30 10:49:40.119938 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.119793    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 30 10:49:40.119938 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.119895    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-j6wlm\""
Jul 30 10:49:40.120246 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.120205    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 30 10:49:40.120978 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.120923    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"]
Jul 30 10:49:40.121088 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.121072    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.124446 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.124389    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 10:49:40.124887 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.124864    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 10:49:40.124887 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.124880    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 10:49:40.125387 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.125370    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r6g6q\""
Jul 30 10:49:40.142789 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.142757    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"]
Jul 30 10:49:40.233784 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.233747    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-tls\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.233784 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.233783    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-wtmp\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.234028 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.233818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqcd6\" (UniqueName: \"kubernetes.io/projected/5c7a612e-1dc9-486e-842c-2322e74e4d9b-kube-api-access-fqcd6\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.234028 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.233883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.234028 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.233928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d119d959-6bc2-49fb-8bad-5d117709b07d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.234028 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.233956    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-textfile\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.234028 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.233984    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-accelerators-collector-config\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.234306 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c7a612e-1dc9-486e-842c-2322e74e4d9b-metrics-client-ca\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.234306 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d119d959-6bc2-49fb-8bad-5d117709b07d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.234306 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsd2j\" (UniqueName: \"kubernetes.io/projected/d119d959-6bc2-49fb-8bad-5d117709b07d-kube-api-access-rsd2j\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.234306 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234158    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.234306 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c7a612e-1dc9-486e-842c-2322e74e4d9b-sys\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.234306 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234212    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a810588-1c40-4e7b-a016-38816e4db2eb-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.234306 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kdjw\" (UniqueName: \"kubernetes.io/projected/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-api-access-8kdjw\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.234306 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234278    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c7a612e-1dc9-486e-842c-2322e74e4d9b-root\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.234599 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234347    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.234599 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234379    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.234599 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d119d959-6bc2-49fb-8bad-5d117709b07d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.234599 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.234422    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7a810588-1c40-4e7b-a016-38816e4db2eb-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.335451 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335407    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-textfile\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.335645 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-accelerators-collector-config\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.335645 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335505    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c7a612e-1dc9-486e-842c-2322e74e4d9b-metrics-client-ca\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.335645 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335549    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d119d959-6bc2-49fb-8bad-5d117709b07d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.335645 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsd2j\" (UniqueName: \"kubernetes.io/projected/d119d959-6bc2-49fb-8bad-5d117709b07d-kube-api-access-rsd2j\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.335645 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335618    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.335645 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c7a612e-1dc9-486e-842c-2322e74e4d9b-sys\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a810588-1c40-4e7b-a016-38816e4db2eb-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335695    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kdjw\" (UniqueName: \"kubernetes.io/projected/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-api-access-8kdjw\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335714    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c7a612e-1dc9-486e-842c-2322e74e4d9b-root\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335755    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335771    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335791    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d119d959-6bc2-49fb-8bad-5d117709b07d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335819    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7a810588-1c40-4e7b-a016-38816e4db2eb-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335846    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-tls\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335863    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-wtmp\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335896    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqcd6\" (UniqueName: \"kubernetes.io/projected/5c7a612e-1dc9-486e-842c-2322e74e4d9b-kube-api-access-fqcd6\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.335949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335932    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d119d959-6bc2-49fb-8bad-5d117709b07d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.336564 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.335769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-textfile\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.336564 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.336111    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c7a612e-1dc9-486e-842c-2322e74e4d9b-sys\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.336564 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.336377    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.336564 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.336449    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c7a612e-1dc9-486e-842c-2322e74e4d9b-root\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.336771 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.336586    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-accelerators-collector-config\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.336827 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.336796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a810588-1c40-4e7b-a016-38816e4db2eb-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.336883 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.336858    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d119d959-6bc2-49fb-8bad-5d117709b07d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.337355 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.337326    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c7a612e-1dc9-486e-842c-2322e74e4d9b-metrics-client-ca\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.337464 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:49:40.337434    2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 30 10:49:40.337464 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.337443    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-wtmp\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.337569 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:49:40.337492    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-tls podName:7a810588-1c40-4e7b-a016-38816e4db2eb nodeName:}" failed. No retries permitted until 2026-07-30 10:49:40.837472718 +0000 UTC m=+84.946114192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-bl6bf" (UID: "7a810588-1c40-4e7b-a016-38816e4db2eb") : secret "kube-state-metrics-tls" not found
Jul 30 10:49:40.337569 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.337546    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7a810588-1c40-4e7b-a016-38816e4db2eb-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.339965 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.339914    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d119d959-6bc2-49fb-8bad-5d117709b07d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.339965 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.339941    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d119d959-6bc2-49fb-8bad-5d117709b07d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.340388 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.340278    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.340722 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.340672    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.341042 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.340998    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c7a612e-1dc9-486e-842c-2322e74e4d9b-node-exporter-tls\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.350546 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.350464    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kdjw\" (UniqueName: \"kubernetes.io/projected/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-api-access-8kdjw\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.354804 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.354772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqcd6\" (UniqueName: \"kubernetes.io/projected/5c7a612e-1dc9-486e-842c-2322e74e4d9b-kube-api-access-fqcd6\") pod \"node-exporter-dk9w9\" (UID: \"5c7a612e-1dc9-486e-842c-2322e74e4d9b\") " pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.355047 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.355024    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsd2j\" (UniqueName: \"kubernetes.io/projected/d119d959-6bc2-49fb-8bad-5d117709b07d-kube-api-access-rsd2j\") pod \"openshift-state-metrics-b8f49f5c6-bmxj5\" (UID: \"d119d959-6bc2-49fb-8bad-5d117709b07d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.414480 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.414445    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"
Jul 30 10:49:40.437051 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.437017    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dk9w9"
Jul 30 10:49:40.449705 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:40.449673    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7a612e_1dc9_486e_842c_2322e74e4d9b.slice/crio-f4ff19cccc7e61a358e24c944bfe0e8b5d1ad01b5e6076202642a3d5de4df491 WatchSource:0}: Error finding container f4ff19cccc7e61a358e24c944bfe0e8b5d1ad01b5e6076202642a3d5de4df491: Status 404 returned error can't find the container with id f4ff19cccc7e61a358e24c944bfe0e8b5d1ad01b5e6076202642a3d5de4df491
Jul 30 10:49:40.575936 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.575902    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5"]
Jul 30 10:49:40.579855 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:40.579813    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd119d959_6bc2_49fb_8bad_5d117709b07d.slice/crio-de971bdb1702400143950bc38db96582c8231c26619d900856f6f60076f0b351 WatchSource:0}: Error finding container de971bdb1702400143950bc38db96582c8231c26619d900856f6f60076f0b351: Status 404 returned error can't find the container with id de971bdb1702400143950bc38db96582c8231c26619d900856f6f60076f0b351
Jul 30 10:49:40.840369 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.840329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.843097 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.843061    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a810588-1c40-4e7b-a016-38816e4db2eb-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-bl6bf\" (UID: \"7a810588-1c40-4e7b-a016-38816e4db2eb\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:40.952080 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.952025    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dk9w9" event={"ID":"5c7a612e-1dc9-486e-842c-2322e74e4d9b","Type":"ContainerStarted","Data":"f4ff19cccc7e61a358e24c944bfe0e8b5d1ad01b5e6076202642a3d5de4df491"}
Jul 30 10:49:40.954402 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.954369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5" event={"ID":"d119d959-6bc2-49fb-8bad-5d117709b07d","Type":"ContainerStarted","Data":"2606da3864de049a0f3bf0a45b0e032a4e80c43c0ee360f522f3242c81ab9e6c"}
Jul 30 10:49:40.954542 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.954432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5" event={"ID":"d119d959-6bc2-49fb-8bad-5d117709b07d","Type":"ContainerStarted","Data":"2bbf20b6e413c4b0f8574cac0d6a8647d6a77840d3f467e5cf9affd8137f3d4f"}
Jul 30 10:49:40.954542 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:40.954451    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5" event={"ID":"d119d959-6bc2-49fb-8bad-5d117709b07d","Type":"ContainerStarted","Data":"de971bdb1702400143950bc38db96582c8231c26619d900856f6f60076f0b351"}
Jul 30 10:49:41.032018 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:41.030862    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"
Jul 30 10:49:41.216887 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:41.216763    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf"]
Jul 30 10:49:41.219980 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:41.219933    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a810588_1c40_4e7b_a016_38816e4db2eb.slice/crio-7e39a423f7775fa90a93a91a6482070ef5ab01eb857cc2a9842fdc2c45e796bb WatchSource:0}: Error finding container 7e39a423f7775fa90a93a91a6482070ef5ab01eb857cc2a9842fdc2c45e796bb: Status 404 returned error can't find the container with id 7e39a423f7775fa90a93a91a6482070ef5ab01eb857cc2a9842fdc2c45e796bb
Jul 30 10:49:41.960587 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:41.960547    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf" event={"ID":"7a810588-1c40-4e7b-a016-38816e4db2eb","Type":"ContainerStarted","Data":"7e39a423f7775fa90a93a91a6482070ef5ab01eb857cc2a9842fdc2c45e796bb"}
Jul 30 10:49:43.431942 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.431903    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f7c6f8778-499kr"]
Jul 30 10:49:43.439600 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.439570    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.450045 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.449318    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f7c6f8778-499kr"]
Jul 30 10:49:43.450804 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.450778    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 30 10:49:43.563619 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.563571    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-oauth-config\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.563778 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.563625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-service-ca\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.563778 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.563691    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-serving-cert\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.563778 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.563733    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-console-config\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.563778 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.563763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-trusted-ca-bundle\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.563778 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.563777    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-oauth-serving-cert\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.563957 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.563800    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj66d\" (UniqueName: \"kubernetes.io/projected/deed32f3-263a-46a4-8107-59a036bd4182-kube-api-access-gj66d\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.664957 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.664915    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-serving-cert\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.665132 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.664977    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-console-config\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.665132 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.665017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-trusted-ca-bundle\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.665132 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.665043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-oauth-serving-cert\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.665132 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.665072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj66d\" (UniqueName: \"kubernetes.io/projected/deed32f3-263a-46a4-8107-59a036bd4182-kube-api-access-gj66d\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.665132 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.665118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-oauth-config\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.665406 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.665144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-service-ca\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.666074 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.666049    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-trusted-ca-bundle\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.666176 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.666094    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-console-config\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.666176 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.666100    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-service-ca\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.666288 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.666207    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-oauth-serving-cert\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.667897 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.667870    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-serving-cert\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.667999 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.667949    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-oauth-config\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.677841 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.677808    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj66d\" (UniqueName: \"kubernetes.io/projected/deed32f3-263a-46a4-8107-59a036bd4182-kube-api-access-gj66d\") pod \"console-7f7c6f8778-499kr\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") " pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.752563 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.752463    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:43.846721 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:43.846687    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55f47d7f4d-gkzb6"
Jul 30 10:49:44.417796 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.417767    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56786fb6b8-h24sz"]
Jul 30 10:49:44.466512 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.466477    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56786fb6b8-h24sz"]
Jul 30 10:49:44.467044 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.466622    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.470476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.470453    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 30 10:49:44.470641 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.470453    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 10:49:44.471006 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.470954    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 30 10:49:44.471542 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.471520    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 30 10:49:44.471638 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.471579    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-976hircge3q3g\""
Jul 30 10:49:44.472390 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.472371    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-hhkqr\""
Jul 30 10:49:44.575193 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.575157    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c9527a5a-dbba-4a6c-95bb-743e894dd85b-metrics-server-audit-profiles\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.575397 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.575216    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c9527a5a-dbba-4a6c-95bb-743e894dd85b-secret-metrics-server-tls\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.575397 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.575310    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9527a5a-dbba-4a6c-95bb-743e894dd85b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.575397 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.575351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c9527a5a-dbba-4a6c-95bb-743e894dd85b-secret-metrics-server-client-certs\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.575397 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.575374    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c9527a5a-dbba-4a6c-95bb-743e894dd85b-client-ca-bundle\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.575397 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.575396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c9527a5a-dbba-4a6c-95bb-743e894dd85b-audit-log\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.575626 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.575471    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smrlw\" (UniqueName: \"kubernetes.io/projected/c9527a5a-dbba-4a6c-95bb-743e894dd85b-kube-api-access-smrlw\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.676777 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.676492    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9527a5a-dbba-4a6c-95bb-743e894dd85b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.676777 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.676544    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c9527a5a-dbba-4a6c-95bb-743e894dd85b-secret-metrics-server-client-certs\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.676777 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.676578    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c9527a5a-dbba-4a6c-95bb-743e894dd85b-client-ca-bundle\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.676777 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.676612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c9527a5a-dbba-4a6c-95bb-743e894dd85b-audit-log\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.676777 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.676668    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smrlw\" (UniqueName: \"kubernetes.io/projected/c9527a5a-dbba-4a6c-95bb-743e894dd85b-kube-api-access-smrlw\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.676777 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.676703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c9527a5a-dbba-4a6c-95bb-743e894dd85b-metrics-server-audit-profiles\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.676777 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.676743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c9527a5a-dbba-4a6c-95bb-743e894dd85b-secret-metrics-server-tls\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.677258 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.677096    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c9527a5a-dbba-4a6c-95bb-743e894dd85b-audit-log\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.677387 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.677359    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9527a5a-dbba-4a6c-95bb-743e894dd85b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.677987 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.677879    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c9527a5a-dbba-4a6c-95bb-743e894dd85b-metrics-server-audit-profiles\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.679633 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.679588    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c9527a5a-dbba-4a6c-95bb-743e894dd85b-client-ca-bundle\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.679731 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.679678    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c9527a5a-dbba-4a6c-95bb-743e894dd85b-secret-metrics-server-tls\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.679944 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.679918    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c9527a5a-dbba-4a6c-95bb-743e894dd85b-secret-metrics-server-client-certs\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.686663 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.686639    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smrlw\" (UniqueName: \"kubernetes.io/projected/c9527a5a-dbba-4a6c-95bb-743e894dd85b-kube-api-access-smrlw\") pod \"metrics-server-56786fb6b8-h24sz\" (UID: \"c9527a5a-dbba-4a6c-95bb-743e894dd85b\") " pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.782432 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.782369    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:49:44.908240 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.908185    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"]
Jul 30 10:49:44.928863 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.928762    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"]
Jul 30 10:49:44.929027 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.928931    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"
Jul 30 10:49:44.931885 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.931858    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 30 10:49:44.932024 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.931936    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mmmh5\""
Jul 30 10:49:44.976943 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.976911    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:44.977118 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.976969    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:44.978670 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.978639    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cth5\" (UniqueName: \"kubernetes.io/projected/2e4d14ae-5a18-4bca-9aac-6995d8a7404b-kube-api-access-6cth5\") pod \"monitoring-plugin-68b7fc9574-mpjcw\" (UID: \"2e4d14ae-5a18-4bca-9aac-6995d8a7404b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"
Jul 30 10:49:44.978818 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.978696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4d14ae-5a18-4bca-9aac-6995d8a7404b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mpjcw\" (UID: \"2e4d14ae-5a18-4bca-9aac-6995d8a7404b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"
Jul 30 10:49:44.983589 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:44.983553    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:45.079768 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:45.079734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cth5\" (UniqueName: \"kubernetes.io/projected/2e4d14ae-5a18-4bca-9aac-6995d8a7404b-kube-api-access-6cth5\") pod \"monitoring-plugin-68b7fc9574-mpjcw\" (UID: \"2e4d14ae-5a18-4bca-9aac-6995d8a7404b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"
Jul 30 10:49:45.079968 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:45.079788    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4d14ae-5a18-4bca-9aac-6995d8a7404b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mpjcw\" (UID: \"2e4d14ae-5a18-4bca-9aac-6995d8a7404b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"
Jul 30 10:49:45.080074 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:49:45.080053    2583 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 30 10:49:45.080164 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:49:45.080151    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4d14ae-5a18-4bca-9aac-6995d8a7404b-monitoring-plugin-cert podName:2e4d14ae-5a18-4bca-9aac-6995d8a7404b nodeName:}" failed. No retries permitted until 2026-07-30 10:49:45.580125316 +0000 UTC m=+89.688766791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2e4d14ae-5a18-4bca-9aac-6995d8a7404b-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-mpjcw" (UID: "2e4d14ae-5a18-4bca-9aac-6995d8a7404b") : secret "monitoring-plugin-cert" not found
Jul 30 10:49:45.091209 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:45.091168    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cth5\" (UniqueName: \"kubernetes.io/projected/2e4d14ae-5a18-4bca-9aac-6995d8a7404b-kube-api-access-6cth5\") pod \"monitoring-plugin-68b7fc9574-mpjcw\" (UID: \"2e4d14ae-5a18-4bca-9aac-6995d8a7404b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"
Jul 30 10:49:45.585726 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:45.585681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4d14ae-5a18-4bca-9aac-6995d8a7404b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mpjcw\" (UID: \"2e4d14ae-5a18-4bca-9aac-6995d8a7404b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"
Jul 30 10:49:45.588663 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:45.588630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e4d14ae-5a18-4bca-9aac-6995d8a7404b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-mpjcw\" (UID: \"2e4d14ae-5a18-4bca-9aac-6995d8a7404b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"
Jul 30 10:49:45.840435 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:45.840348    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"
Jul 30 10:49:45.982271 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:45.982242    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:49:46.357029 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.356993    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 10:49:46.386560 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.386521    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 10:49:46.386784 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.386748    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.391559 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.391520    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 10:49:46.391716 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.391521    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 10:49:46.391716 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.391526    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 10:49:46.392436 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.392098    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 10:49:46.392436 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.392119    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 10:49:46.392436 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.392155    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 10:49:46.392436 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.392165    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 10:49:46.392436 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.392161    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 10:49:46.392436 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.392211    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 10:49:46.392436 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.392259    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 10:49:46.392436 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.392441    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e9vc53pt9bc26\""
Jul 30 10:49:46.392876 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.392513    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 10:49:46.392876 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.392822    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 10:49:46.392876 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.392845    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9hjwz\""
Jul 30 10:49:46.393367 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.393346    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 10:49:46.400247 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.400202    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 10:49:46.495004 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.494967    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495197 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495023    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495197 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495197 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495076    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-web-config\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495197 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495197 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495135    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv6ls\" (UniqueName: \"kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-kube-api-access-tv6ls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495189    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config-out\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495286    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495352    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495371    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495399    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495428    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495837 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495492    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495837 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495837 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495590    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495837 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495617    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.495837 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.495637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.596945 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.596896    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.596945 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.596955    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.596980    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-web-config\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597042    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597212    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv6ls\" (UniqueName: \"kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-kube-api-access-tv6ls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597281    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config-out\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597344    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597366    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597389    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597413    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597438    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597446    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.597476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597480    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.598116 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597503    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.598116 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597534    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.598116 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.598116 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.598116 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.597596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.598389 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.598269    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.600837 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.600806    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.601099 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.601053    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.601244 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.601202    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.601745 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.601543    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.601745 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.601666    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-web-config\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.601916 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.601890    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.601992 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.601968    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config-out\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.602285 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.602260    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.603036 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.602439    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.603036 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.602932    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.603036 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.602973    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.603036 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.602996    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.603437 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.603410    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.604517 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.604492    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.604619 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.604597    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.604663 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.604620    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.604784 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.604762    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.611400 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.611329    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv6ls\" (UniqueName: \"kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-kube-api-access-tv6ls\") pod \"prometheus-k8s-0\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:46.704864 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:46.704808    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:49:49.641572 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:49.641466    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 10:49:49.658150 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:49.658058    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56786fb6b8-h24sz"]
Jul 30 10:49:49.890598 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:49.890510    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"]
Jul 30 10:49:49.895906 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:49.895862    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f7c6f8778-499kr"]
Jul 30 10:49:49.997660 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:49.997616    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dk9w9" event={"ID":"5c7a612e-1dc9-486e-842c-2322e74e4d9b","Type":"ContainerStarted","Data":"065a50267792b7496c0d14f0c5eb7ab0f0e55418014c7439cec5e4bb73cd976d"}
Jul 30 10:49:50.001893 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:50.001020    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5" event={"ID":"d119d959-6bc2-49fb-8bad-5d117709b07d","Type":"ContainerStarted","Data":"b5205e91c2c3254c1c6a6e23d70dd5256aac333214559870eb5ddde666399e97"}
Jul 30 10:49:50.002911 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:50.002885    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-gqrgs" event={"ID":"9df88ad9-d211-4e41-8b67-d05c9e9510e8","Type":"ContainerStarted","Data":"6b70f2497f1547064a9bbbab8b494bd36c6c48c44e6e7221428a176f9bc88e5a"}
Jul 30 10:49:50.003195 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:50.003158    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-gqrgs"
Jul 30 10:49:50.017856 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:50.017822    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-gqrgs"
Jul 30 10:49:50.036349 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:50.036165    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-gqrgs" podStartSLOduration=2.518683169 podStartE2EDuration="21.036148071s" totalImagesPullingTime="18.517464902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:50.035964667 +0000 UTC m=+94.144606160" watchObservedRunningTime="2026-07-30 10:49:50.036148071 +0000 UTC m=+94.144789563"
Jul 30 10:49:50.055007 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:50.054945    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-bmxj5" podStartSLOduration=1.384884877 podStartE2EDuration="10.054927429s" totalImagesPullingTime="8.670042552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:50.053925283 +0000 UTC m=+94.162566778" watchObservedRunningTime="2026-07-30 10:49:50.054927429 +0000 UTC m=+94.163568921"
Jul 30 10:49:50.121592 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:49:50.121555    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeed32f3_263a_46a4_8107_59a036bd4182.slice/crio-791b2a88861974418daa83f71cdc041a870c3d7abec3d2df4e1158834f2b6a72 WatchSource:0}: Error finding container 791b2a88861974418daa83f71cdc041a870c3d7abec3d2df4e1158834f2b6a72: Status 404 returned error can't find the container with id 791b2a88861974418daa83f71cdc041a870c3d7abec3d2df4e1158834f2b6a72
Jul 30 10:49:50.256854 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:50.256769    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f7c6f8778-499kr"]
Jul 30 10:49:51.014124 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.013784    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf" event={"ID":"7a810588-1c40-4e7b-a016-38816e4db2eb","Type":"ContainerStarted","Data":"6311a070f80ac4ee0bec76d6075ba9e86b28833178680c016766ff5451a8b515"}
Jul 30 10:49:51.014124 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.013877    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf" event={"ID":"7a810588-1c40-4e7b-a016-38816e4db2eb","Type":"ContainerStarted","Data":"df3dff2db8ea144075a903f235f93e94b064557baa3350fc106fa52c75942351"}
Jul 30 10:49:51.014124 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.013906    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf" event={"ID":"7a810588-1c40-4e7b-a016-38816e4db2eb","Type":"ContainerStarted","Data":"74e531fb5c00543efa7c5756f3a40f9b74f8a0dba20d9e82cff7576a7336ea9c"}
Jul 30 10:49:51.019149 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.017920    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz" event={"ID":"c9527a5a-dbba-4a6c-95bb-743e894dd85b","Type":"ContainerStarted","Data":"12f19966fd76bc360cb594c874c4c0f7bbc278b644236bb0a096782d1cfd10cf"}
Jul 30 10:49:51.020575 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.020539    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7c6f8778-499kr" event={"ID":"deed32f3-263a-46a4-8107-59a036bd4182","Type":"ContainerStarted","Data":"84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6"}
Jul 30 10:49:51.020763 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.020600    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7c6f8778-499kr" event={"ID":"deed32f3-263a-46a4-8107-59a036bd4182","Type":"ContainerStarted","Data":"791b2a88861974418daa83f71cdc041a870c3d7abec3d2df4e1158834f2b6a72"}
Jul 30 10:49:51.023864 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.023733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerStarted","Data":"841f9f7e06a9298513abc955fe494c4226644fb714f205df11f7cad505868149"}
Jul 30 10:49:51.027425 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.026523    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c7a612e-1dc9-486e-842c-2322e74e4d9b" containerID="065a50267792b7496c0d14f0c5eb7ab0f0e55418014c7439cec5e4bb73cd976d" exitCode=0
Jul 30 10:49:51.027425 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.026633    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dk9w9" event={"ID":"5c7a612e-1dc9-486e-842c-2322e74e4d9b","Type":"ContainerDied","Data":"065a50267792b7496c0d14f0c5eb7ab0f0e55418014c7439cec5e4bb73cd976d"}
Jul 30 10:49:51.031312 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.030409    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw" event={"ID":"2e4d14ae-5a18-4bca-9aac-6995d8a7404b","Type":"ContainerStarted","Data":"6ec06522b7804866ed16d220c3c5493370c1ef2437e12a489053ef46d8d80761"}
Jul 30 10:49:51.036682 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.036622    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-bl6bf" podStartSLOduration=1.707060917 podStartE2EDuration="11.03659919s" totalImagesPullingTime="9.329538273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:51.036264946 +0000 UTC m=+95.144906439" watchObservedRunningTime="2026-07-30 10:49:51.03659919 +0000 UTC m=+95.145240662"
Jul 30 10:49:51.089481 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:51.086644    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f7c6f8778-499kr" podStartSLOduration=8.086621896 podStartE2EDuration="8.086621896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:51.085197217 +0000 UTC m=+95.193838709" watchObservedRunningTime="2026-07-30 10:49:51.086621896 +0000 UTC m=+95.195263388"
Jul 30 10:49:52.039423 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:52.039218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dk9w9" event={"ID":"5c7a612e-1dc9-486e-842c-2322e74e4d9b","Type":"ContainerStarted","Data":"e2ed7eade79bfd0930946a1e7e86b3858a3c1adb8292069b8779a5b80117501d"}
Jul 30 10:49:52.039423 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:52.039348    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dk9w9" event={"ID":"5c7a612e-1dc9-486e-842c-2322e74e4d9b","Type":"ContainerStarted","Data":"5782996b997e2c6f13a8661fa64781891816f59d5816f58603f172ca58b92cc2"}
Jul 30 10:49:52.079482 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:52.079407    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dk9w9" podStartSLOduration=3.02291053 podStartE2EDuration="12.07938032s" totalImagesPullingTime="8.951802324s" totalInitContainerRuntime="104.667466ms" isStatefulPod=true podCreationTimestamp="2026-07-30 10:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:52.077867997 +0000 UTC m=+96.186509500" watchObservedRunningTime="2026-07-30 10:49:52.07938032 +0000 UTC m=+96.188021814"
Jul 30 10:49:53.753177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:53.753042    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:49:54.051133 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:54.051035    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw" event={"ID":"2e4d14ae-5a18-4bca-9aac-6995d8a7404b","Type":"ContainerStarted","Data":"32fe9af55668dae41fd46336ef4e77dcd788f9e3b0f3c98f0f57371309a2ed5d"}
Jul 30 10:49:54.051133 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:54.051102    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"
Jul 30 10:49:54.053397 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:54.053364    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz" event={"ID":"c9527a5a-dbba-4a6c-95bb-743e894dd85b","Type":"ContainerStarted","Data":"2eb824dfdd3d5c6e0a7a7796ec70551d1068982f03a954d6ab1b03e9ab9305ba"}
Jul 30 10:49:54.056062 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:54.056034    2583 generic.go:356] "Generic (PLEG): container finished" podID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerID="64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea" exitCode=0
Jul 30 10:49:54.056181 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:54.056105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerDied","Data":"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"}
Jul 30 10:49:54.057985 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:54.057959    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw"
Jul 30 10:49:54.068944 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:54.068904    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-mpjcw" podStartSLOduration=7.43316273 podStartE2EDuration="10.068888181s" totalImagesPullingTime="2.635725451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:54.067844797 +0000 UTC m=+98.176486305" watchObservedRunningTime="2026-07-30 10:49:54.068888181 +0000 UTC m=+98.177529673"
Jul 30 10:49:54.085668 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:54.085608    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz" podStartSLOduration=6.526854752 podStartE2EDuration="10.085588065s" totalImagesPullingTime="3.558733313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:49:54.085047203 +0000 UTC m=+98.193688698" watchObservedRunningTime="2026-07-30 10:49:54.085588065 +0000 UTC m=+98.194229558"
Jul 30 10:49:59.085066 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:59.085025    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerStarted","Data":"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"}
Jul 30 10:49:59.085526 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:49:59.085158    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerStarted","Data":"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"}
Jul 30 10:50:01.095475 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:01.095442    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerStarted","Data":"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"}
Jul 30 10:50:01.095809 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:01.095508    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerStarted","Data":"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"}
Jul 30 10:50:01.304592 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:01.304558    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8554b4d84f-ttdlb"]
Jul 30 10:50:02.103476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:02.103433    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerStarted","Data":"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"}
Jul 30 10:50:02.103949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:02.103508    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerStarted","Data":"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"}
Jul 30 10:50:02.138549 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:02.138482    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.983434595 podStartE2EDuration="16.138458938s" totalImagesPullingTime="9.128073279s" totalInitContainerRuntime="26.951064ms" isStatefulPod=false podCreationTimestamp="2026-07-30 10:49:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:50:02.137260455 +0000 UTC m=+106.245901965" watchObservedRunningTime="2026-07-30 10:50:02.138458938 +0000 UTC m=+106.247100432"
Jul 30 10:50:03.924723 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:03.924673    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2k9m9"
Jul 30 10:50:04.782701 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:04.782659    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:50:04.782902 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:04.782723    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:50:06.705421 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:06.705377    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:50:17.065244 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.065156    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f7c6f8778-499kr" podUID="deed32f3-263a-46a4-8107-59a036bd4182" containerName="console" containerID="cri-o://84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6" gracePeriod=15
Jul 30 10:50:17.354439 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.354396    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:50:17.380494 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.380452    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-oauth-config\") pod \"deed32f3-263a-46a4-8107-59a036bd4182\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") "
Jul 30 10:50:17.380684 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.380516    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-console-config\") pod \"deed32f3-263a-46a4-8107-59a036bd4182\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") "
Jul 30 10:50:17.380684 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.380574    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-serving-cert\") pod \"deed32f3-263a-46a4-8107-59a036bd4182\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") "
Jul 30 10:50:17.380684 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.380600    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj66d\" (UniqueName: \"kubernetes.io/projected/deed32f3-263a-46a4-8107-59a036bd4182-kube-api-access-gj66d\") pod \"deed32f3-263a-46a4-8107-59a036bd4182\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") "
Jul 30 10:50:17.380684 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.380633    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-service-ca\") pod \"deed32f3-263a-46a4-8107-59a036bd4182\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") "
Jul 30 10:50:17.380684 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.380665    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-trusted-ca-bundle\") pod \"deed32f3-263a-46a4-8107-59a036bd4182\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") "
Jul 30 10:50:17.380983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.380762    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-oauth-serving-cert\") pod \"deed32f3-263a-46a4-8107-59a036bd4182\" (UID: \"deed32f3-263a-46a4-8107-59a036bd4182\") "
Jul 30 10:50:17.381479 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.381250    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "deed32f3-263a-46a4-8107-59a036bd4182" (UID: "deed32f3-263a-46a4-8107-59a036bd4182"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:50:17.381479 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.381353    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "deed32f3-263a-46a4-8107-59a036bd4182" (UID: "deed32f3-263a-46a4-8107-59a036bd4182"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:50:17.381479 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.381444    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-service-ca" (OuterVolumeSpecName: "service-ca") pod "deed32f3-263a-46a4-8107-59a036bd4182" (UID: "deed32f3-263a-46a4-8107-59a036bd4182"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:50:17.381953 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.381821    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-console-config" (OuterVolumeSpecName: "console-config") pod "deed32f3-263a-46a4-8107-59a036bd4182" (UID: "deed32f3-263a-46a4-8107-59a036bd4182"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:50:17.383129 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.383097    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "deed32f3-263a-46a4-8107-59a036bd4182" (UID: "deed32f3-263a-46a4-8107-59a036bd4182"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:50:17.383129 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.383110    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "deed32f3-263a-46a4-8107-59a036bd4182" (UID: "deed32f3-263a-46a4-8107-59a036bd4182"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:50:17.383408 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.383385    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deed32f3-263a-46a4-8107-59a036bd4182-kube-api-access-gj66d" (OuterVolumeSpecName: "kube-api-access-gj66d") pod "deed32f3-263a-46a4-8107-59a036bd4182" (UID: "deed32f3-263a-46a4-8107-59a036bd4182"). InnerVolumeSpecName "kube-api-access-gj66d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:50:17.481619 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.481579    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-oauth-serving-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:17.481619 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.481613    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-oauth-config\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:17.481619 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.481622    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-console-config\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:17.481619 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.481632    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/deed32f3-263a-46a4-8107-59a036bd4182-console-serving-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:17.481883 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.481640    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj66d\" (UniqueName: \"kubernetes.io/projected/deed32f3-263a-46a4-8107-59a036bd4182-kube-api-access-gj66d\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:17.481883 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.481650    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:17.481883 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:17.481659    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deed32f3-263a-46a4-8107-59a036bd4182-trusted-ca-bundle\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:18.169432 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:18.169397    2583 generic.go:356] "Generic (PLEG): container finished" podID="deed32f3-263a-46a4-8107-59a036bd4182" containerID="84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6" exitCode=0
Jul 30 10:50:18.169920 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:18.169464    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7c6f8778-499kr"
Jul 30 10:50:18.169920 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:18.169495    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7c6f8778-499kr" event={"ID":"deed32f3-263a-46a4-8107-59a036bd4182","Type":"ContainerDied","Data":"84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6"}
Jul 30 10:50:18.169920 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:18.169590    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7c6f8778-499kr" event={"ID":"deed32f3-263a-46a4-8107-59a036bd4182","Type":"ContainerDied","Data":"791b2a88861974418daa83f71cdc041a870c3d7abec3d2df4e1158834f2b6a72"}
Jul 30 10:50:18.169920 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:18.169622    2583 scope.go:117] "RemoveContainer" containerID="84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6"
Jul 30 10:50:18.179478 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:18.179458    2583 scope.go:117] "RemoveContainer" containerID="84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6"
Jul 30 10:50:18.179801 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:50:18.179781    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6\": container with ID starting with 84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6 not found: ID does not exist" containerID="84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6"
Jul 30 10:50:18.179860 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:18.179811    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6"} err="failed to get container status \"84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6\": rpc error: code = NotFound desc = could not find container \"84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6\": container with ID starting with 84e6b7b903ed230a1af7adb07d00550700a355a9759e924545b6a42611f1e6d6 not found: ID does not exist"
Jul 30 10:50:18.192400 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:18.192367    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f7c6f8778-499kr"]
Jul 30 10:50:18.200491 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:18.200461    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f7c6f8778-499kr"]
Jul 30 10:50:18.460920 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:18.460838    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deed32f3-263a-46a4-8107-59a036bd4182" path="/var/lib/kubelet/pods/deed32f3-263a-46a4-8107-59a036bd4182/volumes"
Jul 30 10:50:24.788017 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:24.787988    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:50:24.792385 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:24.792354    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56786fb6b8-h24sz"
Jul 30 10:50:26.328832 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.328794    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8554b4d84f-ttdlb" podUID="6d089c60-d74c-4159-8682-ec4f3c73c45d" containerName="console" containerID="cri-o://0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5" gracePeriod=15
Jul 30 10:50:26.623961 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.623922    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:50:26.657932 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.657896    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-oauth-config\") pod \"6d089c60-d74c-4159-8682-ec4f3c73c45d\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") "
Jul 30 10:50:26.658127 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.657946    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-config\") pod \"6d089c60-d74c-4159-8682-ec4f3c73c45d\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") "
Jul 30 10:50:26.658127 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.657987    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-service-ca\") pod \"6d089c60-d74c-4159-8682-ec4f3c73c45d\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") "
Jul 30 10:50:26.658127 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.658006    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-oauth-serving-cert\") pod \"6d089c60-d74c-4159-8682-ec4f3c73c45d\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") "
Jul 30 10:50:26.658127 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.658084    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-serving-cert\") pod \"6d089c60-d74c-4159-8682-ec4f3c73c45d\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") "
Jul 30 10:50:26.658127 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.658124    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2djq7\" (UniqueName: \"kubernetes.io/projected/6d089c60-d74c-4159-8682-ec4f3c73c45d-kube-api-access-2djq7\") pod \"6d089c60-d74c-4159-8682-ec4f3c73c45d\" (UID: \"6d089c60-d74c-4159-8682-ec4f3c73c45d\") "
Jul 30 10:50:26.658460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.658433    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-config" (OuterVolumeSpecName: "console-config") pod "6d089c60-d74c-4159-8682-ec4f3c73c45d" (UID: "6d089c60-d74c-4159-8682-ec4f3c73c45d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:50:26.658460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.658443    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-service-ca" (OuterVolumeSpecName: "service-ca") pod "6d089c60-d74c-4159-8682-ec4f3c73c45d" (UID: "6d089c60-d74c-4159-8682-ec4f3c73c45d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:50:26.658766 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.658728    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6d089c60-d74c-4159-8682-ec4f3c73c45d" (UID: "6d089c60-d74c-4159-8682-ec4f3c73c45d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:50:26.660788 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.660752    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6d089c60-d74c-4159-8682-ec4f3c73c45d" (UID: "6d089c60-d74c-4159-8682-ec4f3c73c45d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:50:26.660788 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.660766    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6d089c60-d74c-4159-8682-ec4f3c73c45d" (UID: "6d089c60-d74c-4159-8682-ec4f3c73c45d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:50:26.660943 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.660790    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d089c60-d74c-4159-8682-ec4f3c73c45d-kube-api-access-2djq7" (OuterVolumeSpecName: "kube-api-access-2djq7") pod "6d089c60-d74c-4159-8682-ec4f3c73c45d" (UID: "6d089c60-d74c-4159-8682-ec4f3c73c45d"). InnerVolumeSpecName "kube-api-access-2djq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:50:26.758734 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.758692    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-serving-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:26.758734 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.758724    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2djq7\" (UniqueName: \"kubernetes.io/projected/6d089c60-d74c-4159-8682-ec4f3c73c45d-kube-api-access-2djq7\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:26.758734 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.758738    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-oauth-config\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:26.758972 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.758751    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-console-config\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:26.758972 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.758764    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:26.758972 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:26.758775    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6d089c60-d74c-4159-8682-ec4f3c73c45d-oauth-serving-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:50:27.205755 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:27.205720    2583 generic.go:356] "Generic (PLEG): container finished" podID="6d089c60-d74c-4159-8682-ec4f3c73c45d" containerID="0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5" exitCode=0
Jul 30 10:50:27.205959 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:27.205777    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8554b4d84f-ttdlb"
Jul 30 10:50:27.205959 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:27.205809    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8554b4d84f-ttdlb" event={"ID":"6d089c60-d74c-4159-8682-ec4f3c73c45d","Type":"ContainerDied","Data":"0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5"}
Jul 30 10:50:27.205959 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:27.205860    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8554b4d84f-ttdlb" event={"ID":"6d089c60-d74c-4159-8682-ec4f3c73c45d","Type":"ContainerDied","Data":"3678b8d22a1b399757c6fc4aa3699e11c418ec62e8b56e84affa4fe5ee527d01"}
Jul 30 10:50:27.205959 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:27.205881    2583 scope.go:117] "RemoveContainer" containerID="0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5"
Jul 30 10:50:27.215411 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:27.215390    2583 scope.go:117] "RemoveContainer" containerID="0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5"
Jul 30 10:50:27.215737 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:50:27.215714    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5\": container with ID starting with 0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5 not found: ID does not exist" containerID="0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5"
Jul 30 10:50:27.215805 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:27.215754    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5"} err="failed to get container status \"0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5\": rpc error: code = NotFound desc = could not find container \"0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5\": container with ID starting with 0e88a4bfc010920c207a6a1dc164215dc623c262095eacb6b51c5caca3f341b5 not found: ID does not exist"
Jul 30 10:50:27.228364 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:27.228334    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8554b4d84f-ttdlb"]
Jul 30 10:50:27.232358 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:27.232324    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8554b4d84f-ttdlb"]
Jul 30 10:50:28.461284 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:28.461249    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d089c60-d74c-4159-8682-ec4f3c73c45d" path="/var/lib/kubelet/pods/6d089c60-d74c-4159-8682-ec4f3c73c45d/volumes"
Jul 30 10:50:46.706049 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:46.706001    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:50:46.725895 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:46.725862    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:50:47.306685 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:50:47.306656    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:04.803246 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:04.803196    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 10:51:04.803753 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:04.803504    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="prometheus" containerID="cri-o://ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8" gracePeriod=600
Jul 30 10:51:04.803753 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:04.803560    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy-web" containerID="cri-o://32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a" gracePeriod=600
Jul 30 10:51:04.803753 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:04.803569    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757" gracePeriod=600
Jul 30 10:51:04.803753 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:04.803593    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="config-reloader" containerID="cri-o://0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee" gracePeriod=600
Jul 30 10:51:04.803753 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:04.803529    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy" containerID="cri-o://1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2" gracePeriod=600
Jul 30 10:51:04.803753 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:04.803529    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="thanos-sidecar" containerID="cri-o://42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064" gracePeriod=600
Jul 30 10:51:05.048177 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.048150    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.097748 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.097651    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-db\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.097748 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.097705    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-thanos-prometheus-http-client-file\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.097748 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.097748    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-tls\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.098035 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.097777    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config-out\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.098035 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.097806    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-tls-assets\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.098035 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.097829    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-trusted-ca-bundle\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.098035 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.097877    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-kubelet-serving-ca-bundle\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.098035 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.097896    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-serving-certs-ca-bundle\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.098035 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.097912    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-kube-rbac-proxy\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.098035 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.097934    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-metrics-client-certs\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.098035 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.097963    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-metrics-client-ca\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.098493 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.098456    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.098976    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.098985    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099144    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-0\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099295    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-2\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099324    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-grpc-tls\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099358    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099398    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tv6ls\" (UniqueName: \"kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-kube-api-access-tv6ls\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099427    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099479    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-1\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099353    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099523    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-web-config\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.099839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099603    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\" (UID: \"27a6fce3-2176-4eaf-9ef9-fc55e724b095\") "
Jul 30 10:51:05.100531 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099870    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-metrics-client-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.100531 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099889    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.100531 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099908    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.100531 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.099924    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.100724 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.100600    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:51:05.101113 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.100942    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 10:51:05.101720 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.101491    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:51:05.101921 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.101833    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:51:05.101921 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.101881    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:51:05.102263 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.102210    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:51:05.102263 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.102219    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 10:51:05.103733 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.103703    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:51:05.104133 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.104073    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:51:05.104133 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.104117    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config" (OuterVolumeSpecName: "config") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:51:05.104830 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.104787    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:51:05.105264 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.105217    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:51:05.105355 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.105295    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-kube-api-access-tv6ls" (OuterVolumeSpecName: "kube-api-access-tv6ls") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "kube-api-access-tv6ls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 10:51:05.105404 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.105380    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config-out" (OuterVolumeSpecName: "config-out") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 10:51:05.106000 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.105975    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:51:05.115826 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.115788    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-web-config" (OuterVolumeSpecName: "web-config") pod "27a6fce3-2176-4eaf-9ef9-fc55e724b095" (UID: "27a6fce3-2176-4eaf-9ef9-fc55e724b095"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 10:51:05.201179 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201127    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config-out\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201179 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201170    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-tls-assets\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201179 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201179    2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-kube-rbac-proxy\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201179 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201188    2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-metrics-client-certs\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201179 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201197    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201206    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201217    2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-grpc-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201253    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201261    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tv6ls\" (UniqueName: \"kubernetes.io/projected/27a6fce3-2176-4eaf-9ef9-fc55e724b095-kube-api-access-tv6ls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201269    2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-config\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201278    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201286    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-web-config\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201295    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201303    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/27a6fce3-2176-4eaf-9ef9-fc55e724b095-prometheus-k8s-db\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201312    2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.201507 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.201320    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/27a6fce3-2176-4eaf-9ef9-fc55e724b095-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 10:51:05.364750 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364662    2583 generic.go:356] "Generic (PLEG): container finished" podID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerID="a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757" exitCode=0
Jul 30 10:51:05.364750 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364693    2583 generic.go:356] "Generic (PLEG): container finished" podID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerID="1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2" exitCode=0
Jul 30 10:51:05.364750 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364700    2583 generic.go:356] "Generic (PLEG): container finished" podID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerID="32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a" exitCode=0
Jul 30 10:51:05.364750 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364707    2583 generic.go:356] "Generic (PLEG): container finished" podID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerID="42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064" exitCode=0
Jul 30 10:51:05.364750 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364713    2583 generic.go:356] "Generic (PLEG): container finished" podID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerID="0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee" exitCode=0
Jul 30 10:51:05.364750 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364719    2583 generic.go:356] "Generic (PLEG): container finished" podID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerID="ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8" exitCode=0
Jul 30 10:51:05.364750 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364733    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.365083 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364750    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerDied","Data":"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"}
Jul 30 10:51:05.365083 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerDied","Data":"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"}
Jul 30 10:51:05.365083 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364899    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerDied","Data":"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"}
Jul 30 10:51:05.365083 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364932    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerDied","Data":"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"}
Jul 30 10:51:05.365083 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364966    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerDied","Data":"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"}
Jul 30 10:51:05.365083 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364992    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerDied","Data":"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"}
Jul 30 10:51:05.365083 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.364936    2583 scope.go:117] "RemoveContainer" containerID="a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"
Jul 30 10:51:05.365083 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.365028    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"27a6fce3-2176-4eaf-9ef9-fc55e724b095","Type":"ContainerDied","Data":"841f9f7e06a9298513abc955fe494c4226644fb714f205df11f7cad505868149"}
Jul 30 10:51:05.373749 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.373702    2583 scope.go:117] "RemoveContainer" containerID="1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"
Jul 30 10:51:05.381556 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.381528    2583 scope.go:117] "RemoveContainer" containerID="32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"
Jul 30 10:51:05.389599 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.389545    2583 scope.go:117] "RemoveContainer" containerID="42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"
Jul 30 10:51:05.391760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.391738    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 10:51:05.396311 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.396284    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 10:51:05.399990 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.399970    2583 scope.go:117] "RemoveContainer" containerID="0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"
Jul 30 10:51:05.408631 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.408611    2583 scope.go:117] "RemoveContainer" containerID="ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"
Jul 30 10:51:05.417032 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.417007    2583 scope.go:117] "RemoveContainer" containerID="64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"
Jul 30 10:51:05.424960 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.424928    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 10:51:05.425304 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425213    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deed32f3-263a-46a4-8107-59a036bd4182" containerName="console"
Jul 30 10:51:05.425304 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425240    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="deed32f3-263a-46a4-8107-59a036bd4182" containerName="console"
Jul 30 10:51:05.425304 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425254    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy-web"
Jul 30 10:51:05.425304 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425262    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy-web"
Jul 30 10:51:05.425304 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425273    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="thanos-sidecar"
Jul 30 10:51:05.425304 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425278    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="thanos-sidecar"
Jul 30 10:51:05.425304 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425290    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="init-config-reloader"
Jul 30 10:51:05.425304 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425295    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="init-config-reloader"
Jul 30 10:51:05.425304 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425301    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="config-reloader"
Jul 30 10:51:05.425304 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425307    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="config-reloader"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425319    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy-thanos"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425328    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy-thanos"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425338    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d089c60-d74c-4159-8682-ec4f3c73c45d" containerName="console"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425343    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d089c60-d74c-4159-8682-ec4f3c73c45d" containerName="console"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425356    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="prometheus"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425366    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="prometheus"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425375    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425380    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425411    2583 scope.go:117] "RemoveContainer" containerID="a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425438    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="deed32f3-263a-46a4-8107-59a036bd4182" containerName="console"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425446    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425451    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy-thanos"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425457    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="prometheus"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425462    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="thanos-sidecar"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425468    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d089c60-d74c-4159-8682-ec4f3c73c45d" containerName="console"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425473    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="config-reloader"
Jul 30 10:51:05.425698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425478    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" containerName="kube-rbac-proxy-web"
Jul 30 10:51:05.426195 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:51:05.425752    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": container with ID starting with a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757 not found: ID does not exist" containerID="a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"
Jul 30 10:51:05.426195 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425778    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"} err="failed to get container status \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": rpc error: code = NotFound desc = could not find container \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": container with ID starting with a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757 not found: ID does not exist"
Jul 30 10:51:05.426195 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.425797    2583 scope.go:117] "RemoveContainer" containerID="1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"
Jul 30 10:51:05.426195 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:51:05.426076    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": container with ID starting with 1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2 not found: ID does not exist" containerID="1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"
Jul 30 10:51:05.426195 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.426098    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"} err="failed to get container status \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": rpc error: code = NotFound desc = could not find container \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": container with ID starting with 1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2 not found: ID does not exist"
Jul 30 10:51:05.426195 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.426113    2583 scope.go:117] "RemoveContainer" containerID="32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"
Jul 30 10:51:05.426432 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:51:05.426374    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": container with ID starting with 32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a not found: ID does not exist" containerID="32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"
Jul 30 10:51:05.426432 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.426404    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"} err="failed to get container status \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": rpc error: code = NotFound desc = could not find container \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": container with ID starting with 32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a not found: ID does not exist"
Jul 30 10:51:05.426432 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.426423    2583 scope.go:117] "RemoveContainer" containerID="42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"
Jul 30 10:51:05.426677 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:51:05.426661    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": container with ID starting with 42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064 not found: ID does not exist" containerID="42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"
Jul 30 10:51:05.426721 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.426681    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"} err="failed to get container status \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": rpc error: code = NotFound desc = could not find container \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": container with ID starting with 42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064 not found: ID does not exist"
Jul 30 10:51:05.426721 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.426695    2583 scope.go:117] "RemoveContainer" containerID="0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"
Jul 30 10:51:05.426940 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:51:05.426923    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": container with ID starting with 0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee not found: ID does not exist" containerID="0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"
Jul 30 10:51:05.427012 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.426948    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"} err="failed to get container status \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": rpc error: code = NotFound desc = could not find container \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": container with ID starting with 0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee not found: ID does not exist"
Jul 30 10:51:05.427012 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.426968    2583 scope.go:117] "RemoveContainer" containerID="ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"
Jul 30 10:51:05.427218 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:51:05.427201    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": container with ID starting with ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8 not found: ID does not exist" containerID="ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"
Jul 30 10:51:05.427286 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.427245    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"} err="failed to get container status \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": rpc error: code = NotFound desc = could not find container \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": container with ID starting with ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8 not found: ID does not exist"
Jul 30 10:51:05.427286 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.427261    2583 scope.go:117] "RemoveContainer" containerID="64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"
Jul 30 10:51:05.427520 ip-10-0-134-172 kubenswrapper[2583]: E0730 10:51:05.427505    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": container with ID starting with 64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea not found: ID does not exist" containerID="64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"
Jul 30 10:51:05.427553 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.427523    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"} err="failed to get container status \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": rpc error: code = NotFound desc = could not find container \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": container with ID starting with 64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea not found: ID does not exist"
Jul 30 10:51:05.427553 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.427536    2583 scope.go:117] "RemoveContainer" containerID="a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"
Jul 30 10:51:05.427775 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.427758    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"} err="failed to get container status \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": rpc error: code = NotFound desc = could not find container \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": container with ID starting with a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757 not found: ID does not exist"
Jul 30 10:51:05.427826 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.427776    2583 scope.go:117] "RemoveContainer" containerID="1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"
Jul 30 10:51:05.428037 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.428012    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"} err="failed to get container status \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": rpc error: code = NotFound desc = could not find container \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": container with ID starting with 1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2 not found: ID does not exist"
Jul 30 10:51:05.428117 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.428039    2583 scope.go:117] "RemoveContainer" containerID="32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"
Jul 30 10:51:05.428299 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.428281    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"} err="failed to get container status \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": rpc error: code = NotFound desc = could not find container \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": container with ID starting with 32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a not found: ID does not exist"
Jul 30 10:51:05.428346 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.428301    2583 scope.go:117] "RemoveContainer" containerID="42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"
Jul 30 10:51:05.429057 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.429039    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"} err="failed to get container status \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": rpc error: code = NotFound desc = could not find container \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": container with ID starting with 42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064 not found: ID does not exist"
Jul 30 10:51:05.429116 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.429057    2583 scope.go:117] "RemoveContainer" containerID="0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"
Jul 30 10:51:05.429116 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.429071    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.429323 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.429297    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"} err="failed to get container status \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": rpc error: code = NotFound desc = could not find container \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": container with ID starting with 0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee not found: ID does not exist"
Jul 30 10:51:05.429323 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.429323    2583 scope.go:117] "RemoveContainer" containerID="ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"
Jul 30 10:51:05.429775 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.429733    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"} err="failed to get container status \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": rpc error: code = NotFound desc = could not find container \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": container with ID starting with ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8 not found: ID does not exist"
Jul 30 10:51:05.429775 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.429776    2583 scope.go:117] "RemoveContainer" containerID="64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"
Jul 30 10:51:05.430031 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.430010    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"} err="failed to get container status \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": rpc error: code = NotFound desc = could not find container \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": container with ID starting with 64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea not found: ID does not exist"
Jul 30 10:51:05.430031 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.430031    2583 scope.go:117] "RemoveContainer" containerID="a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"
Jul 30 10:51:05.430393 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.430368    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"} err="failed to get container status \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": rpc error: code = NotFound desc = could not find container \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": container with ID starting with a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757 not found: ID does not exist"
Jul 30 10:51:05.430461 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.430397    2583 scope.go:117] "RemoveContainer" containerID="1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"
Jul 30 10:51:05.430639 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.430610    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"} err="failed to get container status \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": rpc error: code = NotFound desc = could not find container \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": container with ID starting with 1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2 not found: ID does not exist"
Jul 30 10:51:05.430639 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.430639    2583 scope.go:117] "RemoveContainer" containerID="32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"
Jul 30 10:51:05.430892 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.430873    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"} err="failed to get container status \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": rpc error: code = NotFound desc = could not find container \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": container with ID starting with 32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a not found: ID does not exist"
Jul 30 10:51:05.430943 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.430894    2583 scope.go:117] "RemoveContainer" containerID="42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"
Jul 30 10:51:05.431107 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.431085    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"} err="failed to get container status \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": rpc error: code = NotFound desc = could not find container \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": container with ID starting with 42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064 not found: ID does not exist"
Jul 30 10:51:05.431151 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.431110    2583 scope.go:117] "RemoveContainer" containerID="0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"
Jul 30 10:51:05.431348 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.431331    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"} err="failed to get container status \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": rpc error: code = NotFound desc = could not find container \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": container with ID starting with 0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee not found: ID does not exist"
Jul 30 10:51:05.431407 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.431348    2583 scope.go:117] "RemoveContainer" containerID="ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"
Jul 30 10:51:05.431518 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.431503    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"} err="failed to get container status \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": rpc error: code = NotFound desc = could not find container \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": container with ID starting with ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8 not found: ID does not exist"
Jul 30 10:51:05.431580 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.431518    2583 scope.go:117] "RemoveContainer" containerID="64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"
Jul 30 10:51:05.431784 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.431762    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"} err="failed to get container status \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": rpc error: code = NotFound desc = could not find container \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": container with ID starting with 64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea not found: ID does not exist"
Jul 30 10:51:05.431784 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.431783    2583 scope.go:117] "RemoveContainer" containerID="a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"
Jul 30 10:51:05.432023 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.432003    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"} err="failed to get container status \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": rpc error: code = NotFound desc = could not find container \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": container with ID starting with a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757 not found: ID does not exist"
Jul 30 10:51:05.432023 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.432023    2583 scope.go:117] "RemoveContainer" containerID="1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"
Jul 30 10:51:05.432290 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.432268    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"} err="failed to get container status \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": rpc error: code = NotFound desc = could not find container \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": container with ID starting with 1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2 not found: ID does not exist"
Jul 30 10:51:05.432351 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.432293    2583 scope.go:117] "RemoveContainer" containerID="32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"
Jul 30 10:51:05.432554 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.432531    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"} err="failed to get container status \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": rpc error: code = NotFound desc = could not find container \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": container with ID starting with 32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a not found: ID does not exist"
Jul 30 10:51:05.432619 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.432556    2583 scope.go:117] "RemoveContainer" containerID="42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"
Jul 30 10:51:05.432817 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.432793    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 10:51:05.432817 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.432797    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"} err="failed to get container status \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": rpc error: code = NotFound desc = could not find container \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": container with ID starting with 42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064 not found: ID does not exist"
Jul 30 10:51:05.433139 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.432819    2583 scope.go:117] "RemoveContainer" containerID="0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"
Jul 30 10:51:05.433139 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.432930    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9hjwz\""
Jul 30 10:51:05.433268 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433181    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 10:51:05.433268 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433177    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"} err="failed to get container status \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": rpc error: code = NotFound desc = could not find container \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": container with ID starting with 0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee not found: ID does not exist"
Jul 30 10:51:05.433268 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433199    2583 scope.go:117] "RemoveContainer" containerID="ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"
Jul 30 10:51:05.433422 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433357    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 10:51:05.433422 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433414    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 10:51:05.433572 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433548    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"} err="failed to get container status \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": rpc error: code = NotFound desc = could not find container \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": container with ID starting with ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8 not found: ID does not exist"
Jul 30 10:51:05.433678 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433575    2583 scope.go:117] "RemoveContainer" containerID="64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"
Jul 30 10:51:05.433678 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433580    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 10:51:05.433678 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433577    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 10:51:05.433900 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433873    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"} err="failed to get container status \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": rpc error: code = NotFound desc = could not find container \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": container with ID starting with 64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea not found: ID does not exist"
Jul 30 10:51:05.433900 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433900    2583 scope.go:117] "RemoveContainer" containerID="a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"
Jul 30 10:51:05.434005 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433920    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 10:51:05.434005 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.433998    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 10:51:05.434184 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.434162    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"} err="failed to get container status \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": rpc error: code = NotFound desc = could not find container \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": container with ID starting with a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757 not found: ID does not exist"
Jul 30 10:51:05.434184 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.434183    2583 scope.go:117] "RemoveContainer" containerID="1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"
Jul 30 10:51:05.434464 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.434447    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 10:51:05.434540 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.434468    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"} err="failed to get container status \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": rpc error: code = NotFound desc = could not find container \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": container with ID starting with 1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2 not found: ID does not exist"
Jul 30 10:51:05.434540 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.434485    2583 scope.go:117] "RemoveContainer" containerID="32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"
Jul 30 10:51:05.434694 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.434679    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 10:51:05.434769 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.434735    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-e9vc53pt9bc26\""
Jul 30 10:51:05.434877 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.434841    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"} err="failed to get container status \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": rpc error: code = NotFound desc = could not find container \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": container with ID starting with 32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a not found: ID does not exist"
Jul 30 10:51:05.434945 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.434878    2583 scope.go:117] "RemoveContainer" containerID="42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"
Jul 30 10:51:05.434945 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.434882    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 10:51:05.435152 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.435135    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"} err="failed to get container status \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": rpc error: code = NotFound desc = could not find container \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": container with ID starting with 42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064 not found: ID does not exist"
Jul 30 10:51:05.435201 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.435152    2583 scope.go:117] "RemoveContainer" containerID="0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"
Jul 30 10:51:05.435422 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.435403    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"} err="failed to get container status \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": rpc error: code = NotFound desc = could not find container \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": container with ID starting with 0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee not found: ID does not exist"
Jul 30 10:51:05.435517 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.435424    2583 scope.go:117] "RemoveContainer" containerID="ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"
Jul 30 10:51:05.435658 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.435632    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"} err="failed to get container status \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": rpc error: code = NotFound desc = could not find container \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": container with ID starting with ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8 not found: ID does not exist"
Jul 30 10:51:05.435720 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.435660    2583 scope.go:117] "RemoveContainer" containerID="64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"
Jul 30 10:51:05.435908 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.435870    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"} err="failed to get container status \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": rpc error: code = NotFound desc = could not find container \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": container with ID starting with 64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea not found: ID does not exist"
Jul 30 10:51:05.435908 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.435906    2583 scope.go:117] "RemoveContainer" containerID="a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"
Jul 30 10:51:05.436144 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.436128    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 10:51:05.436582 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.436557    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 10:51:05.436705 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.436681    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757"} err="failed to get container status \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": rpc error: code = NotFound desc = could not find container \"a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757\": container with ID starting with a6d9a26308d8c0742ffd2a808d93e662a324fdd050aa24aff3aebb5f03534757 not found: ID does not exist"
Jul 30 10:51:05.436800 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.436708    2583 scope.go:117] "RemoveContainer" containerID="1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"
Jul 30 10:51:05.437015 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.436987    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2"} err="failed to get container status \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": rpc error: code = NotFound desc = could not find container \"1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2\": container with ID starting with 1bba9fee315d1a99890dc45549d64722b9462359cfc055b7782142d31ea337d2 not found: ID does not exist"
Jul 30 10:51:05.437015 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.437014    2583 scope.go:117] "RemoveContainer" containerID="32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"
Jul 30 10:51:05.437349 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.437323    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a"} err="failed to get container status \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": rpc error: code = NotFound desc = could not find container \"32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a\": container with ID starting with 32279d34418dc9b1ed6e68c3de67cf6e46a729e5d7ed26634e3b5d68aecf1c1a not found: ID does not exist"
Jul 30 10:51:05.437349 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.437347    2583 scope.go:117] "RemoveContainer" containerID="42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"
Jul 30 10:51:05.437742 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.437715    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064"} err="failed to get container status \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": rpc error: code = NotFound desc = could not find container \"42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064\": container with ID starting with 42ed6578a7049473a9133b88322750a94d5476f9f21cef5a435f4575eccbb064 not found: ID does not exist"
Jul 30 10:51:05.437742 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.437738    2583 scope.go:117] "RemoveContainer" containerID="0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"
Jul 30 10:51:05.438052 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.438033    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee"} err="failed to get container status \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": rpc error: code = NotFound desc = could not find container \"0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee\": container with ID starting with 0d8eedb937f47692b1f4a80999c922577d246e525034da058fffaa76440bdcee not found: ID does not exist"
Jul 30 10:51:05.438052 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.438051    2583 scope.go:117] "RemoveContainer" containerID="ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"
Jul 30 10:51:05.438346 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.438325    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8"} err="failed to get container status \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": rpc error: code = NotFound desc = could not find container \"ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8\": container with ID starting with ef1087818709e7a771f68d43f02bf64edfcda21a74db0d412687eef2f07382a8 not found: ID does not exist"
Jul 30 10:51:05.438429 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.438346    2583 scope.go:117] "RemoveContainer" containerID="64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"
Jul 30 10:51:05.438640 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.438617    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea"} err="failed to get container status \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": rpc error: code = NotFound desc = could not find container \"64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea\": container with ID starting with 64bc95c31634b4487444964c002f26e26c6dcd62c691bcebcc377ca074d1c5ea not found: ID does not exist"
Jul 30 10:51:05.441796 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.441777    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 10:51:05.456984 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.456956    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 10:51:05.502929 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.502886    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea431918-773b-4dc5-b680-eea011dc5f62-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.502929 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.502929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503165 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.502949    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503165 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.502970    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea431918-773b-4dc5-b680-eea011dc5f62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503165 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503165 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503165 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503165 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503407 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503165    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503407 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503407 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503214    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503407 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503255    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503407 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503275    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-config\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503407 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503289    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503407 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503309    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503407 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503327    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503407 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503343    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503407 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503403    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503687 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmj2w\" (UniqueName: \"kubernetes.io/projected/ea431918-773b-4dc5-b680-eea011dc5f62-kube-api-access-fmj2w\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.503687 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.503438    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.604484 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.604484 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.604717 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.604717 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604624    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.604717 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.604717 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.604717 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-config\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.604717 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604736    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604764    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604799    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604840    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604867    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmj2w\" (UniqueName: \"kubernetes.io/projected/ea431918-773b-4dc5-b680-eea011dc5f62-kube-api-access-fmj2w\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604952    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea431918-773b-4dc5-b680-eea011dc5f62-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.604984    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.605011    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605540 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.605056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea431918-773b-4dc5-b680-eea011dc5f62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605540 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.605085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605540 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.605114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.605701 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.605584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.606460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.606309    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.606460 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.606347    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.607625 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.607598    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.607748 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.607689    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-config\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.607748 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.607710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.607865 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.607753    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.608392 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.605057    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.608392 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.608334    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.608839 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.608545    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.608964 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.608938    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.609102 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.609026    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.609492 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.609463    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.609605 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.609582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.609605 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.609593    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea431918-773b-4dc5-b680-eea011dc5f62-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.610156 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.610133    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea431918-773b-4dc5-b680-eea011dc5f62-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.610326 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.610310    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.610575 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.610560    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea431918-773b-4dc5-b680-eea011dc5f62-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.610761 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.610741    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea431918-773b-4dc5-b680-eea011dc5f62-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.617327 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.617263    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmj2w\" (UniqueName: \"kubernetes.io/projected/ea431918-773b-4dc5-b680-eea011dc5f62-kube-api-access-fmj2w\") pod \"prometheus-k8s-0\" (UID: \"ea431918-773b-4dc5-b680-eea011dc5f62\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.740697 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.740653    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:51:05.889022 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:05.888934    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 10:51:05.892121 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:51:05.892083    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea431918_773b_4dc5_b680_eea011dc5f62.slice/crio-dab23291e4a1d888ff37e1b35f6348bdddb8c2a581ea64601bd02a023068b709 WatchSource:0}: Error finding container dab23291e4a1d888ff37e1b35f6348bdddb8c2a581ea64601bd02a023068b709: Status 404 returned error can't find the container with id dab23291e4a1d888ff37e1b35f6348bdddb8c2a581ea64601bd02a023068b709
Jul 30 10:51:06.370782 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:06.370746    2583 generic.go:356] "Generic (PLEG): container finished" podID="ea431918-773b-4dc5-b680-eea011dc5f62" containerID="1cdb501d43bc9af2bed6a8c11bcbaf788bd91cb390defe911a9302e6c921cd9c" exitCode=0
Jul 30 10:51:06.370988 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:06.370842    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea431918-773b-4dc5-b680-eea011dc5f62","Type":"ContainerDied","Data":"1cdb501d43bc9af2bed6a8c11bcbaf788bd91cb390defe911a9302e6c921cd9c"}
Jul 30 10:51:06.370988 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:06.370924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea431918-773b-4dc5-b680-eea011dc5f62","Type":"ContainerStarted","Data":"dab23291e4a1d888ff37e1b35f6348bdddb8c2a581ea64601bd02a023068b709"}
Jul 30 10:51:06.461584 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:06.461549    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27a6fce3-2176-4eaf-9ef9-fc55e724b095" path="/var/lib/kubelet/pods/27a6fce3-2176-4eaf-9ef9-fc55e724b095/volumes"
Jul 30 10:51:07.379926 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:07.379894    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea431918-773b-4dc5-b680-eea011dc5f62","Type":"ContainerStarted","Data":"025a0dacb58d88630431490bc5f5d57d386284fabf6aa34fb458d7a9ec5ca0bf"}
Jul 30 10:51:07.380336 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:07.379959    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea431918-773b-4dc5-b680-eea011dc5f62","Type":"ContainerStarted","Data":"60ffb66a0cce3eb5f68a97f8d49a7550e7ebd43f16f60e3c296672af439c14f8"}
Jul 30 10:51:07.380336 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:07.379985    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea431918-773b-4dc5-b680-eea011dc5f62","Type":"ContainerStarted","Data":"13da0a062e87a970fbe5e82233323a41296d0762739e9b123404a6aecacb1010"}
Jul 30 10:51:07.380336 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:07.380010    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea431918-773b-4dc5-b680-eea011dc5f62","Type":"ContainerStarted","Data":"872b1f952389c24d8cdb0dce7d4897a20fcd35ed5ae5d1e9a7b047755f252753"}
Jul 30 10:51:07.380336 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:07.380034    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea431918-773b-4dc5-b680-eea011dc5f62","Type":"ContainerStarted","Data":"a11420263e380db4a8007cc0d9a9f405c65b3e5acdad04e44597420c0b670042"}
Jul 30 10:51:07.380336 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:07.380056    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea431918-773b-4dc5-b680-eea011dc5f62","Type":"ContainerStarted","Data":"d822b372265e97b40ec7b56a859f696de4e21e7ab4ccfb31a598c57b74d77964"}
Jul 30 10:51:07.410493 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:07.410434    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.390479332 podStartE2EDuration="2.410415071s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.935739ms" isStatefulPod=false podCreationTimestamp="2026-07-30 10:51:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:51:07.408107291 +0000 UTC m=+171.516748821" watchObservedRunningTime="2026-07-30 10:51:07.410415071 +0000 UTC m=+171.519056562"
Jul 30 10:51:10.741321 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:51:10.741276    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:52:05.741063 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:52:05.741008    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:52:05.757303 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:52:05.757276    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:52:06.639376 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:52:06.639350    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 10:53:16.295750 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:53:16.289684    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 10:54:09.543954 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.543864    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp"]
Jul 30 10:54:09.546191 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.546167    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp"
Jul 30 10:54:09.554254 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.549788    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fjl7w\""
Jul 30 10:54:09.554254 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.550064    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 10:54:09.554254 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.550967    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 10:54:09.557060 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.557019    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp"]
Jul 30 10:54:09.620313 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.620275    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/939eccda-b562-4b04-a343-d1dd381cec0a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4rdp\" (UID: \"939eccda-b562-4b04-a343-d1dd381cec0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp"
Jul 30 10:54:09.620497 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.620358    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n2dt\" (UniqueName: \"kubernetes.io/projected/939eccda-b562-4b04-a343-d1dd381cec0a-kube-api-access-9n2dt\") pod \"openshift-lws-operator-fd8ccff4c-h4rdp\" (UID: \"939eccda-b562-4b04-a343-d1dd381cec0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp"
Jul 30 10:54:09.721090 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.721055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/939eccda-b562-4b04-a343-d1dd381cec0a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4rdp\" (UID: \"939eccda-b562-4b04-a343-d1dd381cec0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp"
Jul 30 10:54:09.721328 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.721134    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n2dt\" (UniqueName: \"kubernetes.io/projected/939eccda-b562-4b04-a343-d1dd381cec0a-kube-api-access-9n2dt\") pod \"openshift-lws-operator-fd8ccff4c-h4rdp\" (UID: \"939eccda-b562-4b04-a343-d1dd381cec0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp"
Jul 30 10:54:09.721564 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.721540    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/939eccda-b562-4b04-a343-d1dd381cec0a-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h4rdp\" (UID: \"939eccda-b562-4b04-a343-d1dd381cec0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp"
Jul 30 10:54:09.732241 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.732197    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n2dt\" (UniqueName: \"kubernetes.io/projected/939eccda-b562-4b04-a343-d1dd381cec0a-kube-api-access-9n2dt\") pod \"openshift-lws-operator-fd8ccff4c-h4rdp\" (UID: \"939eccda-b562-4b04-a343-d1dd381cec0a\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp"
Jul 30 10:54:09.860730 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.860627    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp"
Jul 30 10:54:09.994768 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.994733    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp"]
Jul 30 10:54:09.997962 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:54:09.997928    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod939eccda_b562_4b04_a343_d1dd381cec0a.slice/crio-5d351e9df92db378475d375b4362390ea7ab9b6a8ac74c562eead6cfbe445913 WatchSource:0}: Error finding container 5d351e9df92db378475d375b4362390ea7ab9b6a8ac74c562eead6cfbe445913: Status 404 returned error can't find the container with id 5d351e9df92db378475d375b4362390ea7ab9b6a8ac74c562eead6cfbe445913
Jul 30 10:54:09.999534 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:09.999514    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 10:54:10.105000 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:10.104962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp" event={"ID":"939eccda-b562-4b04-a343-d1dd381cec0a","Type":"ContainerStarted","Data":"5d351e9df92db378475d375b4362390ea7ab9b6a8ac74c562eead6cfbe445913"}
Jul 30 10:54:13.121754 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:13.121715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp" event={"ID":"939eccda-b562-4b04-a343-d1dd381cec0a","Type":"ContainerStarted","Data":"6c4aaa75006784afaa243fd095fb8bd074d09ce3f2938b0844537c04503bcb94"}
Jul 30 10:54:13.138055 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:13.138000    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h4rdp" podStartSLOduration=1.502070893 podStartE2EDuration="4.137982954s" totalImagesPullingTime="2.635912061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:54:13.137414001 +0000 UTC m=+357.246055494" watchObservedRunningTime="2026-07-30 10:54:13.137982954 +0000 UTC m=+357.246624447"
Jul 30 10:54:29.151150 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.151115    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"]
Jul 30 10:54:29.155067 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.155037    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.157859 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.157822    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 10:54:29.157859 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.157841    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 10:54:29.158066 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.157913    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 10:54:29.158066 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.157973    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wx6nc\""
Jul 30 10:54:29.158292 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.158277    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 10:54:29.171330 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.171299    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"]
Jul 30 10:54:29.186162 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.186131    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-manifests\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.186339 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.186172    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-tmp\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.186339 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.186193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lb5p\" (UniqueName: \"kubernetes.io/projected/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-kube-api-access-6lb5p\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.186339 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.186318    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.186443 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.186354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.286894 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.286855    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.287076 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.286904    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.287076 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.286932    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-manifests\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.287164 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.287097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-tmp\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.287164 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.287133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lb5p\" (UniqueName: \"kubernetes.io/projected/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-kube-api-access-6lb5p\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.287423 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.287402    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-manifests\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.289402 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.289381    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-tmp\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.289503 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.289490    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.289562 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.289507    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.312587 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.312549    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lb5p\" (UniqueName: \"kubernetes.io/projected/612b3b8d-fafa-4c90-a1c5-aa6eff903ab3-kube-api-access-6lb5p\") pod \"opendatahub-operator-controller-manager-6d97895fdd-657cw\" (UID: \"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3\") " pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.465470 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.465381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:29.613837 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:29.613810    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"]
Jul 30 10:54:29.615942 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:54:29.615912    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612b3b8d_fafa_4c90_a1c5_aa6eff903ab3.slice/crio-233bf57931874e97dcd104e693b4c19fc746e801cf1e08e85b8e328db1989b23 WatchSource:0}: Error finding container 233bf57931874e97dcd104e693b4c19fc746e801cf1e08e85b8e328db1989b23: Status 404 returned error can't find the container with id 233bf57931874e97dcd104e693b4c19fc746e801cf1e08e85b8e328db1989b23
Jul 30 10:54:30.188419 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:30.188382    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw" event={"ID":"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3","Type":"ContainerStarted","Data":"233bf57931874e97dcd104e693b4c19fc746e801cf1e08e85b8e328db1989b23"}
Jul 30 10:54:33.204444 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:33.204406    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw" event={"ID":"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3","Type":"ContainerStarted","Data":"ea46a136381649c720cf25f00471ee3aa25a6220f894dbc0807811f873e1cf66"}
Jul 30 10:54:34.210504 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:34.210397    2583 generic.go:356] "Generic (PLEG): container finished" podID="612b3b8d-fafa-4c90-a1c5-aa6eff903ab3" containerID="ea46a136381649c720cf25f00471ee3aa25a6220f894dbc0807811f873e1cf66" exitCode=0
Jul 30 10:54:34.210504 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:34.210488    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw" event={"ID":"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3","Type":"ContainerDied","Data":"ea46a136381649c720cf25f00471ee3aa25a6220f894dbc0807811f873e1cf66"}
Jul 30 10:54:35.216712 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:35.216675    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw" event={"ID":"612b3b8d-fafa-4c90-a1c5-aa6eff903ab3","Type":"ContainerStarted","Data":"7bb5dac16f8fb16af5f1e01f4c5e561e6db775f2c7cdaf74f081d1085dff3d8a"}
Jul 30 10:54:35.217158 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:35.216807    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:35.242343 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:35.242286    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw" podStartSLOduration=1.678481515 podStartE2EDuration="6.242264473s" totalImagesPullingTime="3.384473448s" totalInitContainerRuntime="1.17930951s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:54:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:54:35.24115132 +0000 UTC m=+379.349792811" watchObservedRunningTime="2026-07-30 10:54:35.242264473 +0000 UTC m=+379.350905966"
Jul 30 10:54:46.223093 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:46.223058    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d97895fdd-657cw"
Jul 30 10:54:48.647034 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.646998    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-866774c595-bkslj"]
Jul 30 10:54:48.689131 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.689089    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-866774c595-bkslj"]
Jul 30 10:54:48.689337 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.689187    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.693069 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.693021    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 10:54:48.693216 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.693094    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 10:54:48.693216 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.693022    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fq5bv\""
Jul 30 10:54:48.693372 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.693364    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 10:54:48.764893 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.764854    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b0280762-6d1a-46f4-a865-50124f4c1dc0-manager-config\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.765130 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.764934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0280762-6d1a-46f4-a865-50124f4c1dc0-cert\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.765130 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.765034    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q5g4\" (UniqueName: \"kubernetes.io/projected/b0280762-6d1a-46f4-a865-50124f4c1dc0-kube-api-access-7q5g4\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.765130 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.765090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0280762-6d1a-46f4-a865-50124f4c1dc0-metrics-cert\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.866451 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.866416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b0280762-6d1a-46f4-a865-50124f4c1dc0-manager-config\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.866654 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.866484    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0280762-6d1a-46f4-a865-50124f4c1dc0-cert\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.866654 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.866527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q5g4\" (UniqueName: \"kubernetes.io/projected/b0280762-6d1a-46f4-a865-50124f4c1dc0-kube-api-access-7q5g4\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.866654 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.866558    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0280762-6d1a-46f4-a865-50124f4c1dc0-metrics-cert\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.867305 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.867276    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b0280762-6d1a-46f4-a865-50124f4c1dc0-manager-config\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.869404 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.869363    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b0280762-6d1a-46f4-a865-50124f4c1dc0-metrics-cert\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.869538 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.869410    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b0280762-6d1a-46f4-a865-50124f4c1dc0-cert\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.879043 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.879007    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q5g4\" (UniqueName: \"kubernetes.io/projected/b0280762-6d1a-46f4-a865-50124f4c1dc0-kube-api-access-7q5g4\") pod \"lws-controller-manager-866774c595-bkslj\" (UID: \"b0280762-6d1a-46f4-a865-50124f4c1dc0\") " pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:48.999401 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:48.999372    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:49.151327 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.151287    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-866774c595-bkslj"]
Jul 30 10:54:49.155419 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:54:49.155385    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0280762_6d1a_46f4_a865_50124f4c1dc0.slice/crio-41af0bb56c33374a3733e742f2b8c3ce1584b879b59414af6ed1c5e1efaead81 WatchSource:0}: Error finding container 41af0bb56c33374a3733e742f2b8c3ce1584b879b59414af6ed1c5e1efaead81: Status 404 returned error can't find the container with id 41af0bb56c33374a3733e742f2b8c3ce1584b879b59414af6ed1c5e1efaead81
Jul 30 10:54:49.277933 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.277847    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj" event={"ID":"b0280762-6d1a-46f4-a865-50124f4c1dc0","Type":"ContainerStarted","Data":"41af0bb56c33374a3733e742f2b8c3ce1584b879b59414af6ed1c5e1efaead81"}
Jul 30 10:54:49.661850 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.661810    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9l5nx"]
Jul 30 10:54:49.666049 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.665993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx"
Jul 30 10:54:49.668522 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.668497    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 30 10:54:49.680529 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.680497    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9l5nx"]
Jul 30 10:54:49.774619 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.774517    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc8wj\" (UniqueName: \"kubernetes.io/projected/e764c1f5-8158-4533-8705-cd386ae6810c-kube-api-access-rc8wj\") pod \"model-serving-api-54d89bd5fc-9l5nx\" (UID: \"e764c1f5-8158-4533-8705-cd386ae6810c\") " pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx"
Jul 30 10:54:49.774619 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.774574    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e764c1f5-8158-4533-8705-cd386ae6810c-tls-certs\") pod \"model-serving-api-54d89bd5fc-9l5nx\" (UID: \"e764c1f5-8158-4533-8705-cd386ae6810c\") " pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx"
Jul 30 10:54:49.875866 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.875821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc8wj\" (UniqueName: \"kubernetes.io/projected/e764c1f5-8158-4533-8705-cd386ae6810c-kube-api-access-rc8wj\") pod \"model-serving-api-54d89bd5fc-9l5nx\" (UID: \"e764c1f5-8158-4533-8705-cd386ae6810c\") " pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx"
Jul 30 10:54:49.876034 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.875877    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e764c1f5-8158-4533-8705-cd386ae6810c-tls-certs\") pod \"model-serving-api-54d89bd5fc-9l5nx\" (UID: \"e764c1f5-8158-4533-8705-cd386ae6810c\") " pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx"
Jul 30 10:54:49.878652 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.878620    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e764c1f5-8158-4533-8705-cd386ae6810c-tls-certs\") pod \"model-serving-api-54d89bd5fc-9l5nx\" (UID: \"e764c1f5-8158-4533-8705-cd386ae6810c\") " pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx"
Jul 30 10:54:49.883805 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.883783    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc8wj\" (UniqueName: \"kubernetes.io/projected/e764c1f5-8158-4533-8705-cd386ae6810c-kube-api-access-rc8wj\") pod \"model-serving-api-54d89bd5fc-9l5nx\" (UID: \"e764c1f5-8158-4533-8705-cd386ae6810c\") " pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx"
Jul 30 10:54:49.980319 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:49.980141    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx"
Jul 30 10:54:50.142065 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:50.141967    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9l5nx"]
Jul 30 10:54:50.144200 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:54:50.144168    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode764c1f5_8158_4533_8705_cd386ae6810c.slice/crio-43a6dce9ced839e31f2245105a3c2122e1aa3889fbfdd82fba385228e273d956 WatchSource:0}: Error finding container 43a6dce9ced839e31f2245105a3c2122e1aa3889fbfdd82fba385228e273d956: Status 404 returned error can't find the container with id 43a6dce9ced839e31f2245105a3c2122e1aa3889fbfdd82fba385228e273d956
Jul 30 10:54:50.286018 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:50.285926    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx" event={"ID":"e764c1f5-8158-4533-8705-cd386ae6810c","Type":"ContainerStarted","Data":"43a6dce9ced839e31f2245105a3c2122e1aa3889fbfdd82fba385228e273d956"}
Jul 30 10:54:51.293579 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:51.293535    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj" event={"ID":"b0280762-6d1a-46f4-a865-50124f4c1dc0","Type":"ContainerStarted","Data":"2f1e31e364a30e02ea8009868f763c8fca47579476528e5225175c43ba9f4395"}
Jul 30 10:54:51.294053 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:51.293679    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:54:51.312893 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:51.312837    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj" podStartSLOduration=1.9278027629999999 podStartE2EDuration="3.312818292s" totalImagesPullingTime="1.385015529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:54:51.311532379 +0000 UTC m=+395.420173895" watchObservedRunningTime="2026-07-30 10:54:51.312818292 +0000 UTC m=+395.421459763"
Jul 30 10:54:52.300195 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:52.300159    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx" event={"ID":"e764c1f5-8158-4533-8705-cd386ae6810c","Type":"ContainerStarted","Data":"b71b93c9c96324df53a4965737111d6564bd61ce15554083b0f985880e86d16b"}
Jul 30 10:54:52.328810 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:52.328740    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx" podStartSLOduration=1.724624207 podStartE2EDuration="3.328718469s" totalImagesPullingTime="1.604094262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:54:52.328648991 +0000 UTC m=+396.437290482" watchObservedRunningTime="2026-07-30 10:54:52.328718469 +0000 UTC m=+396.437359963"
Jul 30 10:54:53.305390 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:53.305351    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx"
Jul 30 10:54:56.994476 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:56.994443    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"]
Jul 30 10:54:56.996913 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:56.996891    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.000077 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.000049    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 10:54:57.000208 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.000096    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-m5ngc\""
Jul 30 10:54:57.000328 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.000305    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 10:54:57.001088 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.001067    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 10:54:57.013315 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.013288    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"]
Jul 30 10:54:57.139664 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.139623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.139664 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.139664    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.139890 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.139755    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.139890 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.139793    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.139890 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.139833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.139890 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.139857    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.139890 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.139872    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7e77547-70b2-4c29-aca2-fe14eab247c6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.140113 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.139956    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.140113 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.139987    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgmtg\" (UniqueName: \"kubernetes.io/projected/f7e77547-70b2-4c29-aca2-fe14eab247c6-kube-api-access-bgmtg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241257 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241257 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgmtg\" (UniqueName: \"kubernetes.io/projected/f7e77547-70b2-4c29-aca2-fe14eab247c6-kube-api-access-bgmtg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241257 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241269    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241561 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241285    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241561 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241337    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241561 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241561 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241414    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241561 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241445    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241561 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7e77547-70b2-4c29-aca2-fe14eab247c6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241862 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241727    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241862 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241774    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.241862 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.241796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.242096 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.242078    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.242180 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.242158    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7e77547-70b2-4c29-aca2-fe14eab247c6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.244075 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.244035    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.244321 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.244299    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.257991 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.257916    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7e77547-70b2-4c29-aca2-fe14eab247c6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.257991 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.257930    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgmtg\" (UniqueName: \"kubernetes.io/projected/f7e77547-70b2-4c29-aca2-fe14eab247c6-kube-api-access-bgmtg\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29\" (UID: \"f7e77547-70b2-4c29-aca2-fe14eab247c6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.310710 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.310668    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:54:57.466567 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:57.466481    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"]
Jul 30 10:54:57.470905 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:54:57.470882    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e77547_70b2_4c29_aca2_fe14eab247c6.slice/crio-7d6380e2541b74833a0af4a3aa6404172bed6d3bb48d155439499070b4ce0186 WatchSource:0}: Error finding container 7d6380e2541b74833a0af4a3aa6404172bed6d3bb48d155439499070b4ce0186: Status 404 returned error can't find the container with id 7d6380e2541b74833a0af4a3aa6404172bed6d3bb48d155439499070b4ce0186
Jul 30 10:54:58.331698 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:58.331662    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29" event={"ID":"f7e77547-70b2-4c29-aca2-fe14eab247c6","Type":"ContainerStarted","Data":"7d6380e2541b74833a0af4a3aa6404172bed6d3bb48d155439499070b4ce0186"}
Jul 30 10:54:59.284126 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.284058    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"]
Jul 30 10:54:59.287147 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.287121    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"]
Jul 30 10:54:59.287329 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.287286    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"
Jul 30 10:54:59.289289 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.289266    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"
Jul 30 10:54:59.291053 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.291028    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 30 10:54:59.291172 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.291030    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ld8n7\""
Jul 30 10:54:59.292243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.292192    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 30 10:54:59.292439 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.292410    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-cg9t9\""
Jul 30 10:54:59.303829 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.303793    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"]
Jul 30 10:54:59.305446 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.305420    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"]
Jul 30 10:54:59.464259 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.464203    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c0fca6d-62b0-4089-9374-e65ad1ea13c6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x72cz\" (UID: \"5c0fca6d-62b0-4089-9374-e65ad1ea13c6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"
Jul 30 10:54:59.464663 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.464288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/340d6680-41a0-4273-aba8-73539fac9844-cert\") pod \"kserve-controller-manager-d6f4b65b8-6vmv6\" (UID: \"340d6680-41a0-4273-aba8-73539fac9844\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"
Jul 30 10:54:59.464663 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.464377    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xstdk\" (UniqueName: \"kubernetes.io/projected/5c0fca6d-62b0-4089-9374-e65ad1ea13c6-kube-api-access-xstdk\") pod \"llmisvc-controller-manager-777c6bd7d5-x72cz\" (UID: \"5c0fca6d-62b0-4089-9374-e65ad1ea13c6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"
Jul 30 10:54:59.464663 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.464462    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlt2z\" (UniqueName: \"kubernetes.io/projected/340d6680-41a0-4273-aba8-73539fac9844-kube-api-access-xlt2z\") pod \"kserve-controller-manager-d6f4b65b8-6vmv6\" (UID: \"340d6680-41a0-4273-aba8-73539fac9844\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"
Jul 30 10:54:59.565707 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.565617    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlt2z\" (UniqueName: \"kubernetes.io/projected/340d6680-41a0-4273-aba8-73539fac9844-kube-api-access-xlt2z\") pod \"kserve-controller-manager-d6f4b65b8-6vmv6\" (UID: \"340d6680-41a0-4273-aba8-73539fac9844\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"
Jul 30 10:54:59.565877 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.565738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c0fca6d-62b0-4089-9374-e65ad1ea13c6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x72cz\" (UID: \"5c0fca6d-62b0-4089-9374-e65ad1ea13c6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"
Jul 30 10:54:59.565877 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.565770    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/340d6680-41a0-4273-aba8-73539fac9844-cert\") pod \"kserve-controller-manager-d6f4b65b8-6vmv6\" (UID: \"340d6680-41a0-4273-aba8-73539fac9844\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"
Jul 30 10:54:59.565877 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.565849    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xstdk\" (UniqueName: \"kubernetes.io/projected/5c0fca6d-62b0-4089-9374-e65ad1ea13c6-kube-api-access-xstdk\") pod \"llmisvc-controller-manager-777c6bd7d5-x72cz\" (UID: \"5c0fca6d-62b0-4089-9374-e65ad1ea13c6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"
Jul 30 10:54:59.568517 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.568491    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/340d6680-41a0-4273-aba8-73539fac9844-cert\") pod \"kserve-controller-manager-d6f4b65b8-6vmv6\" (UID: \"340d6680-41a0-4273-aba8-73539fac9844\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"
Jul 30 10:54:59.568776 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.568755    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c0fca6d-62b0-4089-9374-e65ad1ea13c6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x72cz\" (UID: \"5c0fca6d-62b0-4089-9374-e65ad1ea13c6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"
Jul 30 10:54:59.581740 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.581710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xstdk\" (UniqueName: \"kubernetes.io/projected/5c0fca6d-62b0-4089-9374-e65ad1ea13c6-kube-api-access-xstdk\") pod \"llmisvc-controller-manager-777c6bd7d5-x72cz\" (UID: \"5c0fca6d-62b0-4089-9374-e65ad1ea13c6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"
Jul 30 10:54:59.581880 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.581759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlt2z\" (UniqueName: \"kubernetes.io/projected/340d6680-41a0-4273-aba8-73539fac9844-kube-api-access-xlt2z\") pod \"kserve-controller-manager-d6f4b65b8-6vmv6\" (UID: \"340d6680-41a0-4273-aba8-73539fac9844\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"
Jul 30 10:54:59.604609 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.604572    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"
Jul 30 10:54:59.612056 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:54:59.612028    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"
Jul 30 10:55:00.565011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:00.564120    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 10:55:00.565011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:00.564219    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 10:55:00.565011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:00.564281    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 10:55:00.667744 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:00.667715    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"]
Jul 30 10:55:00.670463 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:55:00.670432    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340d6680_41a0_4273_aba8_73539fac9844.slice/crio-ecc29e7bf8734c0e7c73e9d90cf7c4c29bdc8b75f9259f2d67cabbad79139608 WatchSource:0}: Error finding container ecc29e7bf8734c0e7c73e9d90cf7c4c29bdc8b75f9259f2d67cabbad79139608: Status 404 returned error can't find the container with id ecc29e7bf8734c0e7c73e9d90cf7c4c29bdc8b75f9259f2d67cabbad79139608
Jul 30 10:55:00.680257 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:00.680207    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"]
Jul 30 10:55:00.682556 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:55:00.682504    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5c0fca6d_62b0_4089_9374_e65ad1ea13c6.slice/crio-958236fda0e35c147a4e7521852efffe87855774e9ea56866de46ce2c6239a58 WatchSource:0}: Error finding container 958236fda0e35c147a4e7521852efffe87855774e9ea56866de46ce2c6239a58: Status 404 returned error can't find the container with id 958236fda0e35c147a4e7521852efffe87855774e9ea56866de46ce2c6239a58
Jul 30 10:55:01.348986 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:01.348941    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz" event={"ID":"5c0fca6d-62b0-4089-9374-e65ad1ea13c6","Type":"ContainerStarted","Data":"958236fda0e35c147a4e7521852efffe87855774e9ea56866de46ce2c6239a58"}
Jul 30 10:55:01.350793 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:01.350754    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29" event={"ID":"f7e77547-70b2-4c29-aca2-fe14eab247c6","Type":"ContainerStarted","Data":"9dce96ba11482b3e1301415b6dbc40381a1c2a5e99b040f4e1fb3652964c506a"}
Jul 30 10:55:01.352081 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:01.352049    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6" event={"ID":"340d6680-41a0-4273-aba8-73539fac9844","Type":"ContainerStarted","Data":"ecc29e7bf8734c0e7c73e9d90cf7c4c29bdc8b75f9259f2d67cabbad79139608"}
Jul 30 10:55:01.378393 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:01.378341    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29" podStartSLOduration=2.287472646 podStartE2EDuration="5.378325258s" totalImagesPullingTime="3.090852612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:55:01.377287674 +0000 UTC m=+405.485929198" watchObservedRunningTime="2026-07-30 10:55:01.378325258 +0000 UTC m=+405.486966785"
Jul 30 10:55:02.303602 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:02.303567    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-866774c595-bkslj"
Jul 30 10:55:02.311657 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:02.311570    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:55:02.318443 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:02.318410    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:55:02.361838 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:02.361763    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:55:02.363459 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:02.363431    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29"
Jul 30 10:55:04.315760 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:04.315732    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-9l5nx"
Jul 30 10:55:05.377311 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:05.377269    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz" event={"ID":"5c0fca6d-62b0-4089-9374-e65ad1ea13c6","Type":"ContainerStarted","Data":"4e032abd7c2813fbb66c2f5c59a1a80662792e21436066cbabc369b194546a98"}
Jul 30 10:55:05.377754 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:05.377340    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"
Jul 30 10:55:05.378825 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:05.378799    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6" event={"ID":"340d6680-41a0-4273-aba8-73539fac9844","Type":"ContainerStarted","Data":"72a146708bb36a327a70f613c19bd4e3eb2661b5b6984d35993418c7c06097aa"}
Jul 30 10:55:05.378959 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:05.378848    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"
Jul 30 10:55:05.396595 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:05.396537    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz" podStartSLOduration=2.640593979 podStartE2EDuration="6.396519624s" totalImagesPullingTime="3.755925645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:55:05.395684595 +0000 UTC m=+409.504326088" watchObservedRunningTime="2026-07-30 10:55:05.396519624 +0000 UTC m=+409.505161173"
Jul 30 10:55:05.414890 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:05.414829    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6" podStartSLOduration=2.65312051 podStartE2EDuration="6.414809765s" totalImagesPullingTime="3.761689255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:55:05.412724927 +0000 UTC m=+409.521366419" watchObservedRunningTime="2026-07-30 10:55:05.414809765 +0000 UTC m=+409.523451301"
Jul 30 10:55:36.392884 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:36.392854    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x72cz"
Jul 30 10:55:36.395720 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:55:36.395697    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6vmv6"
Jul 30 10:56:13.316388 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.316347    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-659c679879-w8d2q"]
Jul 30 10:56:13.320032 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.320002    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.322861 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.322828    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 10:56:13.323013 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.322906    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 10:56:13.324060 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.324040    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 10:56:13.324243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.324041    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 10:56:13.324243 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.324040    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 10:56:13.324427 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.324409    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-drg7x\""
Jul 30 10:56:13.328916 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.328892    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 30 10:56:13.332445 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.332417    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659c679879-w8d2q"]
Jul 30 10:56:13.447216 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.447154    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-trusted-ca-bundle\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.447216 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.447248    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-console-config\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.447534 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.447341    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68240aee-d0a7-4d31-838f-0344a350d086-console-oauth-config\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.447534 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.447398    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-service-ca\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.447534 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.447426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqh5p\" (UniqueName: \"kubernetes.io/projected/68240aee-d0a7-4d31-838f-0344a350d086-kube-api-access-cqh5p\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.447534 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.447485    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68240aee-d0a7-4d31-838f-0344a350d086-console-serving-cert\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.447694 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.447537    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-oauth-serving-cert\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.548946 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.548904    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-trusted-ca-bundle\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.549130 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.548969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-console-config\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.549130 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.549015    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68240aee-d0a7-4d31-838f-0344a350d086-console-oauth-config\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.549130 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.549051    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-service-ca\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.549130 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.549077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqh5p\" (UniqueName: \"kubernetes.io/projected/68240aee-d0a7-4d31-838f-0344a350d086-kube-api-access-cqh5p\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.549394 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.549144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68240aee-d0a7-4d31-838f-0344a350d086-console-serving-cert\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.549394 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.549190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-oauth-serving-cert\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.549852 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.549827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-console-config\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.550017 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.549991    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-trusted-ca-bundle\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.550017 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.549929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-service-ca\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.550017 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.549953    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68240aee-d0a7-4d31-838f-0344a350d086-oauth-serving-cert\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.551605 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.551584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68240aee-d0a7-4d31-838f-0344a350d086-console-oauth-config\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.551794 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.551775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68240aee-d0a7-4d31-838f-0344a350d086-console-serving-cert\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.560123 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.560088    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqh5p\" (UniqueName: \"kubernetes.io/projected/68240aee-d0a7-4d31-838f-0344a350d086-kube-api-access-cqh5p\") pod \"console-659c679879-w8d2q\" (UID: \"68240aee-d0a7-4d31-838f-0344a350d086\") " pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.631209 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.631107    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:13.774527 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:13.774497    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-659c679879-w8d2q"]
Jul 30 10:56:13.776847 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:56:13.776816    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68240aee_d0a7_4d31_838f_0344a350d086.slice/crio-bb7526ba1d2f1ee65efdf03d2c4900ee4363ad682fcea2c7ec97fd8b89ac3510 WatchSource:0}: Error finding container bb7526ba1d2f1ee65efdf03d2c4900ee4363ad682fcea2c7ec97fd8b89ac3510: Status 404 returned error can't find the container with id bb7526ba1d2f1ee65efdf03d2c4900ee4363ad682fcea2c7ec97fd8b89ac3510
Jul 30 10:56:14.707925 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:14.707884    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659c679879-w8d2q" event={"ID":"68240aee-d0a7-4d31-838f-0344a350d086","Type":"ContainerStarted","Data":"eb6ecb19c4e3e049aa62c5ec9032a83237a07ed733dab81c5874272c58c018b9"}
Jul 30 10:56:14.708331 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:14.707938    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-659c679879-w8d2q" event={"ID":"68240aee-d0a7-4d31-838f-0344a350d086","Type":"ContainerStarted","Data":"bb7526ba1d2f1ee65efdf03d2c4900ee4363ad682fcea2c7ec97fd8b89ac3510"}
Jul 30 10:56:14.730828 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:14.730759    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-659c679879-w8d2q" podStartSLOduration=1.730736456 podStartE2EDuration="1.730736456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:56:14.727684509 +0000 UTC m=+478.836325993" watchObservedRunningTime="2026-07-30 10:56:14.730736456 +0000 UTC m=+478.839377951"
Jul 30 10:56:19.846887 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:19.846851    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-jlgws"]
Jul 30 10:56:19.850637 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:19.850606    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-jlgws"
Jul 30 10:56:19.853747 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:19.853726    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 10:56:19.854525 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:19.854497    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wq28x\""
Jul 30 10:56:19.854633 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:19.854524    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 10:56:19.864844 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:19.864816    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-jlgws"]
Jul 30 10:56:20.007897 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:20.007866    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59k8x\" (UniqueName: \"kubernetes.io/projected/806e53c8-ed09-4ba9-9c45-9f1caff7fa50-kube-api-access-59k8x\") pod \"authorino-operator-68d88948d8-jlgws\" (UID: \"806e53c8-ed09-4ba9-9c45-9f1caff7fa50\") " pod="kuadrant-system/authorino-operator-68d88948d8-jlgws"
Jul 30 10:56:20.108743 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:20.108645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59k8x\" (UniqueName: \"kubernetes.io/projected/806e53c8-ed09-4ba9-9c45-9f1caff7fa50-kube-api-access-59k8x\") pod \"authorino-operator-68d88948d8-jlgws\" (UID: \"806e53c8-ed09-4ba9-9c45-9f1caff7fa50\") " pod="kuadrant-system/authorino-operator-68d88948d8-jlgws"
Jul 30 10:56:20.121055 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:20.121027    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59k8x\" (UniqueName: \"kubernetes.io/projected/806e53c8-ed09-4ba9-9c45-9f1caff7fa50-kube-api-access-59k8x\") pod \"authorino-operator-68d88948d8-jlgws\" (UID: \"806e53c8-ed09-4ba9-9c45-9f1caff7fa50\") " pod="kuadrant-system/authorino-operator-68d88948d8-jlgws"
Jul 30 10:56:20.160919 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:20.160882    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-jlgws"
Jul 30 10:56:20.313582 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:20.313553    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-jlgws"]
Jul 30 10:56:20.316118 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:56:20.316088    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806e53c8_ed09_4ba9_9c45_9f1caff7fa50.slice/crio-be95699edefe7603ba0e6d04575facde713694bd5d9476254c7bdbf81491ca44 WatchSource:0}: Error finding container be95699edefe7603ba0e6d04575facde713694bd5d9476254c7bdbf81491ca44: Status 404 returned error can't find the container with id be95699edefe7603ba0e6d04575facde713694bd5d9476254c7bdbf81491ca44
Jul 30 10:56:20.742818 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:20.742733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-jlgws" event={"ID":"806e53c8-ed09-4ba9-9c45-9f1caff7fa50","Type":"ContainerStarted","Data":"be95699edefe7603ba0e6d04575facde713694bd5d9476254c7bdbf81491ca44"}
Jul 30 10:56:23.631786 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:23.631750    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:23.632184 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:23.631833    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:23.636666 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:23.636641    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:23.760696 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:23.760659    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-jlgws" event={"ID":"806e53c8-ed09-4ba9-9c45-9f1caff7fa50","Type":"ContainerStarted","Data":"d87a0180fc2164d3989b7d0bcc99a637fd71b51310bf2f2491b2aadc5417ef42"}
Jul 30 10:56:23.760872 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:23.760855    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-jlgws"
Jul 30 10:56:23.764745 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:23.764721    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-659c679879-w8d2q"
Jul 30 10:56:23.782411 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:23.782359    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-jlgws" podStartSLOduration=2.31505224 podStartE2EDuration="4.782341495s" totalImagesPullingTime="2.467289255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:56:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:56:23.780691339 +0000 UTC m=+487.889332832" watchObservedRunningTime="2026-07-30 10:56:23.782341495 +0000 UTC m=+487.890982986"
Jul 30 10:56:34.768134 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:56:34.768103    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-jlgws"
Jul 30 10:57:02.429560 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.429520    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"]
Jul 30 10:57:02.437655 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.437618    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.442111 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.442084    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qgtd6\""
Jul 30 10:57:02.465649 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.465613    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"]
Jul 30 10:57:02.591138 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.591094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znx48\" (UniqueName: \"kubernetes.io/projected/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-kube-api-access-znx48\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.591138 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.591142    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.591419 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.591271    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.591419 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.591317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.591419 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.591335    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.591419 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.591370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.591419 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.591409    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.591648 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.591430    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.591648 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.591614    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.692687 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.692588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.692687 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.692632    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.692687 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.692652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.692983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.692801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.692983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.692848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.692983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.692875    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.692983 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.692941    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.693180 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.693003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znx48\" (UniqueName: \"kubernetes.io/projected/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-kube-api-access-znx48\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.693180 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.693055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.693180 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.693060    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.693350 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.693264    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.693350 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.693334    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.693454 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.693399    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.693454 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.693431    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.695117 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.695092    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.695577 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.695559    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.702376 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.702345    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.702557 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.702521    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znx48\" (UniqueName: \"kubernetes.io/projected/8a91e970-67b0-4e0d-bdb8-e6813048c9d2-kube-api-access-znx48\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ldfs4\" (UID: \"8a91e970-67b0-4e0d-bdb8-e6813048c9d2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.749788 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.749741    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:02.900960 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.900921    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"]
Jul 30 10:57:02.904751 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:57:02.904721    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a91e970_67b0_4e0d_bdb8_e6813048c9d2.slice/crio-1c4fe75e8e000ac9e1b80a642528eb381e9bdbea417e0e2a77238e47bf451477 WatchSource:0}: Error finding container 1c4fe75e8e000ac9e1b80a642528eb381e9bdbea417e0e2a77238e47bf451477: Status 404 returned error can't find the container with id 1c4fe75e8e000ac9e1b80a642528eb381e9bdbea417e0e2a77238e47bf451477
Jul 30 10:57:02.907058 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.907019    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 10:57:02.907125 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.907113    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 10:57:02.907174 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.907154    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 10:57:02.963145 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:02.963105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4" event={"ID":"8a91e970-67b0-4e0d-bdb8-e6813048c9d2","Type":"ContainerStarted","Data":"1c4fe75e8e000ac9e1b80a642528eb381e9bdbea417e0e2a77238e47bf451477"}
Jul 30 10:57:03.969479 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:03.969439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4" event={"ID":"8a91e970-67b0-4e0d-bdb8-e6813048c9d2","Type":"ContainerStarted","Data":"f89e5f52d5ab70f7bfa991402cd3e05a743d2936850ff48f5a4aa9dd3f3cbe05"}
Jul 30 10:57:03.993031 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:03.992964    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4" podStartSLOduration=1.992945206 podStartE2EDuration="1.992945206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:57:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:57:03.991125594 +0000 UTC m=+528.099767089" watchObservedRunningTime="2026-07-30 10:57:03.992945206 +0000 UTC m=+528.101586697"
Jul 30 10:57:04.750079 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:04.750037    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:04.755085 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:04.755049    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:04.974728 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:04.974682    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:57:04.975840 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:57:04.975823    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:58:28.388543 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:28.388507    2583 generic.go:356] "Generic (PLEG): container finished" podID="8a91e970-67b0-4e0d-bdb8-e6813048c9d2" containerID="f89e5f52d5ab70f7bfa991402cd3e05a743d2936850ff48f5a4aa9dd3f3cbe05" exitCode=0
Jul 30 10:58:28.389040 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:28.388589    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4" event={"ID":"8a91e970-67b0-4e0d-bdb8-e6813048c9d2","Type":"ContainerDied","Data":"f89e5f52d5ab70f7bfa991402cd3e05a743d2936850ff48f5a4aa9dd3f3cbe05"}
Jul 30 10:58:28.389040 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:28.388987    2583 scope.go:117] "RemoveContainer" containerID="f89e5f52d5ab70f7bfa991402cd3e05a743d2936850ff48f5a4aa9dd3f3cbe05"
Jul 30 10:58:28.389996 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:28.389968    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 10:58:28.390088 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:28.390034    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 10:58:28.390088 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:28.390065    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 10:58:29.395907 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:29.395868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4" event={"ID":"8a91e970-67b0-4e0d-bdb8-e6813048c9d2","Type":"ContainerStarted","Data":"cba2730e38cd1c05f6e02db03200e484aa27f7d0d62fe3240b921932155b0e55"}
Jul 30 10:58:29.750129 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:29.750085    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:58:29.750442 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:29.750402    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ldfs4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 30 10:58:29.750678 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:29.750642    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4" podUID="8a91e970-67b0-4e0d-bdb8-e6813048c9d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 30 10:58:30.750214 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:30.750176    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ldfs4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 30 10:58:30.750711 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:30.750352    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4" podUID="8a91e970-67b0-4e0d-bdb8-e6813048c9d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 30 10:58:31.753205 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:31.752668    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ldfs4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 30 10:58:31.753205 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:31.752749    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4" podUID="8a91e970-67b0-4e0d-bdb8-e6813048c9d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 30 10:58:32.751191 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:32.751148    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ldfs4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 30 10:58:32.751387 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:32.751247    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4" podUID="8a91e970-67b0-4e0d-bdb8-e6813048c9d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 30 10:58:33.751252 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:33.750895    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ldfs4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 30 10:58:33.751252 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:33.750967    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4" podUID="8a91e970-67b0-4e0d-bdb8-e6813048c9d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 30 10:58:34.754788 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:34.754756    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:58:34.755255 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:34.755043    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:58:34.755976 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:34.755952    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ldfs4"
Jul 30 10:58:37.677027 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.676934    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"]
Jul 30 10:58:37.679423 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.679396    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.682474 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.682444    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 10:58:37.682474 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.682448    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 10:58:37.683401 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.683381    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f52tt\""
Jul 30 10:58:37.683508 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.683420    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 30 10:58:37.691751 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.691717    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"]
Jul 30 10:58:37.813115 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.813060    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.813345 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.813145    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5af70a49-cdcf-46c9-a3de-741429b0a3aa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.813345 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.813199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.813345 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.813267    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhntz\" (UniqueName: \"kubernetes.io/projected/5af70a49-cdcf-46c9-a3de-741429b0a3aa-kube-api-access-zhntz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.813345 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.813324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.813490 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.813372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.920644 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.920603    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.920834 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.920732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5af70a49-cdcf-46c9-a3de-741429b0a3aa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.920834 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.920778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.920834 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.920797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhntz\" (UniqueName: \"kubernetes.io/projected/5af70a49-cdcf-46c9-a3de-741429b0a3aa-kube-api-access-zhntz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.921007 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.920852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.921007 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.920859    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.921007 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.920923    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.921161 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.921125    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.921217 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.921179    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.923104 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.923080    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5af70a49-cdcf-46c9-a3de-741429b0a3aa-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.923429 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.923409    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5af70a49-cdcf-46c9-a3de-741429b0a3aa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.929481 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.929415    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhntz\" (UniqueName: \"kubernetes.io/projected/5af70a49-cdcf-46c9-a3de-741429b0a3aa-kube-api-access-zhntz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw\" (UID: \"5af70a49-cdcf-46c9-a3de-741429b0a3aa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:37.990780 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:37.990744    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:38.130521 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:38.130329    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"]
Jul 30 10:58:38.133502 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:58:38.133473    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af70a49_cdcf_46c9_a3de_741429b0a3aa.slice/crio-74b8f02140b4afc82134e76eb5c364fe34916d6ad5ce5a19508a0e52fca6708c WatchSource:0}: Error finding container 74b8f02140b4afc82134e76eb5c364fe34916d6ad5ce5a19508a0e52fca6708c: Status 404 returned error can't find the container with id 74b8f02140b4afc82134e76eb5c364fe34916d6ad5ce5a19508a0e52fca6708c
Jul 30 10:58:38.438844 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:38.438805    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw" event={"ID":"5af70a49-cdcf-46c9-a3de-741429b0a3aa","Type":"ContainerStarted","Data":"74b8f02140b4afc82134e76eb5c364fe34916d6ad5ce5a19508a0e52fca6708c"}
Jul 30 10:58:39.445239 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:39.445192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw" event={"ID":"5af70a49-cdcf-46c9-a3de-741429b0a3aa","Type":"ContainerStarted","Data":"b7457ac7e0d4d1a52387d5f9a28ddaca2b2b6490612d94a33a83187bb80de98b"}
Jul 30 10:58:39.465780 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:39.465722    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw" podStartSLOduration=1.48880283 podStartE2EDuration="2.465704165s" totalImagesPullingTime="976.901335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:58:39.464088671 +0000 UTC m=+623.572730164" watchObservedRunningTime="2026-07-30 10:58:39.465704165 +0000 UTC m=+623.574345657"
Jul 30 10:58:47.991219 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:47.991178    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:47.991649 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:47.991274    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:48.004011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:48.003977    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:58:48.500840 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:58:48.500812    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw"
Jul 30 10:59:21.586816 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.586781    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"]
Jul 30 10:59:21.591347 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.591321    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.594053 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.594028    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 30 10:59:21.603134 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.603099    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"]
Jul 30 10:59:21.733687 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.733643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.733878 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.733721    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.733878 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.733834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpfpn\" (UniqueName: \"kubernetes.io/projected/d8653e17-dcdd-4a42-9584-15dc20578c49-kube-api-access-kpfpn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.733999 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.733888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8653e17-dcdd-4a42-9584-15dc20578c49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.733999 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.733958    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.734097 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.734001    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.835183 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.835138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.835183 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.835189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.835426 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.835351    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.835426 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.835417    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.835510 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.835495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpfpn\" (UniqueName: \"kubernetes.io/projected/d8653e17-dcdd-4a42-9584-15dc20578c49-kube-api-access-kpfpn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.835553 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.835527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8653e17-dcdd-4a42-9584-15dc20578c49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.835853 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.835825    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.835853 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.835841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.836062 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.836018    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.837995 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.837930    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8653e17-dcdd-4a42-9584-15dc20578c49-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.838522 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.838500    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8653e17-dcdd-4a42-9584-15dc20578c49-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.845827 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.845796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpfpn\" (UniqueName: \"kubernetes.io/projected/d8653e17-dcdd-4a42-9584-15dc20578c49-kube-api-access-kpfpn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-g4xlf\" (UID: \"d8653e17-dcdd-4a42-9584-15dc20578c49\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:21.904774 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:21.904713    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:22.050769 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:22.050739    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"]
Jul 30 10:59:22.053890 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:59:22.053861    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8653e17_dcdd_4a42_9584_15dc20578c49.slice/crio-f57dc1c00164689e74a8f817c79af062083ad2ef3cf2d6aba576f49df41204c7 WatchSource:0}: Error finding container f57dc1c00164689e74a8f817c79af062083ad2ef3cf2d6aba576f49df41204c7: Status 404 returned error can't find the container with id f57dc1c00164689e74a8f817c79af062083ad2ef3cf2d6aba576f49df41204c7
Jul 30 10:59:22.055671 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:22.055652    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 10:59:22.652888 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:22.652849    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf" event={"ID":"d8653e17-dcdd-4a42-9584-15dc20578c49","Type":"ContainerStarted","Data":"a829fceecdcf4de41330fc15a64f009e70216ab565edb52c982823ab0eda59b3"}
Jul 30 10:59:22.653293 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:22.652913    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf" event={"ID":"d8653e17-dcdd-4a42-9584-15dc20578c49","Type":"ContainerStarted","Data":"f57dc1c00164689e74a8f817c79af062083ad2ef3cf2d6aba576f49df41204c7"}
Jul 30 10:59:22.677652 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:22.677598    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf" podStartSLOduration=1.420313014 podStartE2EDuration="1.677581316s" totalImagesPullingTime="257.268302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:59:22.677150723 +0000 UTC m=+666.785792216" watchObservedRunningTime="2026-07-30 10:59:22.677581316 +0000 UTC m=+666.786222808"
Jul 30 10:59:31.905040 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:31.904985    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:31.905548 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:31.905064    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:31.917792 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:31.917762    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:32.711353 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:32.711320    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-g4xlf"
Jul 30 10:59:47.083014 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.082967    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"]
Jul 30 10:59:47.086495 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.086471    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.089742 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.089710    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 30 10:59:47.100171 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.100143    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"]
Jul 30 10:59:47.173126 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.173081    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.173337 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.173182    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.173337 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.173215    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msmnl\" (UniqueName: \"kubernetes.io/projected/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-kube-api-access-msmnl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.173337 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.173294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.173448 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.173336    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.173448 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.173365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.274366 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.274320    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.274366 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.274374    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msmnl\" (UniqueName: \"kubernetes.io/projected/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-kube-api-access-msmnl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.274685 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.274512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.274685 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.274557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.274685 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.274597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.274685 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.274626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.274848 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.274806    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.275077 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.275052    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.275241 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.275152    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.277169 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.277138    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.277328 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.277313    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.282902 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.282877    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msmnl\" (UniqueName: \"kubernetes.io/projected/00bc8882-bcb7-4797-beb0-9c4e8c75b4e9-kube-api-access-msmnl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-2lgbp\" (UID: \"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.402118 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.402079    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:47.551704 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.551680    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"]
Jul 30 10:59:47.553988 ip-10-0-134-172 kubenswrapper[2583]: W0730 10:59:47.553954    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00bc8882_bcb7_4797_beb0_9c4e8c75b4e9.slice/crio-d41b89a279cd0e1656c63bf8de7be4247a533f58ba2d8374e99f4c117a966436 WatchSource:0}: Error finding container d41b89a279cd0e1656c63bf8de7be4247a533f58ba2d8374e99f4c117a966436: Status 404 returned error can't find the container with id d41b89a279cd0e1656c63bf8de7be4247a533f58ba2d8374e99f4c117a966436
Jul 30 10:59:47.776088 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:47.776052    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp" event={"ID":"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9","Type":"ContainerStarted","Data":"d41b89a279cd0e1656c63bf8de7be4247a533f58ba2d8374e99f4c117a966436"}
Jul 30 10:59:48.782483 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:48.782443    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp" event={"ID":"00bc8882-bcb7-4797-beb0-9c4e8c75b4e9","Type":"ContainerStarted","Data":"97df3ceedc24d839f86f92429ce209c41c4c1466bb4c0008425e7ee59dea1f8d"}
Jul 30 10:59:48.803949 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:48.803896    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp" podStartSLOduration=1.6195138500000001 podStartE2EDuration="1.803878124s" totalImagesPullingTime="184.364274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 10:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 10:59:48.802029896 +0000 UTC m=+692.910671389" watchObservedRunningTime="2026-07-30 10:59:48.803878124 +0000 UTC m=+692.912519617"
Jul 30 10:59:57.402624 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:57.402581    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:57.403011 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:57.402645    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:57.415447 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:57.415418    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 10:59:57.838126 ip-10-0-134-172 kubenswrapper[2583]: I0730 10:59:57.838039    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-2lgbp"
Jul 30 11:19:05.925444 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:05.925399    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"]
Jul 30 11:19:05.929183 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:05.929154    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:05.931832 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:05.931806    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2ca37a8f-openshift-default-dockercfg-hqwt5\""
Jul 30 11:19:05.949626 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:05.949589    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"]
Jul 30 11:19:06.010940 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.010893    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-socket\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.011135 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.010954    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/550f3d7e-8af0-4159-b336-552140bc6f13-istio-podinfo\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.011135 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.011000    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-data\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.011135 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.011031    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/550f3d7e-8af0-4159-b336-552140bc6f13-istiod-ca-cert\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.011135 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.011057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-credential-socket\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.011135 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.011084    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-envoy\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.011135 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.011120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-certs\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.011532 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.011162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-istio-token\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.011532 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.011444    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7x4t\" (UniqueName: \"kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-kube-api-access-s7x4t\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113078 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-data\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113320 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113090    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/550f3d7e-8af0-4159-b336-552140bc6f13-istiod-ca-cert\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113320 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113112    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-credential-socket\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113320 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113139    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-envoy\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113320 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-certs\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113320 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-istio-token\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113320 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7x4t\" (UniqueName: \"kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-kube-api-access-s7x4t\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113320 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-socket\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113737 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/550f3d7e-8af0-4159-b336-552140bc6f13-istio-podinfo\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113737 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113562    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-data\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113737 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113709    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-credential-socket\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113859 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113789    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-socket\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.113959 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113938    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-certs\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.114001 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.113969    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/550f3d7e-8af0-4159-b336-552140bc6f13-istiod-ca-cert\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.115578 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.115560    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-envoy\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.115805 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.115784    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/550f3d7e-8af0-4159-b336-552140bc6f13-istio-podinfo\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.122573 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.122533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-istio-token\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.122716 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.122669    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7x4t\" (UniqueName: \"kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-kube-api-access-s7x4t\") pod \"e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") " pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.240545 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.240444    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:06.388566 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.388536    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"]
Jul 30 11:19:06.390906 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:19:06.390875    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550f3d7e_8af0_4159_b336_552140bc6f13.slice/crio-bb77826450df204f8bd369253a9493aa3baf6dc4d3bc0ff0facebd7a4b4ed4f1 WatchSource:0}: Error finding container bb77826450df204f8bd369253a9493aa3baf6dc4d3bc0ff0facebd7a4b4ed4f1: Status 404 returned error can't find the container with id bb77826450df204f8bd369253a9493aa3baf6dc4d3bc0ff0facebd7a4b4ed4f1
Jul 30 11:19:06.393275 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.393241    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:19:06.393386 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.393325    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:19:06.393386 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.393368    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:19:06.549390 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.549293    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" event={"ID":"550f3d7e-8af0-4159-b336-552140bc6f13","Type":"ContainerStarted","Data":"dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab"}
Jul 30 11:19:06.549390 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.549358    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" event={"ID":"550f3d7e-8af0-4159-b336-552140bc6f13","Type":"ContainerStarted","Data":"bb77826450df204f8bd369253a9493aa3baf6dc4d3bc0ff0facebd7a4b4ed4f1"}
Jul 30 11:19:06.568808 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:06.568753    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" podStartSLOduration=1.568727398 podStartE2EDuration="1.568727398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:19:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:19:06.567395586 +0000 UTC m=+1850.676037094" watchObservedRunningTime="2026-07-30 11:19:06.568727398 +0000 UTC m=+1850.677368890"
Jul 30 11:19:07.241331 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:07.241289    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:07.246209 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:07.246179    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:07.554527 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:07.554434    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:07.555640 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:07.555616    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:22.761078 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:22.761042    2583 patch_prober.go:28] interesting pod/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": read tcp 10.134.0.2:45344->10.134.0.36:15021: read: connection reset by peer" start-of-body=
Jul 30 11:19:22.761557 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:22.761128    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": read tcp 10.134.0.2:45344->10.134.0.36:15021: read: connection reset by peer"
Jul 30 11:19:23.637946 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:23.637911    2583 generic.go:356] "Generic (PLEG): container finished" podID="550f3d7e-8af0-4159-b336-552140bc6f13" containerID="dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab" exitCode=0
Jul 30 11:19:23.638137 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:23.637986    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" event={"ID":"550f3d7e-8af0-4159-b336-552140bc6f13","Type":"ContainerDied","Data":"dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab"}
Jul 30 11:19:23.638453 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:23.638435    2583 scope.go:117] "RemoveContainer" containerID="dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab"
Jul 30 11:19:23.639488 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:23.639462    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:19:23.639555 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:23.639529    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:19:23.639590 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:23.639562    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:19:24.648841 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:24.648794    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" event={"ID":"550f3d7e-8af0-4159-b336-552140bc6f13","Type":"ContainerStarted","Data":"b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34"}
Jul 30 11:19:25.241790 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:25.241736    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:25.242011 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:25.241910    2583 patch_prober.go:28] interesting pod/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 30 11:19:25.242082 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:25.242031    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 30 11:19:26.242041 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:26.241991    2583 patch_prober.go:28] interesting pod/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 30 11:19:26.242568 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:26.242066    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 30 11:19:27.241672 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:27.241633    2583 patch_prober.go:28] interesting pod/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 30 11:19:27.241882 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:27.241701    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 30 11:19:28.241807 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:28.241762    2583 patch_prober.go:28] interesting pod/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 30 11:19:28.242501 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:28.242461    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 30 11:19:29.241959 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:29.241912    2583 patch_prober.go:28] interesting pod/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 30 11:19:29.242636 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:29.242599    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 30 11:19:30.244674 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:30.244640    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:30.245073 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:30.244998    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:30.245781 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:30.245753    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:39.830011 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:39.829969    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"]
Jul 30 11:19:39.830898 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:39.830856    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy" containerID="cri-o://b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34" gracePeriod=30
Jul 30 11:19:45.085850 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.085819    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:45.225680 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.225641    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-certs\") pod \"550f3d7e-8af0-4159-b336-552140bc6f13\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") "
Jul 30 11:19:45.225944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.225705    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-data\") pod \"550f3d7e-8af0-4159-b336-552140bc6f13\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") "
Jul 30 11:19:45.225944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.225730    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-socket\") pod \"550f3d7e-8af0-4159-b336-552140bc6f13\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") "
Jul 30 11:19:45.225944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.225761    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7x4t\" (UniqueName: \"kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-kube-api-access-s7x4t\") pod \"550f3d7e-8af0-4159-b336-552140bc6f13\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") "
Jul 30 11:19:45.225944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.225812    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/550f3d7e-8af0-4159-b336-552140bc6f13-istio-podinfo\") pod \"550f3d7e-8af0-4159-b336-552140bc6f13\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") "
Jul 30 11:19:45.225944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.225842    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-credential-socket\") pod \"550f3d7e-8af0-4159-b336-552140bc6f13\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") "
Jul 30 11:19:45.225944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.225874    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-istio-token\") pod \"550f3d7e-8af0-4159-b336-552140bc6f13\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") "
Jul 30 11:19:45.225944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.225911    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-envoy\") pod \"550f3d7e-8af0-4159-b336-552140bc6f13\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") "
Jul 30 11:19:45.225944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.225937    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/550f3d7e-8af0-4159-b336-552140bc6f13-istiod-ca-cert\") pod \"550f3d7e-8af0-4159-b336-552140bc6f13\" (UID: \"550f3d7e-8af0-4159-b336-552140bc6f13\") "
Jul 30 11:19:45.226388 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.226007    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-data" (OuterVolumeSpecName: "istio-data") pod "550f3d7e-8af0-4159-b336-552140bc6f13" (UID: "550f3d7e-8af0-4159-b336-552140bc6f13"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:19:45.226388 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.226118    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "550f3d7e-8af0-4159-b336-552140bc6f13" (UID: "550f3d7e-8af0-4159-b336-552140bc6f13"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:19:45.226388 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.226015    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "550f3d7e-8af0-4159-b336-552140bc6f13" (UID: "550f3d7e-8af0-4159-b336-552140bc6f13"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:19:45.226388 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.226177    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "550f3d7e-8af0-4159-b336-552140bc6f13" (UID: "550f3d7e-8af0-4159-b336-552140bc6f13"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:19:45.226614 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.226409    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-certs\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:19:45.226614 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.226417    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/550f3d7e-8af0-4159-b336-552140bc6f13-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "550f3d7e-8af0-4159-b336-552140bc6f13" (UID: "550f3d7e-8af0-4159-b336-552140bc6f13"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:19:45.226614 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.226432    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-data\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:19:45.226614 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.226447    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-workload-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:19:45.226614 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.226462    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-credential-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:19:45.228163 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.228134    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-kube-api-access-s7x4t" (OuterVolumeSpecName: "kube-api-access-s7x4t") pod "550f3d7e-8af0-4159-b336-552140bc6f13" (UID: "550f3d7e-8af0-4159-b336-552140bc6f13"). InnerVolumeSpecName "kube-api-access-s7x4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:19:45.228354 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.228189    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/550f3d7e-8af0-4159-b336-552140bc6f13-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "550f3d7e-8af0-4159-b336-552140bc6f13" (UID: "550f3d7e-8af0-4159-b336-552140bc6f13"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 11:19:45.228468 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.228448    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "550f3d7e-8af0-4159-b336-552140bc6f13" (UID: "550f3d7e-8af0-4159-b336-552140bc6f13"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:19:45.228581 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.228564    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-istio-token" (OuterVolumeSpecName: "istio-token") pod "550f3d7e-8af0-4159-b336-552140bc6f13" (UID: "550f3d7e-8af0-4159-b336-552140bc6f13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:19:45.327712 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.327675    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-istio-token\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:19:45.327712 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.327705    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/550f3d7e-8af0-4159-b336-552140bc6f13-istio-envoy\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:19:45.327712 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.327715    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/550f3d7e-8af0-4159-b336-552140bc6f13-istiod-ca-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:19:45.327712 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.327724    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7x4t\" (UniqueName: \"kubernetes.io/projected/550f3d7e-8af0-4159-b336-552140bc6f13-kube-api-access-s7x4t\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:19:45.327965 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.327733    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/550f3d7e-8af0-4159-b336-552140bc6f13-istio-podinfo\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:19:45.759840 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.759806    2583 generic.go:356] "Generic (PLEG): container finished" podID="550f3d7e-8af0-4159-b336-552140bc6f13" containerID="b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34" exitCode=0
Jul 30 11:19:45.760008 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.759852    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"
Jul 30 11:19:45.760008 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.759887    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" event={"ID":"550f3d7e-8af0-4159-b336-552140bc6f13","Type":"ContainerDied","Data":"b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34"}
Jul 30 11:19:45.760008 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.759943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t" event={"ID":"550f3d7e-8af0-4159-b336-552140bc6f13","Type":"ContainerDied","Data":"bb77826450df204f8bd369253a9493aa3baf6dc4d3bc0ff0facebd7a4b4ed4f1"}
Jul 30 11:19:45.760008 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.759966    2583 scope.go:117] "RemoveContainer" containerID="b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34"
Jul 30 11:19:45.769896 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.769876    2583 scope.go:117] "RemoveContainer" containerID="dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab"
Jul 30 11:19:45.778665 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.778644    2583 scope.go:117] "RemoveContainer" containerID="b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34"
Jul 30 11:19:45.779021 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:19:45.778998    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34\": container with ID starting with b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34 not found: ID does not exist" containerID="b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34"
Jul 30 11:19:45.779075 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.779031    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34"} err="failed to get container status \"b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34\": rpc error: code = NotFound desc = could not find container \"b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34\": container with ID starting with b06e407939f0e174c89bf6b1bb54f8050b336dd3ec9626b25005ec6b468b4f34 not found: ID does not exist"
Jul 30 11:19:45.779075 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.779054    2583 scope.go:117] "RemoveContainer" containerID="dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab"
Jul 30 11:19:45.779338 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:19:45.779319    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab\": container with ID starting with dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab not found: ID does not exist" containerID="dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab"
Jul 30 11:19:45.779397 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.779344    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab"} err="failed to get container status \"dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab\": rpc error: code = NotFound desc = could not find container \"dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab\": container with ID starting with dd6837717825886db7ae4203dfb40c8175d2f5af2999e306327ed5c75f5935ab not found: ID does not exist"
Jul 30 11:19:45.782545 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.782515    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"]
Jul 30 11:19:45.786583 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:45.786553    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2ca37a8f-openshift-default-9f8c6dffd-tjh9t"]
Jul 30 11:19:46.465433 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:46.465395    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" path="/var/lib/kubelet/pods/550f3d7e-8af0-4159-b336-552140bc6f13/volumes"
Jul 30 11:19:49.764794 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.764733    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"]
Jul 30 11:19:49.765202 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.765177    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy"
Jul 30 11:19:49.765202 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.765192    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy"
Jul 30 11:19:49.765202 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.765205    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy"
Jul 30 11:19:49.765343 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.765211    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy"
Jul 30 11:19:49.765343 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.765296    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy"
Jul 30 11:19:49.765343 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.765304    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="550f3d7e-8af0-4159-b336-552140bc6f13" containerName="istio-proxy"
Jul 30 11:19:49.767313 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.767293    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:19:49.769920 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.769891    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d9108b46\""
Jul 30 11:19:49.770075 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.769946    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d9108b46-dockercfg-p5gb9\""
Jul 30 11:19:49.779917 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.779885    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"]
Jul 30 11:19:49.869578 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.869531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v\" (UID: \"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:19:49.869770 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.869588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhtxp\" (UniqueName: \"kubernetes.io/projected/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-kube-api-access-hhtxp\") pod \"payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v\" (UID: \"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:19:49.970824 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.970774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v\" (UID: \"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:19:49.971016 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.970845    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhtxp\" (UniqueName: \"kubernetes.io/projected/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-kube-api-access-hhtxp\") pod \"payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v\" (UID: \"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:19:49.971574 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.971553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v\" (UID: \"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:19:49.979156 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:49.979127    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhtxp\" (UniqueName: \"kubernetes.io/projected/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-kube-api-access-hhtxp\") pod \"payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v\" (UID: \"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:19:50.081542 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:50.081452    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:19:50.230037 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:50.230010    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"]
Jul 30 11:19:50.232303 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:19:50.232273    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3dc28f_84bc_4b67_a040_a4fa2ffe7542.slice/crio-3674505b777ccc7d12840aabfd5017d80826d18bf5bd7f1a475ae7249a41dab0 WatchSource:0}: Error finding container 3674505b777ccc7d12840aabfd5017d80826d18bf5bd7f1a475ae7249a41dab0: Status 404 returned error can't find the container with id 3674505b777ccc7d12840aabfd5017d80826d18bf5bd7f1a475ae7249a41dab0
Jul 30 11:19:50.234719 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:50.234697    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 11:19:50.789384 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:50.789340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v" event={"ID":"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542","Type":"ContainerStarted","Data":"3674505b777ccc7d12840aabfd5017d80826d18bf5bd7f1a475ae7249a41dab0"}
Jul 30 11:19:52.802350 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:52.802299    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v" event={"ID":"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542","Type":"ContainerStarted","Data":"dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332"}
Jul 30 11:19:52.802732 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:52.802390    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:19:52.818051 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:19:52.817995    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v" podStartSLOduration=1.468324973 podStartE2EDuration="3.817975306s" totalImagesPullingTime="2.349650333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:19:52.817719709 +0000 UTC m=+1896.926361200" watchObservedRunningTime="2026-07-30 11:19:52.817975306 +0000 UTC m=+1896.926616799"
Jul 30 11:20:03.809929 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:03.809889    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:20:20.574926 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.574877    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"]
Jul 30 11:20:20.575469 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.575163    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v" podUID="ed3dc28f-84bc-4b67-a040-a4fa2ffe7542" containerName="payload-pre-processing" containerID="cri-o://dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332" gracePeriod=30
Jul 30 11:20:20.840081 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.840051    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:20:20.946690 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.946647    2583 generic.go:356] "Generic (PLEG): container finished" podID="ed3dc28f-84bc-4b67-a040-a4fa2ffe7542" containerID="dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332" exitCode=0
Jul 30 11:20:20.946690 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.946693    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"
Jul 30 11:20:20.947043 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.946773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v" event={"ID":"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542","Type":"ContainerDied","Data":"dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332"}
Jul 30 11:20:20.947043 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.946829    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v" event={"ID":"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542","Type":"ContainerDied","Data":"3674505b777ccc7d12840aabfd5017d80826d18bf5bd7f1a475ae7249a41dab0"}
Jul 30 11:20:20.947043 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.946860    2583 scope.go:117] "RemoveContainer" containerID="dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332"
Jul 30 11:20:20.956737 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.956697    2583 scope.go:117] "RemoveContainer" containerID="dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332"
Jul 30 11:20:20.957003 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:20:20.956982    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332\": container with ID starting with dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332 not found: ID does not exist" containerID="dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332"
Jul 30 11:20:20.957070 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.957012    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332"} err="failed to get container status \"dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332\": rpc error: code = NotFound desc = could not find container \"dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332\": container with ID starting with dc277f00bad5719d8626eabc7381244954c1bdf543d9779030c95c26882b5332 not found: ID does not exist"
Jul 30 11:20:20.964414 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.964384    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-plugins-config-volume\") pod \"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542\" (UID: \"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542\") "
Jul 30 11:20:20.964583 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.964532    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhtxp\" (UniqueName: \"kubernetes.io/projected/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-kube-api-access-hhtxp\") pod \"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542\" (UID: \"ed3dc28f-84bc-4b67-a040-a4fa2ffe7542\") "
Jul 30 11:20:20.964785 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.964761    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed3dc28f-84bc-4b67-a040-a4fa2ffe7542" (UID: "ed3dc28f-84bc-4b67-a040-a4fa2ffe7542"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:20:20.966678 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:20.966641    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-kube-api-access-hhtxp" (OuterVolumeSpecName: "kube-api-access-hhtxp") pod "ed3dc28f-84bc-4b67-a040-a4fa2ffe7542" (UID: "ed3dc28f-84bc-4b67-a040-a4fa2ffe7542"). InnerVolumeSpecName "kube-api-access-hhtxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:20:21.066061 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.066014    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhtxp\" (UniqueName: \"kubernetes.io/projected/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-kube-api-access-hhtxp\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:20:21.066061 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.066052    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:20:21.268828 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.268789    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"]
Jul 30 11:20:21.272421 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.272388    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d9108b46-57f9ffb68d-tn86v"]
Jul 30 11:20:21.619039 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.618958    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"]
Jul 30 11:20:21.619416 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.619369    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed3dc28f-84bc-4b67-a040-a4fa2ffe7542" containerName="payload-pre-processing"
Jul 30 11:20:21.619416 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.619381    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed3dc28f-84bc-4b67-a040-a4fa2ffe7542" containerName="payload-pre-processing"
Jul 30 11:20:21.619492 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.619437    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed3dc28f-84bc-4b67-a040-a4fa2ffe7542" containerName="payload-pre-processing"
Jul 30 11:20:21.624533 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.624502    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.629733 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.629634    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-519ed3f7-openshift-default-dockercfg-mlc78\""
Jul 30 11:20:21.637791 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.637758    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"]
Jul 30 11:20:21.772097 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.772052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-socket\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.772310 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.772113    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-certs\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.772310 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.772200    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/404e87e7-0579-4ea7-bc89-97b2149b871d-istiod-ca-cert\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.772310 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.772279    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-credential-socket\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.772439 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.772309    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-data\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.772439 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.772370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-token\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.772439 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.772392    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-podinfo\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.772439 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.772437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-envoy\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.772572 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.772510    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnpbs\" (UniqueName: \"kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-kube-api-access-wnpbs\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.873569 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.873476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-token\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.873569 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.873522    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-podinfo\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.873569 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.873550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-envoy\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.873841 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.873593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpbs\" (UniqueName: \"kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-kube-api-access-wnpbs\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.873841 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.873621    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-socket\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.873841 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.873655    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-certs\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.873841 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.873692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/404e87e7-0579-4ea7-bc89-97b2149b871d-istiod-ca-cert\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.873841 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.873724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-credential-socket\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.873841 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.873760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-data\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.874546 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.874121    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-socket\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.874546 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.874172    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-credential-socket\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.874546 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.874245    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-data\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.874546 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.874217    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-certs\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.874827 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.874803    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/404e87e7-0579-4ea7-bc89-97b2149b871d-istiod-ca-cert\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.876185 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.876163    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-envoy\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.876331 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.876312    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-podinfo\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.884729 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.884692    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-token\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.884895 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.884814    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnpbs\" (UniqueName: \"kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-kube-api-access-wnpbs\") pod \"e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") " pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:21.941330 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:21.941287    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:22.102102 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:22.102063    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"]
Jul 30 11:20:22.105834 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:20:22.105804    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404e87e7_0579_4ea7_bc89_97b2149b871d.slice/crio-5d5c0236854bf7574316b2b0019d93dfa33cad660416b40667f6ec3bf10f6d1b WatchSource:0}: Error finding container 5d5c0236854bf7574316b2b0019d93dfa33cad660416b40667f6ec3bf10f6d1b: Status 404 returned error can't find the container with id 5d5c0236854bf7574316b2b0019d93dfa33cad660416b40667f6ec3bf10f6d1b
Jul 30 11:20:22.108463 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:22.108420    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:20:22.108533 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:22.108493    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:20:22.108533 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:22.108518    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:20:22.461990 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:22.461949    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed3dc28f-84bc-4b67-a040-a4fa2ffe7542" path="/var/lib/kubelet/pods/ed3dc28f-84bc-4b67-a040-a4fa2ffe7542/volumes"
Jul 30 11:20:22.959151 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:22.959119    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" event={"ID":"404e87e7-0579-4ea7-bc89-97b2149b871d","Type":"ContainerStarted","Data":"d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124"}
Jul 30 11:20:22.959586 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:22.959170    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" event={"ID":"404e87e7-0579-4ea7-bc89-97b2149b871d","Type":"ContainerStarted","Data":"5d5c0236854bf7574316b2b0019d93dfa33cad660416b40667f6ec3bf10f6d1b"}
Jul 30 11:20:22.980016 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:22.979862    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" podStartSLOduration=1.97981326 podStartE2EDuration="1.97981326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:20:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:20:22.979043388 +0000 UTC m=+1927.087684894" watchObservedRunningTime="2026-07-30 11:20:22.97981326 +0000 UTC m=+1927.088454755"
Jul 30 11:20:23.942088 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:23.942031    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:23.947521 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:23.947490    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:23.965167 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:23.965136    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:23.966279 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:23.966221    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:25.419669 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.419630    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"]
Jul 30 11:20:25.428335 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.428307    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:25.430966 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.430920    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-519ed3f7-serving-cert\""
Jul 30 11:20:25.431219 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.431188    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gvjcm\""
Jul 30 11:20:25.431325 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.431304    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 11:20:25.432179 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.432153    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 11:20:25.432377 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.432350    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"]
Jul 30 11:20:25.509853 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.509813    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/411f00fd-2924-498b-a84d-77b4e7b971cc-openshift-service-ca\") pod \"maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:25.509853 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.509858    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z668d\" (UniqueName: \"kubernetes.io/projected/411f00fd-2924-498b-a84d-77b4e7b971cc-kube-api-access-z668d\") pod \"maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:25.510114 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.509969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/411f00fd-2924-498b-a84d-77b4e7b971cc-maas-api-tls\") pod \"maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:25.611379 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.611337    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/411f00fd-2924-498b-a84d-77b4e7b971cc-maas-api-tls\") pod \"maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:25.611586 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.611440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/411f00fd-2924-498b-a84d-77b4e7b971cc-openshift-service-ca\") pod \"maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:25.611586 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.611466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z668d\" (UniqueName: \"kubernetes.io/projected/411f00fd-2924-498b-a84d-77b4e7b971cc-kube-api-access-z668d\") pod \"maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:25.612110 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.612091    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/411f00fd-2924-498b-a84d-77b4e7b971cc-openshift-service-ca\") pod \"maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:25.613964 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.613933    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/411f00fd-2924-498b-a84d-77b4e7b971cc-maas-api-tls\") pod \"maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:25.620216 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.620184    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z668d\" (UniqueName: \"kubernetes.io/projected/411f00fd-2924-498b-a84d-77b4e7b971cc-kube-api-access-z668d\") pod \"maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:25.741109 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.741018    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:25.893999 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.893968    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"]
Jul 30 11:20:25.896817 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:20:25.896789    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411f00fd_2924_498b_a84d_77b4e7b971cc.slice/crio-c2726d9a6fe2114a1d262a09b4fe0850db094231ddcff0b68fb2f853af890cea WatchSource:0}: Error finding container c2726d9a6fe2114a1d262a09b4fe0850db094231ddcff0b68fb2f853af890cea: Status 404 returned error can't find the container with id c2726d9a6fe2114a1d262a09b4fe0850db094231ddcff0b68fb2f853af890cea
Jul 30 11:20:25.975771 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:25.975731    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf" event={"ID":"411f00fd-2924-498b-a84d-77b4e7b971cc","Type":"ContainerStarted","Data":"c2726d9a6fe2114a1d262a09b4fe0850db094231ddcff0b68fb2f853af890cea"}
Jul 30 11:20:26.188135 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.188099    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"]
Jul 30 11:20:26.197882 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.197848    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:26.200837 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.200801    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-519ed3f7\""
Jul 30 11:20:26.201201 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.201181    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-519ed3f7-dockercfg-7cqs4\""
Jul 30 11:20:26.202409 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.202379    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"]
Jul 30 11:20:26.319301 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.319259    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtdx6\" (UniqueName: \"kubernetes.io/projected/2a40811e-5097-4b64-8fb2-dca5e3671981-kube-api-access-jtdx6\") pod \"payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g\" (UID: \"2a40811e-5097-4b64-8fb2-dca5e3671981\") " pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:26.319301 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.319317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a40811e-5097-4b64-8fb2-dca5e3671981-plugins-config-volume\") pod \"payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g\" (UID: \"2a40811e-5097-4b64-8fb2-dca5e3671981\") " pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:26.421029 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.420988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtdx6\" (UniqueName: \"kubernetes.io/projected/2a40811e-5097-4b64-8fb2-dca5e3671981-kube-api-access-jtdx6\") pod \"payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g\" (UID: \"2a40811e-5097-4b64-8fb2-dca5e3671981\") " pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:26.421029 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.421037    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a40811e-5097-4b64-8fb2-dca5e3671981-plugins-config-volume\") pod \"payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g\" (UID: \"2a40811e-5097-4b64-8fb2-dca5e3671981\") " pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:26.421789 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.421768    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a40811e-5097-4b64-8fb2-dca5e3671981-plugins-config-volume\") pod \"payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g\" (UID: \"2a40811e-5097-4b64-8fb2-dca5e3671981\") " pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:26.429317 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.429289    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtdx6\" (UniqueName: \"kubernetes.io/projected/2a40811e-5097-4b64-8fb2-dca5e3671981-kube-api-access-jtdx6\") pod \"payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g\" (UID: \"2a40811e-5097-4b64-8fb2-dca5e3671981\") " pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:26.512997 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.512896    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:26.706883 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.706501    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"]
Jul 30 11:20:26.711427 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:20:26.711373    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a40811e_5097_4b64_8fb2_dca5e3671981.slice/crio-e2d9ad2ef33d52143f151c1bbeed1a9a1a76c794e38a833c96b5184a5d5c7e28 WatchSource:0}: Error finding container e2d9ad2ef33d52143f151c1bbeed1a9a1a76c794e38a833c96b5184a5d5c7e28: Status 404 returned error can't find the container with id e2d9ad2ef33d52143f151c1bbeed1a9a1a76c794e38a833c96b5184a5d5c7e28
Jul 30 11:20:26.985266 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.985202    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g" event={"ID":"2a40811e-5097-4b64-8fb2-dca5e3671981","Type":"ContainerStarted","Data":"81a3737ed518d01b3920fc90dc4a0b922030175afde79a77502259555afaa062"}
Jul 30 11:20:26.985467 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.985294    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g" event={"ID":"2a40811e-5097-4b64-8fb2-dca5e3671981","Type":"ContainerStarted","Data":"e2d9ad2ef33d52143f151c1bbeed1a9a1a76c794e38a833c96b5184a5d5c7e28"}
Jul 30 11:20:26.985467 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:26.985431    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:27.003166 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:27.003114    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g" podStartSLOduration=1.003095662 podStartE2EDuration="1.003095662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:20:27.000819002 +0000 UTC m=+1931.109460539" watchObservedRunningTime="2026-07-30 11:20:27.003095662 +0000 UTC m=+1931.111737151"
Jul 30 11:20:28.998013 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:28.997976    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf" event={"ID":"411f00fd-2924-498b-a84d-77b4e7b971cc","Type":"ContainerStarted","Data":"8eae488acd787603375dfaaae33b43ad6a98ae407af400299780a15e00701ea8"}
Jul 30 11:20:28.998497 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:28.998122    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:29.016185 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:29.016131    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf" podStartSLOduration=1.603099337 podStartE2EDuration="4.016113621s" totalImagesPullingTime="2.413014284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:20:29.014469663 +0000 UTC m=+1933.123111155" watchObservedRunningTime="2026-07-30 11:20:29.016113621 +0000 UTC m=+1933.124755113"
Jul 30 11:20:35.009168 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:35.009135    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:37.993486 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:37.993444    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:38.966481 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:38.966439    2583 patch_prober.go:28] interesting pod/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 30 11:20:38.966701 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:38.966508    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 30 11:20:39.055920 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:39.055883    2583 generic.go:356] "Generic (PLEG): container finished" podID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerID="d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124" exitCode=0
Jul 30 11:20:39.056330 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:39.055954    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" event={"ID":"404e87e7-0579-4ea7-bc89-97b2149b871d","Type":"ContainerDied","Data":"d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124"}
Jul 30 11:20:39.056424 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:39.056408    2583 scope.go:117] "RemoveContainer" containerID="d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124"
Jul 30 11:20:39.057562 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:39.057534    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:20:39.057645 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:39.057626    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:20:39.057686 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:39.057657    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:20:40.063275 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:40.063238    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" event={"ID":"404e87e7-0579-4ea7-bc89-97b2149b871d","Type":"ContainerStarted","Data":"621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb"}
Jul 30 11:20:40.942074 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:40.942027    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:40.942315 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:40.942181    2583 patch_prober.go:28] interesting pod/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 30 11:20:40.942315 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:40.942246    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 30 11:20:41.942439 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:41.941936    2583 patch_prober.go:28] interesting pod/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 30 11:20:41.942439 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:41.942003    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 30 11:20:42.942765 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:42.942718    2583 patch_prober.go:28] interesting pod/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 30 11:20:42.943438 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:42.943397    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 30 11:20:43.941851 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:43.941796    2583 patch_prober.go:28] interesting pod/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 30 11:20:43.942078 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:43.941892    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 30 11:20:44.942433 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:44.942388    2583 patch_prober.go:28] interesting pod/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 30 11:20:44.942944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:44.942453    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 30 11:20:45.946349 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:45.946318    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:45.946780 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:45.946600    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:45.947432 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:45.947412    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:20:55.928105 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:55.928061    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"]
Jul 30 11:20:55.928667 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:55.928369    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf" podUID="411f00fd-2924-498b-a84d-77b4e7b971cc" containerName="maas-api" containerID="cri-o://8eae488acd787603375dfaaae33b43ad6a98ae407af400299780a15e00701ea8" gracePeriod=30
Jul 30 11:20:55.980021 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:55.979981    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"]
Jul 30 11:20:55.980303 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:55.980252    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g" podUID="2a40811e-5097-4b64-8fb2-dca5e3671981" containerName="payload-processing" containerID="cri-o://81a3737ed518d01b3920fc90dc4a0b922030175afde79a77502259555afaa062" gracePeriod=30
Jul 30 11:20:56.165247 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.162595    2583 generic.go:356] "Generic (PLEG): container finished" podID="2a40811e-5097-4b64-8fb2-dca5e3671981" containerID="81a3737ed518d01b3920fc90dc4a0b922030175afde79a77502259555afaa062" exitCode=0
Jul 30 11:20:56.165247 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.162778    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g" event={"ID":"2a40811e-5097-4b64-8fb2-dca5e3671981","Type":"ContainerDied","Data":"81a3737ed518d01b3920fc90dc4a0b922030175afde79a77502259555afaa062"}
Jul 30 11:20:56.165247 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.164834    2583 generic.go:356] "Generic (PLEG): container finished" podID="411f00fd-2924-498b-a84d-77b4e7b971cc" containerID="8eae488acd787603375dfaaae33b43ad6a98ae407af400299780a15e00701ea8" exitCode=0
Jul 30 11:20:56.165247 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.164924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf" event={"ID":"411f00fd-2924-498b-a84d-77b4e7b971cc","Type":"ContainerDied","Data":"8eae488acd787603375dfaaae33b43ad6a98ae407af400299780a15e00701ea8"}
Jul 30 11:20:56.247580 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.247547    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:56.284681 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.284648    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:56.325257 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.325204    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/411f00fd-2924-498b-a84d-77b4e7b971cc-maas-api-tls\") pod \"411f00fd-2924-498b-a84d-77b4e7b971cc\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") "
Jul 30 11:20:56.325458 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.325303    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/411f00fd-2924-498b-a84d-77b4e7b971cc-openshift-service-ca\") pod \"411f00fd-2924-498b-a84d-77b4e7b971cc\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") "
Jul 30 11:20:56.325458 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.325357    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z668d\" (UniqueName: \"kubernetes.io/projected/411f00fd-2924-498b-a84d-77b4e7b971cc-kube-api-access-z668d\") pod \"411f00fd-2924-498b-a84d-77b4e7b971cc\" (UID: \"411f00fd-2924-498b-a84d-77b4e7b971cc\") "
Jul 30 11:20:56.325717 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.325680    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/411f00fd-2924-498b-a84d-77b4e7b971cc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "411f00fd-2924-498b-a84d-77b4e7b971cc" (UID: "411f00fd-2924-498b-a84d-77b4e7b971cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:20:56.325849 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.325770    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/411f00fd-2924-498b-a84d-77b4e7b971cc-openshift-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:20:56.327703 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.327671    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/411f00fd-2924-498b-a84d-77b4e7b971cc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "411f00fd-2924-498b-a84d-77b4e7b971cc" (UID: "411f00fd-2924-498b-a84d-77b4e7b971cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 11:20:56.327823 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.327755    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/411f00fd-2924-498b-a84d-77b4e7b971cc-kube-api-access-z668d" (OuterVolumeSpecName: "kube-api-access-z668d") pod "411f00fd-2924-498b-a84d-77b4e7b971cc" (UID: "411f00fd-2924-498b-a84d-77b4e7b971cc"). InnerVolumeSpecName "kube-api-access-z668d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:20:56.426415 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.426374    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a40811e-5097-4b64-8fb2-dca5e3671981-plugins-config-volume\") pod \"2a40811e-5097-4b64-8fb2-dca5e3671981\" (UID: \"2a40811e-5097-4b64-8fb2-dca5e3671981\") "
Jul 30 11:20:56.426585 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.426511    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtdx6\" (UniqueName: \"kubernetes.io/projected/2a40811e-5097-4b64-8fb2-dca5e3671981-kube-api-access-jtdx6\") pod \"2a40811e-5097-4b64-8fb2-dca5e3671981\" (UID: \"2a40811e-5097-4b64-8fb2-dca5e3671981\") "
Jul 30 11:20:56.426789 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.426758    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a40811e-5097-4b64-8fb2-dca5e3671981-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2a40811e-5097-4b64-8fb2-dca5e3671981" (UID: "2a40811e-5097-4b64-8fb2-dca5e3671981"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:20:56.426899 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.426873    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2a40811e-5097-4b64-8fb2-dca5e3671981-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:20:56.426899 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.426893    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/411f00fd-2924-498b-a84d-77b4e7b971cc-maas-api-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:20:56.427017 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.426904    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z668d\" (UniqueName: \"kubernetes.io/projected/411f00fd-2924-498b-a84d-77b4e7b971cc-kube-api-access-z668d\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:20:56.428764 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.428720    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a40811e-5097-4b64-8fb2-dca5e3671981-kube-api-access-jtdx6" (OuterVolumeSpecName: "kube-api-access-jtdx6") pod "2a40811e-5097-4b64-8fb2-dca5e3671981" (UID: "2a40811e-5097-4b64-8fb2-dca5e3671981"). InnerVolumeSpecName "kube-api-access-jtdx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:20:56.527433 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:56.527392    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtdx6\" (UniqueName: \"kubernetes.io/projected/2a40811e-5097-4b64-8fb2-dca5e3671981-kube-api-access-jtdx6\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:20:57.171324 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.171292    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"
Jul 30 11:20:57.171758 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.171291    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g" event={"ID":"2a40811e-5097-4b64-8fb2-dca5e3671981","Type":"ContainerDied","Data":"e2d9ad2ef33d52143f151c1bbeed1a9a1a76c794e38a833c96b5184a5d5c7e28"}
Jul 30 11:20:57.171758 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.171438    2583 scope.go:117] "RemoveContainer" containerID="81a3737ed518d01b3920fc90dc4a0b922030175afde79a77502259555afaa062"
Jul 30 11:20:57.172944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.172810    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf" event={"ID":"411f00fd-2924-498b-a84d-77b4e7b971cc","Type":"ContainerDied","Data":"c2726d9a6fe2114a1d262a09b4fe0850db094231ddcff0b68fb2f853af890cea"}
Jul 30 11:20:57.172944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.172831    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"
Jul 30 11:20:57.181459 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.181433    2583 scope.go:117] "RemoveContainer" containerID="8eae488acd787603375dfaaae33b43ad6a98ae407af400299780a15e00701ea8"
Jul 30 11:20:57.189863 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.189826    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"]
Jul 30 11:20:57.193131 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.193099    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-519ed3f7-5787b9c56d-qx97g"]
Jul 30 11:20:57.205092 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.205008    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"]
Jul 30 11:20:57.208886 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.208854    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-519ed3f7-598c69757c-6s2jf"]
Jul 30 11:20:57.251050 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.251012    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"]
Jul 30 11:20:57.251333 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:57.251294    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy" containerID="cri-o://621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb" gracePeriod=30
Jul 30 11:20:58.461120 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:58.461085    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a40811e-5097-4b64-8fb2-dca5e3671981" path="/var/lib/kubelet/pods/2a40811e-5097-4b64-8fb2-dca5e3671981/volumes"
Jul 30 11:20:58.461618 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:20:58.461538    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="411f00fd-2924-498b-a84d-77b4e7b971cc" path="/var/lib/kubelet/pods/411f00fd-2924-498b-a84d-77b4e7b971cc/volumes"
Jul 30 11:21:00.949625 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:00.949579    2583 patch_prober.go:28] interesting pod/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 11:21:00.950009 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:00.949644    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 11:21:01.392913 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.392819    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"]
Jul 30 11:21:01.393333 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.393314    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a40811e-5097-4b64-8fb2-dca5e3671981" containerName="payload-processing"
Jul 30 11:21:01.393434 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.393335    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a40811e-5097-4b64-8fb2-dca5e3671981" containerName="payload-processing"
Jul 30 11:21:01.393434 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.393347    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="411f00fd-2924-498b-a84d-77b4e7b971cc" containerName="maas-api"
Jul 30 11:21:01.393434 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.393355    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="411f00fd-2924-498b-a84d-77b4e7b971cc" containerName="maas-api"
Jul 30 11:21:01.393589 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.393451    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a40811e-5097-4b64-8fb2-dca5e3671981" containerName="payload-processing"
Jul 30 11:21:01.393589 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.393465    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="411f00fd-2924-498b-a84d-77b4e7b971cc" containerName="maas-api"
Jul 30 11:21:01.401508 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.401461    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:01.404812 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.404779    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"]
Jul 30 11:21:01.405071 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.404874    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 11:21:01.405071 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.404938    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gvjcm\""
Jul 30 11:21:01.405830 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.405811    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-772a6e1a-serving-cert\""
Jul 30 11:21:01.406012 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.405981    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 11:21:01.576065 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.576029    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-maas-api-tls\") pod \"maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:01.576288 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.576117    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-openshift-service-ca\") pod \"maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:01.576288 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.576265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzs6m\" (UniqueName: \"kubernetes.io/projected/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-kube-api-access-zzs6m\") pod \"maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:01.677690 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.677650    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-maas-api-tls\") pod \"maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:01.677889 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.677734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-openshift-service-ca\") pod \"maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:01.677889 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.677832    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzs6m\" (UniqueName: \"kubernetes.io/projected/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-kube-api-access-zzs6m\") pod \"maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:01.678542 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.678517    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-openshift-service-ca\") pod \"maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:01.680170 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.680148    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-maas-api-tls\") pod \"maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:01.686999 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.686970    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzs6m\" (UniqueName: \"kubernetes.io/projected/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-kube-api-access-zzs6m\") pod \"maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:01.715208 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.715172    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:01.867013 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:01.866985    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"]
Jul 30 11:21:01.869194 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:21:01.869158    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b801cf_3dcc_4739_bd22_01d3d3ab9b2a.slice/crio-d6a147001aa905b388577af84c8996fa1902a898686cdd66a78d371ad9e52495 WatchSource:0}: Error finding container d6a147001aa905b388577af84c8996fa1902a898686cdd66a78d371ad9e52495: Status 404 returned error can't find the container with id d6a147001aa905b388577af84c8996fa1902a898686cdd66a78d371ad9e52495
Jul 30 11:21:02.018520 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.018429    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"]
Jul 30 11:21:02.023720 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.023690    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:02.026677 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.026646    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-772a6e1a\""
Jul 30 11:21:02.032555 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.032527    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"]
Jul 30 11:21:02.057596 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.057552    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"]
Jul 30 11:21:02.061406 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.061382    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:02.063769 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.063749    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-772a6e1a-dockercfg-ptnnd\""
Jul 30 11:21:02.073065 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.073028    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"]
Jul 30 11:21:02.181821 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.181772    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eb16666-18b8-454a-9e0c-30f9d9bb0700-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp\" (UID: \"0eb16666-18b8-454a-9e0c-30f9d9bb0700\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:02.182039 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.181907    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k72fb\" (UniqueName: \"kubernetes.io/projected/c35b065b-c840-4791-86ca-03d303cc2e8a-kube-api-access-k72fb\") pod \"payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz\" (UID: \"c35b065b-c840-4791-86ca-03d303cc2e8a\") " pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:02.182039 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.181960    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fklj4\" (UniqueName: \"kubernetes.io/projected/0eb16666-18b8-454a-9e0c-30f9d9bb0700-kube-api-access-fklj4\") pod \"payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp\" (UID: \"0eb16666-18b8-454a-9e0c-30f9d9bb0700\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:02.182138 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.182057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c35b065b-c840-4791-86ca-03d303cc2e8a-plugins-config-volume\") pod \"payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz\" (UID: \"c35b065b-c840-4791-86ca-03d303cc2e8a\") " pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:02.202127 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.202096    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k" event={"ID":"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a","Type":"ContainerStarted","Data":"d6a147001aa905b388577af84c8996fa1902a898686cdd66a78d371ad9e52495"}
Jul 30 11:21:02.282876 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.282769    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k72fb\" (UniqueName: \"kubernetes.io/projected/c35b065b-c840-4791-86ca-03d303cc2e8a-kube-api-access-k72fb\") pod \"payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz\" (UID: \"c35b065b-c840-4791-86ca-03d303cc2e8a\") " pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:02.282876 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.282817    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fklj4\" (UniqueName: \"kubernetes.io/projected/0eb16666-18b8-454a-9e0c-30f9d9bb0700-kube-api-access-fklj4\") pod \"payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp\" (UID: \"0eb16666-18b8-454a-9e0c-30f9d9bb0700\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:02.282876 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.282875    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c35b065b-c840-4791-86ca-03d303cc2e8a-plugins-config-volume\") pod \"payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz\" (UID: \"c35b065b-c840-4791-86ca-03d303cc2e8a\") " pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:02.283183 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.282901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eb16666-18b8-454a-9e0c-30f9d9bb0700-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp\" (UID: \"0eb16666-18b8-454a-9e0c-30f9d9bb0700\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:02.283688 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.283668    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eb16666-18b8-454a-9e0c-30f9d9bb0700-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp\" (UID: \"0eb16666-18b8-454a-9e0c-30f9d9bb0700\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:02.283738 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.283694    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c35b065b-c840-4791-86ca-03d303cc2e8a-plugins-config-volume\") pod \"payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz\" (UID: \"c35b065b-c840-4791-86ca-03d303cc2e8a\") " pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:02.291647 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.291613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fklj4\" (UniqueName: \"kubernetes.io/projected/0eb16666-18b8-454a-9e0c-30f9d9bb0700-kube-api-access-fklj4\") pod \"payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp\" (UID: \"0eb16666-18b8-454a-9e0c-30f9d9bb0700\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:02.291802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.291614    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k72fb\" (UniqueName: \"kubernetes.io/projected/c35b065b-c840-4791-86ca-03d303cc2e8a-kube-api-access-k72fb\") pod \"payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz\" (UID: \"c35b065b-c840-4791-86ca-03d303cc2e8a\") " pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:02.338236 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.338188    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:02.374600 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.374557    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:02.530486 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.530392    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"]
Jul 30 11:21:02.533154 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:21:02.533054    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb16666_18b8_454a_9e0c_30f9d9bb0700.slice/crio-0d88a198ce49046b46487e168651836d6ca6e01541bc65d272c3f95f74901f03 WatchSource:0}: Error finding container 0d88a198ce49046b46487e168651836d6ca6e01541bc65d272c3f95f74901f03: Status 404 returned error can't find the container with id 0d88a198ce49046b46487e168651836d6ca6e01541bc65d272c3f95f74901f03
Jul 30 11:21:02.542128 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.542099    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:21:02.562386 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.561691    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"]
Jul 30 11:21:02.577683 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:21:02.577647    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc35b065b_c840_4791_86ca_03d303cc2e8a.slice/crio-5de9d3b2825ce66b784318fda2310172acc61b7f50ef8097e35328bd0b664358 WatchSource:0}: Error finding container 5de9d3b2825ce66b784318fda2310172acc61b7f50ef8097e35328bd0b664358: Status 404 returned error can't find the container with id 5de9d3b2825ce66b784318fda2310172acc61b7f50ef8097e35328bd0b664358
Jul 30 11:21:02.688174 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688136    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-podinfo\") pod \"404e87e7-0579-4ea7-bc89-97b2149b871d\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") "
Jul 30 11:21:02.688174 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688187    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-certs\") pod \"404e87e7-0579-4ea7-bc89-97b2149b871d\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") "
Jul 30 11:21:02.688454 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688248    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-data\") pod \"404e87e7-0579-4ea7-bc89-97b2149b871d\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") "
Jul 30 11:21:02.688454 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688279    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-credential-socket\") pod \"404e87e7-0579-4ea7-bc89-97b2149b871d\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") "
Jul 30 11:21:02.688454 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688401    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnpbs\" (UniqueName: \"kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-kube-api-access-wnpbs\") pod \"404e87e7-0579-4ea7-bc89-97b2149b871d\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") "
Jul 30 11:21:02.688454 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688434    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-socket\") pod \"404e87e7-0579-4ea7-bc89-97b2149b871d\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") "
Jul 30 11:21:02.688660 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688492    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-envoy\") pod \"404e87e7-0579-4ea7-bc89-97b2149b871d\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") "
Jul 30 11:21:02.688660 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688516    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-data" (OuterVolumeSpecName: "istio-data") pod "404e87e7-0579-4ea7-bc89-97b2149b871d" (UID: "404e87e7-0579-4ea7-bc89-97b2149b871d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:21:02.688660 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688537    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/404e87e7-0579-4ea7-bc89-97b2149b871d-istiod-ca-cert\") pod \"404e87e7-0579-4ea7-bc89-97b2149b871d\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") "
Jul 30 11:21:02.688660 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688592    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-token\") pod \"404e87e7-0579-4ea7-bc89-97b2149b871d\" (UID: \"404e87e7-0579-4ea7-bc89-97b2149b871d\") "
Jul 30 11:21:02.688851 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688590    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "404e87e7-0579-4ea7-bc89-97b2149b871d" (UID: "404e87e7-0579-4ea7-bc89-97b2149b871d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:21:02.688851 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688660    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "404e87e7-0579-4ea7-bc89-97b2149b871d" (UID: "404e87e7-0579-4ea7-bc89-97b2149b871d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:21:02.688851 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688697    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "404e87e7-0579-4ea7-bc89-97b2149b871d" (UID: "404e87e7-0579-4ea7-bc89-97b2149b871d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:21:02.688999 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688858    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/404e87e7-0579-4ea7-bc89-97b2149b871d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "404e87e7-0579-4ea7-bc89-97b2149b871d" (UID: "404e87e7-0579-4ea7-bc89-97b2149b871d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:21:02.688999 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.688985    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-certs\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:02.689099 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.689005    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-data\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:02.689099 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.689018    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-credential-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:02.689099 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.689033    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-workload-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:02.689099 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.689047    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/404e87e7-0579-4ea7-bc89-97b2149b871d-istiod-ca-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:02.691042 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.691009    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "404e87e7-0579-4ea7-bc89-97b2149b871d" (UID: "404e87e7-0579-4ea7-bc89-97b2149b871d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:21:02.691304 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.691283    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-kube-api-access-wnpbs" (OuterVolumeSpecName: "kube-api-access-wnpbs") pod "404e87e7-0579-4ea7-bc89-97b2149b871d" (UID: "404e87e7-0579-4ea7-bc89-97b2149b871d"). InnerVolumeSpecName "kube-api-access-wnpbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:21:02.691375 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.691340    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-token" (OuterVolumeSpecName: "istio-token") pod "404e87e7-0579-4ea7-bc89-97b2149b871d" (UID: "404e87e7-0579-4ea7-bc89-97b2149b871d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:21:02.691412 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.691397    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "404e87e7-0579-4ea7-bc89-97b2149b871d" (UID: "404e87e7-0579-4ea7-bc89-97b2149b871d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 11:21:02.789803 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.789693    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnpbs\" (UniqueName: \"kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-kube-api-access-wnpbs\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:02.789803 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.789736    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-envoy\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:02.789803 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.789748    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-token\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:02.789803 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:02.789755    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/404e87e7-0579-4ea7-bc89-97b2149b871d-istio-podinfo\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:03.216167 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.216124    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k" event={"ID":"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a","Type":"ContainerStarted","Data":"20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272"}
Jul 30 11:21:03.216643 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.216281    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:03.217725 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.217694    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp" event={"ID":"0eb16666-18b8-454a-9e0c-30f9d9bb0700","Type":"ContainerStarted","Data":"eb978f1236da02a21d6a924526df3c31b4a0333b7e96e38d09d5d8270f376288"}
Jul 30 11:21:03.217876 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.217751    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp" event={"ID":"0eb16666-18b8-454a-9e0c-30f9d9bb0700","Type":"ContainerStarted","Data":"0d88a198ce49046b46487e168651836d6ca6e01541bc65d272c3f95f74901f03"}
Jul 30 11:21:03.217876 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.217780    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:03.219261 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.219213    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz" event={"ID":"c35b065b-c840-4791-86ca-03d303cc2e8a","Type":"ContainerStarted","Data":"730c93fcb16131207712ba08dde6e1fcd8178421e20dfb4337dc550980def095"}
Jul 30 11:21:03.219373 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.219285    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz" event={"ID":"c35b065b-c840-4791-86ca-03d303cc2e8a","Type":"ContainerStarted","Data":"5de9d3b2825ce66b784318fda2310172acc61b7f50ef8097e35328bd0b664358"}
Jul 30 11:21:03.219373 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.219314    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:03.220874 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.220850    2583 generic.go:356] "Generic (PLEG): container finished" podID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerID="621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb" exitCode=0
Jul 30 11:21:03.220966 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.220901    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"
Jul 30 11:21:03.220966 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.220924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" event={"ID":"404e87e7-0579-4ea7-bc89-97b2149b871d","Type":"ContainerDied","Data":"621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb"}
Jul 30 11:21:03.221036 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.220966    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65" event={"ID":"404e87e7-0579-4ea7-bc89-97b2149b871d","Type":"ContainerDied","Data":"5d5c0236854bf7574316b2b0019d93dfa33cad660416b40667f6ec3bf10f6d1b"}
Jul 30 11:21:03.221036 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.220998    2583 scope.go:117] "RemoveContainer" containerID="621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb"
Jul 30 11:21:03.232608 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.232582    2583 scope.go:117] "RemoveContainer" containerID="d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124"
Jul 30 11:21:03.236852 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.236800    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k" podStartSLOduration=1.906704179 podStartE2EDuration="2.236782864s" totalImagesPullingTime="330.078685ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:21:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:21:03.23382414 +0000 UTC m=+1967.342465661" watchObservedRunningTime="2026-07-30 11:21:03.236782864 +0000 UTC m=+1967.345424352"
Jul 30 11:21:03.243852 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.243831    2583 scope.go:117] "RemoveContainer" containerID="621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb"
Jul 30 11:21:03.244211 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:21:03.244189    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb\": container with ID starting with 621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb not found: ID does not exist" containerID="621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb"
Jul 30 11:21:03.244300 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.244221    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb"} err="failed to get container status \"621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb\": rpc error: code = NotFound desc = could not find container \"621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb\": container with ID starting with 621a7f720cd7fa887d5b228f76d46818f48a22b3150fcc40f6837f52b2863cbb not found: ID does not exist"
Jul 30 11:21:03.244300 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.244257    2583 scope.go:117] "RemoveContainer" containerID="d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124"
Jul 30 11:21:03.244567 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:21:03.244545    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124\": container with ID starting with d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124 not found: ID does not exist" containerID="d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124"
Jul 30 11:21:03.244615 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.244573    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124"} err="failed to get container status \"d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124\": rpc error: code = NotFound desc = could not find container \"d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124\": container with ID starting with d7769ab4acb3d0e1299d23fcc522e6ae8da1c6568fba41baa9ab431557284124 not found: ID does not exist"
Jul 30 11:21:03.251656 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.251604    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz" podStartSLOduration=1.251588003 podStartE2EDuration="1.251588003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:21:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:21:03.250059431 +0000 UTC m=+1967.358700927" watchObservedRunningTime="2026-07-30 11:21:03.251588003 +0000 UTC m=+1967.360229561"
Jul 30 11:21:03.266583 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.266530    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp" podStartSLOduration=2.2665083360000002 podStartE2EDuration="2.266508336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:21:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:21:03.266282109 +0000 UTC m=+1967.374923602" watchObservedRunningTime="2026-07-30 11:21:03.266508336 +0000 UTC m=+1967.375149828"
Jul 30 11:21:03.279789 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.279749    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"]
Jul 30 11:21:03.284162 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:03.284129    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-519ed3f7-openshift-default-5df779db7b-x4d65"]
Jul 30 11:21:04.464357 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:04.464322    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" path="/var/lib/kubelet/pods/404e87e7-0579-4ea7-bc89-97b2149b871d/volumes"
Jul 30 11:21:09.235936 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:09.235845    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:14.231756 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:14.231723    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:14.232172 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:14.231811    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:31.996692 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:31.996650    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"]
Jul 30 11:21:31.997219 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:31.996911    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k" podUID="41b801cf-3dcc-4739-bd22-01d3d3ab9b2a" containerName="maas-api" containerID="cri-o://20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272" gracePeriod=30
Jul 30 11:21:32.057949 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.057908    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"]
Jul 30 11:21:32.058240 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.058176    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz" podUID="c35b065b-c840-4791-86ca-03d303cc2e8a" containerName="payload-processing" containerID="cri-o://730c93fcb16131207712ba08dde6e1fcd8178421e20dfb4337dc550980def095" gracePeriod=30
Jul 30 11:21:32.064908 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.064870    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"]
Jul 30 11:21:32.065446 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.065386    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp" podUID="0eb16666-18b8-454a-9e0c-30f9d9bb0700" containerName="payload-pre-processing" containerID="cri-o://eb978f1236da02a21d6a924526df3c31b4a0333b7e96e38d09d5d8270f376288" gracePeriod=30
Jul 30 11:21:32.357249 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.353485    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:32.384851 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.384340    2583 generic.go:356] "Generic (PLEG): container finished" podID="41b801cf-3dcc-4739-bd22-01d3d3ab9b2a" containerID="20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272" exitCode=0
Jul 30 11:21:32.384851 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.384475    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"
Jul 30 11:21:32.384851 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.384488    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k" event={"ID":"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a","Type":"ContainerDied","Data":"20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272"}
Jul 30 11:21:32.384851 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.384565    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k" event={"ID":"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a","Type":"ContainerDied","Data":"d6a147001aa905b388577af84c8996fa1902a898686cdd66a78d371ad9e52495"}
Jul 30 11:21:32.384851 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.384599    2583 scope.go:117] "RemoveContainer" containerID="20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272"
Jul 30 11:21:32.387848 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.387811    2583 generic.go:356] "Generic (PLEG): container finished" podID="0eb16666-18b8-454a-9e0c-30f9d9bb0700" containerID="eb978f1236da02a21d6a924526df3c31b4a0333b7e96e38d09d5d8270f376288" exitCode=0
Jul 30 11:21:32.387957 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.387940    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp" event={"ID":"0eb16666-18b8-454a-9e0c-30f9d9bb0700","Type":"ContainerDied","Data":"eb978f1236da02a21d6a924526df3c31b4a0333b7e96e38d09d5d8270f376288"}
Jul 30 11:21:32.391514 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.391340    2583 generic.go:356] "Generic (PLEG): container finished" podID="c35b065b-c840-4791-86ca-03d303cc2e8a" containerID="730c93fcb16131207712ba08dde6e1fcd8178421e20dfb4337dc550980def095" exitCode=0
Jul 30 11:21:32.391514 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.391405    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz" event={"ID":"c35b065b-c840-4791-86ca-03d303cc2e8a","Type":"ContainerDied","Data":"730c93fcb16131207712ba08dde6e1fcd8178421e20dfb4337dc550980def095"}
Jul 30 11:21:32.402712 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.402679    2583 scope.go:117] "RemoveContainer" containerID="20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272"
Jul 30 11:21:32.403059 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:21:32.403033    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272\": container with ID starting with 20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272 not found: ID does not exist" containerID="20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272"
Jul 30 11:21:32.403195 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.403064    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272"} err="failed to get container status \"20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272\": rpc error: code = NotFound desc = could not find container \"20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272\": container with ID starting with 20f6667ddaf939b24158a8560bac81c4e95b8f9c8c4cad577caf3d25875be272 not found: ID does not exist"
Jul 30 11:21:32.405515 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.405491    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:32.426783 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.426112    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:32.492925 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.492880    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-maas-api-tls\") pod \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") "
Jul 30 11:21:32.492925 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.492929    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzs6m\" (UniqueName: \"kubernetes.io/projected/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-kube-api-access-zzs6m\") pod \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") "
Jul 30 11:21:32.493188 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.492993    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k72fb\" (UniqueName: \"kubernetes.io/projected/c35b065b-c840-4791-86ca-03d303cc2e8a-kube-api-access-k72fb\") pod \"c35b065b-c840-4791-86ca-03d303cc2e8a\" (UID: \"c35b065b-c840-4791-86ca-03d303cc2e8a\") "
Jul 30 11:21:32.493188 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.493026    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-openshift-service-ca\") pod \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\" (UID: \"41b801cf-3dcc-4739-bd22-01d3d3ab9b2a\") "
Jul 30 11:21:32.493188 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.493067    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fklj4\" (UniqueName: \"kubernetes.io/projected/0eb16666-18b8-454a-9e0c-30f9d9bb0700-kube-api-access-fklj4\") pod \"0eb16666-18b8-454a-9e0c-30f9d9bb0700\" (UID: \"0eb16666-18b8-454a-9e0c-30f9d9bb0700\") "
Jul 30 11:21:32.493188 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.493088    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c35b065b-c840-4791-86ca-03d303cc2e8a-plugins-config-volume\") pod \"c35b065b-c840-4791-86ca-03d303cc2e8a\" (UID: \"c35b065b-c840-4791-86ca-03d303cc2e8a\") "
Jul 30 11:21:32.493188 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.493166    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eb16666-18b8-454a-9e0c-30f9d9bb0700-plugins-config-volume\") pod \"0eb16666-18b8-454a-9e0c-30f9d9bb0700\" (UID: \"0eb16666-18b8-454a-9e0c-30f9d9bb0700\") "
Jul 30 11:21:32.493516 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.493483    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "41b801cf-3dcc-4739-bd22-01d3d3ab9b2a" (UID: "41b801cf-3dcc-4739-bd22-01d3d3ab9b2a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:21:32.493809 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.493767    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c35b065b-c840-4791-86ca-03d303cc2e8a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c35b065b-c840-4791-86ca-03d303cc2e8a" (UID: "c35b065b-c840-4791-86ca-03d303cc2e8a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:21:32.493809 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.493791    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eb16666-18b8-454a-9e0c-30f9d9bb0700-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0eb16666-18b8-454a-9e0c-30f9d9bb0700" (UID: "0eb16666-18b8-454a-9e0c-30f9d9bb0700"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:21:32.495212 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.495188    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "41b801cf-3dcc-4739-bd22-01d3d3ab9b2a" (UID: "41b801cf-3dcc-4739-bd22-01d3d3ab9b2a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 11:21:32.495331 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.495306    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c35b065b-c840-4791-86ca-03d303cc2e8a-kube-api-access-k72fb" (OuterVolumeSpecName: "kube-api-access-k72fb") pod "c35b065b-c840-4791-86ca-03d303cc2e8a" (UID: "c35b065b-c840-4791-86ca-03d303cc2e8a"). InnerVolumeSpecName "kube-api-access-k72fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:21:32.495622 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.495592    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-kube-api-access-zzs6m" (OuterVolumeSpecName: "kube-api-access-zzs6m") pod "41b801cf-3dcc-4739-bd22-01d3d3ab9b2a" (UID: "41b801cf-3dcc-4739-bd22-01d3d3ab9b2a"). InnerVolumeSpecName "kube-api-access-zzs6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:21:32.495683 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.495628    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb16666-18b8-454a-9e0c-30f9d9bb0700-kube-api-access-fklj4" (OuterVolumeSpecName: "kube-api-access-fklj4") pod "0eb16666-18b8-454a-9e0c-30f9d9bb0700" (UID: "0eb16666-18b8-454a-9e0c-30f9d9bb0700"). InnerVolumeSpecName "kube-api-access-fklj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:21:32.594978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.594877    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-maas-api-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:32.594978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.594915    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzs6m\" (UniqueName: \"kubernetes.io/projected/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-kube-api-access-zzs6m\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:32.594978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.594950    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k72fb\" (UniqueName: \"kubernetes.io/projected/c35b065b-c840-4791-86ca-03d303cc2e8a-kube-api-access-k72fb\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:32.594978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.594963    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a-openshift-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:32.594978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.594972    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fklj4\" (UniqueName: \"kubernetes.io/projected/0eb16666-18b8-454a-9e0c-30f9d9bb0700-kube-api-access-fklj4\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:32.594978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.594983    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c35b065b-c840-4791-86ca-03d303cc2e8a-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:32.595345 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.594992    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eb16666-18b8-454a-9e0c-30f9d9bb0700-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:21:32.706427 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.706387    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"]
Jul 30 11:21:32.710237 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:32.710190    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-772a6e1a-697bb587cb-8s77k"]
Jul 30 11:21:33.398651 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:33.398556    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"
Jul 30 11:21:33.398651 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:33.398555    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp" event={"ID":"0eb16666-18b8-454a-9e0c-30f9d9bb0700","Type":"ContainerDied","Data":"0d88a198ce49046b46487e168651836d6ca6e01541bc65d272c3f95f74901f03"}
Jul 30 11:21:33.399299 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:33.398704    2583 scope.go:117] "RemoveContainer" containerID="eb978f1236da02a21d6a924526df3c31b4a0333b7e96e38d09d5d8270f376288"
Jul 30 11:21:33.400151 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:33.400028    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"
Jul 30 11:21:33.400151 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:33.400039    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz" event={"ID":"c35b065b-c840-4791-86ca-03d303cc2e8a","Type":"ContainerDied","Data":"5de9d3b2825ce66b784318fda2310172acc61b7f50ef8097e35328bd0b664358"}
Jul 30 11:21:33.409593 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:33.409570    2583 scope.go:117] "RemoveContainer" containerID="730c93fcb16131207712ba08dde6e1fcd8178421e20dfb4337dc550980def095"
Jul 30 11:21:33.423016 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:33.422979    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"]
Jul 30 11:21:33.430863 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:33.430828    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-772a6e1a-9f5d85956-pmdmp"]
Jul 30 11:21:33.442381 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:33.442342    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"]
Jul 30 11:21:33.444664 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:33.444635    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-772a6e1a-5d77d567d6-fdzdz"]
Jul 30 11:21:34.461262 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:34.461213    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eb16666-18b8-454a-9e0c-30f9d9bb0700" path="/var/lib/kubelet/pods/0eb16666-18b8-454a-9e0c-30f9d9bb0700/volumes"
Jul 30 11:21:34.461653 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:34.461635    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41b801cf-3dcc-4739-bd22-01d3d3ab9b2a" path="/var/lib/kubelet/pods/41b801cf-3dcc-4739-bd22-01d3d3ab9b2a/volumes"
Jul 30 11:21:34.461956 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:21:34.461941    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c35b065b-c840-4791-86ca-03d303cc2e8a" path="/var/lib/kubelet/pods/c35b065b-c840-4791-86ca-03d303cc2e8a/volumes"
Jul 30 11:23:32.751997 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.751958    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"]
Jul 30 11:23:32.752585 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752565    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b801cf-3dcc-4739-bd22-01d3d3ab9b2a" containerName="maas-api"
Jul 30 11:23:32.752634 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752589    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b801cf-3dcc-4739-bd22-01d3d3ab9b2a" containerName="maas-api"
Jul 30 11:23:32.752634 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752604    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy"
Jul 30 11:23:32.752634 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752614    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy"
Jul 30 11:23:32.752634 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752624    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy"
Jul 30 11:23:32.752634 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752633    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy"
Jul 30 11:23:32.752798 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752654    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c35b065b-c840-4791-86ca-03d303cc2e8a" containerName="payload-processing"
Jul 30 11:23:32.752798 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752663    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c35b065b-c840-4791-86ca-03d303cc2e8a" containerName="payload-processing"
Jul 30 11:23:32.752798 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752679    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb16666-18b8-454a-9e0c-30f9d9bb0700" containerName="payload-pre-processing"
Jul 30 11:23:32.752798 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752687    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb16666-18b8-454a-9e0c-30f9d9bb0700" containerName="payload-pre-processing"
Jul 30 11:23:32.752920 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752807    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="41b801cf-3dcc-4739-bd22-01d3d3ab9b2a" containerName="maas-api"
Jul 30 11:23:32.752920 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752824    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb16666-18b8-454a-9e0c-30f9d9bb0700" containerName="payload-pre-processing"
Jul 30 11:23:32.752920 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752836    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy"
Jul 30 11:23:32.752920 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752844    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c35b065b-c840-4791-86ca-03d303cc2e8a" containerName="payload-processing"
Jul 30 11:23:32.752920 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.752854    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="404e87e7-0579-4ea7-bc89-97b2149b871d" containerName="istio-proxy"
Jul 30 11:23:32.756469 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.756446    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.759166 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.759143    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-203e4c55-openshift-default-dockercfg-wpktv\""
Jul 30 11:23:32.776455 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.776416    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"]
Jul 30 11:23:32.824401 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.824359    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-certs\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.824599 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.824432    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-token\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.824599 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.824475    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-envoy\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.824599 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.824494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-data\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.824599 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.824523    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbs8m\" (UniqueName: \"kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-kube-api-access-fbs8m\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.824599 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.824556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-podinfo\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.824843 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.824673    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-socket\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.824843 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.824717    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-credential-socket\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.824843 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.824781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istiod-ca-cert\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.926316 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.926279    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istiod-ca-cert\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.926488 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.926332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-certs\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.926488 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.926373    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-token\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.926488 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.926405    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-envoy\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.926488 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.926426    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-data\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.926488 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.926450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbs8m\" (UniqueName: \"kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-kube-api-access-fbs8m\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.926774 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.926502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-podinfo\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.926774 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.926565    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-socket\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.926774 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.926598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-credential-socket\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.927387 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.927106    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-socket\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.927387 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.927142    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-credential-socket\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.927387 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.927189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istiod-ca-cert\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.927387 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.927358    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-certs\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.927387 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.927384    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-data\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.929040 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.929017    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-envoy\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.929369 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.929345    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-podinfo\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.936058 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.936028    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbs8m\" (UniqueName: \"kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-kube-api-access-fbs8m\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:32.936162 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:32.936031    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-token\") pod \"e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") " pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:33.067834 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:33.067736    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:33.216526 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:33.216500    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"]
Jul 30 11:23:33.218876 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:23:33.218840    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf32105_957b_407a_9d2f_2cefb2eec1f6.slice/crio-42ff375f9acc7af84a84ef571ced9df2d588fccc8cce5125fb664670bd71d3ac WatchSource:0}: Error finding container 42ff375f9acc7af84a84ef571ced9df2d588fccc8cce5125fb664670bd71d3ac: Status 404 returned error can't find the container with id 42ff375f9acc7af84a84ef571ced9df2d588fccc8cce5125fb664670bd71d3ac
Jul 30 11:23:33.221176 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:33.221141    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:23:33.221318 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:33.221211    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:23:33.221318 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:33.221257    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:23:34.002514 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:34.002470    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" event={"ID":"bbf32105-957b-407a-9d2f-2cefb2eec1f6","Type":"ContainerStarted","Data":"7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824"}
Jul 30 11:23:34.002970 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:34.002536    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" event={"ID":"bbf32105-957b-407a-9d2f-2cefb2eec1f6","Type":"ContainerStarted","Data":"42ff375f9acc7af84a84ef571ced9df2d588fccc8cce5125fb664670bd71d3ac"}
Jul 30 11:23:34.029770 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:34.029706    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" podStartSLOduration=2.029679479 podStartE2EDuration="2.029679479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:23:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:23:34.027047861 +0000 UTC m=+2118.135689354" watchObservedRunningTime="2026-07-30 11:23:34.029679479 +0000 UTC m=+2118.138320974"
Jul 30 11:23:34.068817 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:34.068763    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:34.074021 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:34.073993    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:35.007468 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:35.007436    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:35.008483 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:35.008462    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:37.695985 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.695945    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"]
Jul 30 11:23:37.699873 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.699850    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:37.702833 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.702687    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-203e4c55-serving-cert\""
Jul 30 11:23:37.702833 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.702705    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 11:23:37.703058 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.703029    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gvjcm\""
Jul 30 11:23:37.703124 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.703069    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 11:23:37.711308 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.711282    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"]
Jul 30 11:23:37.778475 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.778437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqslj\" (UniqueName: \"kubernetes.io/projected/a3fd550f-0d55-4fc7-887e-6abd67b42aff-kube-api-access-vqslj\") pod \"maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:37.778672 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.778492    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3fd550f-0d55-4fc7-887e-6abd67b42aff-openshift-service-ca\") pod \"maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:37.778672 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.778610    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3fd550f-0d55-4fc7-887e-6abd67b42aff-maas-api-tls\") pod \"maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:37.880122 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.880081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqslj\" (UniqueName: \"kubernetes.io/projected/a3fd550f-0d55-4fc7-887e-6abd67b42aff-kube-api-access-vqslj\") pod \"maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:37.880122 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.880126    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3fd550f-0d55-4fc7-887e-6abd67b42aff-openshift-service-ca\") pod \"maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:37.880400 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.880172    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3fd550f-0d55-4fc7-887e-6abd67b42aff-maas-api-tls\") pod \"maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:37.880400 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:23:37.880299    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-serving-cert: secret "maas-api-e2e-mt-203e4c55-serving-cert" not found
Jul 30 11:23:37.880400 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:23:37.880369    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3fd550f-0d55-4fc7-887e-6abd67b42aff-maas-api-tls podName:a3fd550f-0d55-4fc7-887e-6abd67b42aff nodeName:}" failed. No retries permitted until 2026-07-30 11:23:38.380353138 +0000 UTC m=+2122.488994608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a3fd550f-0d55-4fc7-887e-6abd67b42aff-maas-api-tls") pod "maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s" (UID: "a3fd550f-0d55-4fc7-887e-6abd67b42aff") : secret "maas-api-e2e-mt-203e4c55-serving-cert" not found
Jul 30 11:23:37.880858 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.880836    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3fd550f-0d55-4fc7-887e-6abd67b42aff-openshift-service-ca\") pod \"maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:37.891571 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:37.891544    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqslj\" (UniqueName: \"kubernetes.io/projected/a3fd550f-0d55-4fc7-887e-6abd67b42aff-kube-api-access-vqslj\") pod \"maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:38.319614 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.319577    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"]
Jul 30 11:23:38.323149 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.323129    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:23:38.325759 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.325727    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-203e4c55\""
Jul 30 11:23:38.333707 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.333677    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"]
Jul 30 11:23:38.383969 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.383934    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3fd550f-0d55-4fc7-887e-6abd67b42aff-maas-api-tls\") pod \"maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:38.386460 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.386425    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3fd550f-0d55-4fc7-887e-6abd67b42aff-maas-api-tls\") pod \"maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:38.485459 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.485410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqs78\" (UniqueName: \"kubernetes.io/projected/b9cbd7de-bb03-461f-bbe9-16279c567566-kube-api-access-nqs78\") pod \"payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v\" (UID: \"b9cbd7de-bb03-461f-bbe9-16279c567566\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:23:38.485641 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.485492    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9cbd7de-bb03-461f-bbe9-16279c567566-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v\" (UID: \"b9cbd7de-bb03-461f-bbe9-16279c567566\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:23:38.586487 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.586390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqs78\" (UniqueName: \"kubernetes.io/projected/b9cbd7de-bb03-461f-bbe9-16279c567566-kube-api-access-nqs78\") pod \"payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v\" (UID: \"b9cbd7de-bb03-461f-bbe9-16279c567566\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:23:38.586655 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.586488    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9cbd7de-bb03-461f-bbe9-16279c567566-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v\" (UID: \"b9cbd7de-bb03-461f-bbe9-16279c567566\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:23:38.587167 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.587146    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9cbd7de-bb03-461f-bbe9-16279c567566-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v\" (UID: \"b9cbd7de-bb03-461f-bbe9-16279c567566\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:23:38.595604 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.595570    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqs78\" (UniqueName: \"kubernetes.io/projected/b9cbd7de-bb03-461f-bbe9-16279c567566-kube-api-access-nqs78\") pod \"payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v\" (UID: \"b9cbd7de-bb03-461f-bbe9-16279c567566\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:23:38.615480 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.615437    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:38.636832 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.636794    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:23:38.778550 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.778515    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"]
Jul 30 11:23:38.780211 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:23:38.780167    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3fd550f_0d55_4fc7_887e_6abd67b42aff.slice/crio-4a4c58ba52e96d5bdb34b66ac5f1d40cb666854a8088f1f65edafb8564779b5c WatchSource:0}: Error finding container 4a4c58ba52e96d5bdb34b66ac5f1d40cb666854a8088f1f65edafb8564779b5c: Status 404 returned error can't find the container with id 4a4c58ba52e96d5bdb34b66ac5f1d40cb666854a8088f1f65edafb8564779b5c
Jul 30 11:23:38.801046 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:38.801024    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"]
Jul 30 11:23:38.803238 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:23:38.803200    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9cbd7de_bb03_461f_bbe9_16279c567566.slice/crio-dfc3e2a83ef0d9a191af55bad867899837927a9a56ea5bee555eb76b00f25da5 WatchSource:0}: Error finding container dfc3e2a83ef0d9a191af55bad867899837927a9a56ea5bee555eb76b00f25da5: Status 404 returned error can't find the container with id dfc3e2a83ef0d9a191af55bad867899837927a9a56ea5bee555eb76b00f25da5
Jul 30 11:23:39.029214 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:39.029168    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v" event={"ID":"b9cbd7de-bb03-461f-bbe9-16279c567566","Type":"ContainerStarted","Data":"0297700a5967b9a0f415a926815777250e2fa312855427159a53ca8dad37cc6e"}
Jul 30 11:23:39.029428 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:39.029264    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v" event={"ID":"b9cbd7de-bb03-461f-bbe9-16279c567566","Type":"ContainerStarted","Data":"dfc3e2a83ef0d9a191af55bad867899837927a9a56ea5bee555eb76b00f25da5"}
Jul 30 11:23:39.029428 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:39.029298    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:23:39.030777 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:39.030752    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s" event={"ID":"a3fd550f-0d55-4fc7-887e-6abd67b42aff","Type":"ContainerStarted","Data":"4a4c58ba52e96d5bdb34b66ac5f1d40cb666854a8088f1f65edafb8564779b5c"}
Jul 30 11:23:39.046558 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:39.046502    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v" podStartSLOduration=1.046484523 podStartE2EDuration="1.046484523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:23:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:23:39.045481616 +0000 UTC m=+2123.154123108" watchObservedRunningTime="2026-07-30 11:23:39.046484523 +0000 UTC m=+2123.155126014"
Jul 30 11:23:40.037791 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:40.037741    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s" event={"ID":"a3fd550f-0d55-4fc7-887e-6abd67b42aff","Type":"ContainerStarted","Data":"d5daacba0cfb11e58532bcffc34fa74f995fd3249923a33d8f8dedad8e99b272"}
Jul 30 11:23:40.064683 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:40.064620    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s" podStartSLOduration=2.341177233 podStartE2EDuration="3.064602861s" totalImagesPullingTime="723.425628ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:23:40.062845 +0000 UTC m=+2124.171486491" watchObservedRunningTime="2026-07-30 11:23:40.064602861 +0000 UTC m=+2124.173244353"
Jul 30 11:23:41.044085 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:41.044050    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:47.057822 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:47.057729    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:23:50.040255 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:50.040203    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:23:50.166155 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:50.165572    2583 patch_prober.go:28] interesting pod/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:40956->10.134.0.44:15021: read: connection reset by peer" start-of-body=
Jul 30 11:23:50.166155 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:50.165658    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:40956->10.134.0.44:15021: read: connection reset by peer"
Jul 30 11:23:51.100525 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:51.100493    2583 generic.go:356] "Generic (PLEG): container finished" podID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerID="7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824" exitCode=0
Jul 30 11:23:51.100934 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:51.100576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" event={"ID":"bbf32105-957b-407a-9d2f-2cefb2eec1f6","Type":"ContainerDied","Data":"7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824"}
Jul 30 11:23:51.100987 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:51.100975    2583 scope.go:117] "RemoveContainer" containerID="7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824"
Jul 30 11:23:51.102071 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:51.102046    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:23:51.102141 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:51.102116    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:23:51.102184 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:51.102147    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:23:52.107993 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:52.107958    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" event={"ID":"bbf32105-957b-407a-9d2f-2cefb2eec1f6","Type":"ContainerStarted","Data":"f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef"}
Jul 30 11:23:53.068991 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:53.068942    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:53.069199 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:53.069174    2583 patch_prober.go:28] interesting pod/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 30 11:23:53.069300 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:53.069256    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 30 11:23:54.068468 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:54.068425    2583 patch_prober.go:28] interesting pod/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 30 11:23:54.068905 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:54.068500    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 30 11:23:55.068331 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:55.068294    2583 patch_prober.go:28] interesting pod/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 30 11:23:55.068524 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:55.068368    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 30 11:23:56.068645 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:56.068601    2583 patch_prober.go:28] interesting pod/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 30 11:23:56.069065 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:56.068664    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 30 11:23:57.068982 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:57.068948    2583 patch_prober.go:28] interesting pod/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 30 11:23:57.069396 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:57.069006    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 30 11:23:58.072805 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:58.072755    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:58.073315 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:58.073039    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:23:58.074030 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:23:58.074010    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:24:02.932434 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:02.932393    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"]
Jul 30 11:24:02.932901 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:02.932651    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s" podUID="a3fd550f-0d55-4fc7-887e-6abd67b42aff" containerName="maas-api" containerID="cri-o://d5daacba0cfb11e58532bcffc34fa74f995fd3249923a33d8f8dedad8e99b272" gracePeriod=30
Jul 30 11:24:02.992385 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:02.992344    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"]
Jul 30 11:24:02.992860 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:02.992798    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v" podUID="b9cbd7de-bb03-461f-bbe9-16279c567566" containerName="payload-pre-processing" containerID="cri-o://0297700a5967b9a0f415a926815777250e2fa312855427159a53ca8dad37cc6e" gracePeriod=30
Jul 30 11:24:03.181286 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.181153    2583 generic.go:356] "Generic (PLEG): container finished" podID="b9cbd7de-bb03-461f-bbe9-16279c567566" containerID="0297700a5967b9a0f415a926815777250e2fa312855427159a53ca8dad37cc6e" exitCode=0
Jul 30 11:24:03.181286 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.181191    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v" event={"ID":"b9cbd7de-bb03-461f-bbe9-16279c567566","Type":"ContainerDied","Data":"0297700a5967b9a0f415a926815777250e2fa312855427159a53ca8dad37cc6e"}
Jul 30 11:24:03.183261 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.183079    2583 generic.go:356] "Generic (PLEG): container finished" podID="a3fd550f-0d55-4fc7-887e-6abd67b42aff" containerID="d5daacba0cfb11e58532bcffc34fa74f995fd3249923a33d8f8dedad8e99b272" exitCode=0
Jul 30 11:24:03.183261 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.183157    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s" event={"ID":"a3fd550f-0d55-4fc7-887e-6abd67b42aff","Type":"ContainerDied","Data":"d5daacba0cfb11e58532bcffc34fa74f995fd3249923a33d8f8dedad8e99b272"}
Jul 30 11:24:03.282538 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.282191    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:24:03.288017 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.287971    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:24:03.360767 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.360733    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3fd550f-0d55-4fc7-887e-6abd67b42aff-maas-api-tls\") pod \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") "
Jul 30 11:24:03.361009 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.360795    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqs78\" (UniqueName: \"kubernetes.io/projected/b9cbd7de-bb03-461f-bbe9-16279c567566-kube-api-access-nqs78\") pod \"b9cbd7de-bb03-461f-bbe9-16279c567566\" (UID: \"b9cbd7de-bb03-461f-bbe9-16279c567566\") "
Jul 30 11:24:03.361009 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.360828    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3fd550f-0d55-4fc7-887e-6abd67b42aff-openshift-service-ca\") pod \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") "
Jul 30 11:24:03.361009 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.360954    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqslj\" (UniqueName: \"kubernetes.io/projected/a3fd550f-0d55-4fc7-887e-6abd67b42aff-kube-api-access-vqslj\") pod \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\" (UID: \"a3fd550f-0d55-4fc7-887e-6abd67b42aff\") "
Jul 30 11:24:03.361009 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.360999    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9cbd7de-bb03-461f-bbe9-16279c567566-plugins-config-volume\") pod \"b9cbd7de-bb03-461f-bbe9-16279c567566\" (UID: \"b9cbd7de-bb03-461f-bbe9-16279c567566\") "
Jul 30 11:24:03.361277 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.361243    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3fd550f-0d55-4fc7-887e-6abd67b42aff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a3fd550f-0d55-4fc7-887e-6abd67b42aff" (UID: "a3fd550f-0d55-4fc7-887e-6abd67b42aff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:24:03.361491 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.361462    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9cbd7de-bb03-461f-bbe9-16279c567566-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b9cbd7de-bb03-461f-bbe9-16279c567566" (UID: "b9cbd7de-bb03-461f-bbe9-16279c567566"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:24:03.361607 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.361497    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3fd550f-0d55-4fc7-887e-6abd67b42aff-openshift-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:03.363184 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.363151    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3fd550f-0d55-4fc7-887e-6abd67b42aff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a3fd550f-0d55-4fc7-887e-6abd67b42aff" (UID: "a3fd550f-0d55-4fc7-887e-6abd67b42aff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 11:24:03.363317 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.363154    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3fd550f-0d55-4fc7-887e-6abd67b42aff-kube-api-access-vqslj" (OuterVolumeSpecName: "kube-api-access-vqslj") pod "a3fd550f-0d55-4fc7-887e-6abd67b42aff" (UID: "a3fd550f-0d55-4fc7-887e-6abd67b42aff"). InnerVolumeSpecName "kube-api-access-vqslj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:24:03.363317 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.363258    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9cbd7de-bb03-461f-bbe9-16279c567566-kube-api-access-nqs78" (OuterVolumeSpecName: "kube-api-access-nqs78") pod "b9cbd7de-bb03-461f-bbe9-16279c567566" (UID: "b9cbd7de-bb03-461f-bbe9-16279c567566"). InnerVolumeSpecName "kube-api-access-nqs78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:24:03.462086 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.461995    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqslj\" (UniqueName: \"kubernetes.io/projected/a3fd550f-0d55-4fc7-887e-6abd67b42aff-kube-api-access-vqslj\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:03.462086 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.462030    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9cbd7de-bb03-461f-bbe9-16279c567566-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:03.462086 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.462040    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3fd550f-0d55-4fc7-887e-6abd67b42aff-maas-api-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:03.462086 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:03.462052    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqs78\" (UniqueName: \"kubernetes.io/projected/b9cbd7de-bb03-461f-bbe9-16279c567566-kube-api-access-nqs78\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:04.190200 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.190170    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"
Jul 30 11:24:04.190200 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.190181    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v" event={"ID":"b9cbd7de-bb03-461f-bbe9-16279c567566","Type":"ContainerDied","Data":"dfc3e2a83ef0d9a191af55bad867899837927a9a56ea5bee555eb76b00f25da5"}
Jul 30 11:24:04.190790 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.190269    2583 scope.go:117] "RemoveContainer" containerID="0297700a5967b9a0f415a926815777250e2fa312855427159a53ca8dad37cc6e"
Jul 30 11:24:04.191679 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.191656    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"
Jul 30 11:24:04.191765 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.191721    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s" event={"ID":"a3fd550f-0d55-4fc7-887e-6abd67b42aff","Type":"ContainerDied","Data":"4a4c58ba52e96d5bdb34b66ac5f1d40cb666854a8088f1f65edafb8564779b5c"}
Jul 30 11:24:04.203882 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.203309    2583 scope.go:117] "RemoveContainer" containerID="d5daacba0cfb11e58532bcffc34fa74f995fd3249923a33d8f8dedad8e99b272"
Jul 30 11:24:04.223755 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.223719    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"]
Jul 30 11:24:04.228013 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.227975    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-203e4c55-555c459cd8-kr22v"]
Jul 30 11:24:04.238583 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.238546    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"]
Jul 30 11:24:04.242126 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.242092    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-203e4c55-7c9985f9f5-kcr7s"]
Jul 30 11:24:04.462569 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.462467    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3fd550f-0d55-4fc7-887e-6abd67b42aff" path="/var/lib/kubelet/pods/a3fd550f-0d55-4fc7-887e-6abd67b42aff/volumes"
Jul 30 11:24:04.462973 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:04.462950    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9cbd7de-bb03-461f-bbe9-16279c567566" path="/var/lib/kubelet/pods/b9cbd7de-bb03-461f-bbe9-16279c567566/volumes"
Jul 30 11:24:09.908483 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:09.908399    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"]
Jul 30 11:24:09.908941 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:09.908627    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy" containerID="cri-o://f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef" gracePeriod=30
Jul 30 11:24:13.075289 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:13.075242    2583 patch_prober.go:28] interesting pod/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 11:24:13.075756 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:13.075331    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 11:24:15.174871 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.174797    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:24:15.249082 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.249045    2583 generic.go:356] "Generic (PLEG): container finished" podID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerID="f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef" exitCode=0
Jul 30 11:24:15.249300 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.249097    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"
Jul 30 11:24:15.249300 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.249098    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" event={"ID":"bbf32105-957b-407a-9d2f-2cefb2eec1f6","Type":"ContainerDied","Data":"f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef"}
Jul 30 11:24:15.249300 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.249163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz" event={"ID":"bbf32105-957b-407a-9d2f-2cefb2eec1f6","Type":"ContainerDied","Data":"42ff375f9acc7af84a84ef571ced9df2d588fccc8cce5125fb664670bd71d3ac"}
Jul 30 11:24:15.249300 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.249194    2583 scope.go:117] "RemoveContainer" containerID="f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef"
Jul 30 11:24:15.258632 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.258611    2583 scope.go:117] "RemoveContainer" containerID="7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824"
Jul 30 11:24:15.267435 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.267415    2583 scope.go:117] "RemoveContainer" containerID="f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef"
Jul 30 11:24:15.267782 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:24:15.267765    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef\": container with ID starting with f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef not found: ID does not exist" containerID="f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef"
Jul 30 11:24:15.267844 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.267792    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef"} err="failed to get container status \"f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef\": rpc error: code = NotFound desc = could not find container \"f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef\": container with ID starting with f15e43dc2c96f3d8c5dfdf079622b72b4959913f7919d6bdee477e71ab53b5ef not found: ID does not exist"
Jul 30 11:24:15.267844 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.267812    2583 scope.go:117] "RemoveContainer" containerID="7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824"
Jul 30 11:24:15.268033 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:24:15.268017    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824\": container with ID starting with 7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824 not found: ID does not exist" containerID="7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824"
Jul 30 11:24:15.268083 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.268036    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824"} err="failed to get container status \"7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824\": rpc error: code = NotFound desc = could not find container \"7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824\": container with ID starting with 7eaf0e8841a9eaff925d386161a1f30d0afdc7c14f4710a3e19cb8429d0d8824 not found: ID does not exist"
Jul 30 11:24:15.286451 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286415    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-podinfo\") pod \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") "
Jul 30 11:24:15.286617 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286480    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-envoy\") pod \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") "
Jul 30 11:24:15.286617 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286505    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-certs\") pod \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") "
Jul 30 11:24:15.286725 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286611    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-socket\") pod \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") "
Jul 30 11:24:15.286725 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286648    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-credential-socket\") pod \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") "
Jul 30 11:24:15.286831 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286724    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istiod-ca-cert\") pod \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") "
Jul 30 11:24:15.286831 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-data\") pod \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") "
Jul 30 11:24:15.286831 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286817    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bbf32105-957b-407a-9d2f-2cefb2eec1f6" (UID: "bbf32105-957b-407a-9d2f-2cefb2eec1f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:24:15.286978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286826    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbs8m\" (UniqueName: \"kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-kube-api-access-fbs8m\") pod \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") "
Jul 30 11:24:15.286978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286861    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bbf32105-957b-407a-9d2f-2cefb2eec1f6" (UID: "bbf32105-957b-407a-9d2f-2cefb2eec1f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:24:15.286978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286906    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-token\") pod \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\" (UID: \"bbf32105-957b-407a-9d2f-2cefb2eec1f6\") "
Jul 30 11:24:15.286978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.286958    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bbf32105-957b-407a-9d2f-2cefb2eec1f6" (UID: "bbf32105-957b-407a-9d2f-2cefb2eec1f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:24:15.287159 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.287058    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "bbf32105-957b-407a-9d2f-2cefb2eec1f6" (UID: "bbf32105-957b-407a-9d2f-2cefb2eec1f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:24:15.287376 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.287355    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-data\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:15.287462 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.287380    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-certs\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:15.287462 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.287405    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-workload-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:15.287462 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.287419    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-credential-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:15.287462 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.287442    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bbf32105-957b-407a-9d2f-2cefb2eec1f6" (UID: "bbf32105-957b-407a-9d2f-2cefb2eec1f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:24:15.288890 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.288865    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bbf32105-957b-407a-9d2f-2cefb2eec1f6" (UID: "bbf32105-957b-407a-9d2f-2cefb2eec1f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:24:15.288984 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.288886    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-kube-api-access-fbs8m" (OuterVolumeSpecName: "kube-api-access-fbs8m") pod "bbf32105-957b-407a-9d2f-2cefb2eec1f6" (UID: "bbf32105-957b-407a-9d2f-2cefb2eec1f6"). InnerVolumeSpecName "kube-api-access-fbs8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:24:15.289063 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.289043    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bbf32105-957b-407a-9d2f-2cefb2eec1f6" (UID: "bbf32105-957b-407a-9d2f-2cefb2eec1f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 11:24:15.289216 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.289194    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "bbf32105-957b-407a-9d2f-2cefb2eec1f6" (UID: "bbf32105-957b-407a-9d2f-2cefb2eec1f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:24:15.388606 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.388558    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-podinfo\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:15.388606 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.388596    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-envoy\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:15.388606 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.388611    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istiod-ca-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:15.388863 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.388623    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbs8m\" (UniqueName: \"kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-kube-api-access-fbs8m\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:15.388863 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.388637    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbf32105-957b-407a-9d2f-2cefb2eec1f6-istio-token\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:24:15.580200 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.580160    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"]
Jul 30 11:24:15.586409 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:15.586372    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-203e4c55-openshift-default-585c66fffb-qknmz"]
Jul 30 11:24:16.461114 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:24:16.461080    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" path="/var/lib/kubelet/pods/bbf32105-957b-407a-9d2f-2cefb2eec1f6/volumes"
Jul 30 11:26:25.590340 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.590293    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"]
Jul 30 11:26:25.590989 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.590920    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy"
Jul 30 11:26:25.590989 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.590942    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy"
Jul 30 11:26:25.590989 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.590965    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy"
Jul 30 11:26:25.590989 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.590974    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy"
Jul 30 11:26:25.590989 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.590982    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3fd550f-0d55-4fc7-887e-6abd67b42aff" containerName="maas-api"
Jul 30 11:26:25.590989 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.590990    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3fd550f-0d55-4fc7-887e-6abd67b42aff" containerName="maas-api"
Jul 30 11:26:25.591344 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.591016    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9cbd7de-bb03-461f-bbe9-16279c567566" containerName="payload-pre-processing"
Jul 30 11:26:25.591344 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.591025    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9cbd7de-bb03-461f-bbe9-16279c567566" containerName="payload-pre-processing"
Jul 30 11:26:25.591344 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.591117    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9cbd7de-bb03-461f-bbe9-16279c567566" containerName="payload-pre-processing"
Jul 30 11:26:25.591344 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.591131    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy"
Jul 30 11:26:25.591344 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.591140    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf32105-957b-407a-9d2f-2cefb2eec1f6" containerName="istio-proxy"
Jul 30 11:26:25.591344 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.591151    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3fd550f-0d55-4fc7-887e-6abd67b42aff" containerName="maas-api"
Jul 30 11:26:25.593557 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.593536    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.596386 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.596359    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6bccc947-openshift-default-dockercfg-sdt58\""
Jul 30 11:26:25.605988 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.605959    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"]
Jul 30 11:26:25.653350 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.653307    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istiod-ca-cert\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.653350 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.653355    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5zg5\" (UniqueName: \"kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-kube-api-access-d5zg5\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.653579 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.653375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-credential-socket\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.653579 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.653466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-data\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.653579 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.653486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-envoy\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.653579 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.653508    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-podinfo\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.653579 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.653526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-token\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.653579 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.653546    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-certs\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.653821 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.653628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-socket\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.754413 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.754373    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istiod-ca-cert\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.754413 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.754414    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5zg5\" (UniqueName: \"kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-kube-api-access-d5zg5\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.754673 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.754437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-credential-socket\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.754673 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.754616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-data\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.754673 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.754666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-envoy\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.754849 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.754703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-podinfo\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.754849 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.754731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-token\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.754849 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.754762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-certs\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.754849 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.754815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-socket\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.754849 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.754842    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-credential-socket\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.755247 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.755205    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istiod-ca-cert\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.755376 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.755267    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-data\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.755451 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.755432    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-certs\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.755529 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.755457    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-socket\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.757482 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.757457    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-envoy\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.757705 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.757682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-podinfo\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.763950 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.763923    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-token\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.764214 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.764193    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5zg5\" (UniqueName: \"kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-kube-api-access-d5zg5\") pod \"e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") " pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:25.905248 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:25.905206    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:26.052735 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:26.052707    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"]
Jul 30 11:26:26.058508 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:26:26.058441    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844c5427_a1a5_47b5_9777_528ea5a0b1fe.slice/crio-8db260d0421acb5f2a51e31cc8b1518e7f10cf667e2a6a1b13b8363c5acdb1ea WatchSource:0}: Error finding container 8db260d0421acb5f2a51e31cc8b1518e7f10cf667e2a6a1b13b8363c5acdb1ea: Status 404 returned error can't find the container with id 8db260d0421acb5f2a51e31cc8b1518e7f10cf667e2a6a1b13b8363c5acdb1ea
Jul 30 11:26:26.060247 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:26.060191    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:26:26.060387 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:26.060293    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:26:26.060387 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:26.060340    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:26:26.891623 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:26.891589    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" event={"ID":"844c5427-a1a5-47b5-9777-528ea5a0b1fe","Type":"ContainerStarted","Data":"aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303"}
Jul 30 11:26:26.892040 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:26.891650    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" event={"ID":"844c5427-a1a5-47b5-9777-528ea5a0b1fe","Type":"ContainerStarted","Data":"8db260d0421acb5f2a51e31cc8b1518e7f10cf667e2a6a1b13b8363c5acdb1ea"}
Jul 30 11:26:26.906272 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:26.906204    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:26.914691 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:26.914636    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" podStartSLOduration=1.914615977 podStartE2EDuration="1.914615977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:26:26.91369829 +0000 UTC m=+2291.022339782" watchObservedRunningTime="2026-07-30 11:26:26.914615977 +0000 UTC m=+2291.023257468"
Jul 30 11:26:27.910879 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:27.910843    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:28.901787 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:28.901750    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:28.902820 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:28.902802    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:29.941717 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:29.941679    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"]
Jul 30 11:26:29.944467 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:29.944441    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:29.947292 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:29.947259    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 11:26:29.947570 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:29.947555    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 11:26:29.948381 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:29.948361    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gvjcm\""
Jul 30 11:26:29.948541 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:29.948523    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6bccc947-serving-cert\""
Jul 30 11:26:29.958145 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:29.958111    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"]
Jul 30 11:26:30.003085 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.003040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f23e63e-e9d8-46d7-9608-5ba40432389a-maas-api-tls\") pod \"maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:30.003348 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.003147    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgp4v\" (UniqueName: \"kubernetes.io/projected/3f23e63e-e9d8-46d7-9608-5ba40432389a-kube-api-access-cgp4v\") pod \"maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:30.003429 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.003373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f23e63e-e9d8-46d7-9608-5ba40432389a-openshift-service-ca\") pod \"maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:30.104494 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.104449    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f23e63e-e9d8-46d7-9608-5ba40432389a-openshift-service-ca\") pod \"maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:30.104702 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.104512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f23e63e-e9d8-46d7-9608-5ba40432389a-maas-api-tls\") pod \"maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:30.104702 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.104537    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgp4v\" (UniqueName: \"kubernetes.io/projected/3f23e63e-e9d8-46d7-9608-5ba40432389a-kube-api-access-cgp4v\") pod \"maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:30.104702 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:26:30.104633    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-serving-cert: secret "maas-api-e2e-mt-6bccc947-serving-cert" not found
Jul 30 11:26:30.104878 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:26:30.104711    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f23e63e-e9d8-46d7-9608-5ba40432389a-maas-api-tls podName:3f23e63e-e9d8-46d7-9608-5ba40432389a nodeName:}" failed. No retries permitted until 2026-07-30 11:26:30.604689748 +0000 UTC m=+2294.713331219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f23e63e-e9d8-46d7-9608-5ba40432389a-maas-api-tls") pod "maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m" (UID: "3f23e63e-e9d8-46d7-9608-5ba40432389a") : secret "maas-api-e2e-mt-6bccc947-serving-cert" not found
Jul 30 11:26:30.105334 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.105316    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f23e63e-e9d8-46d7-9608-5ba40432389a-openshift-service-ca\") pod \"maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:30.113165 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.113138    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgp4v\" (UniqueName: \"kubernetes.io/projected/3f23e63e-e9d8-46d7-9608-5ba40432389a-kube-api-access-cgp4v\") pod \"maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:30.592655 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.592611    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"]
Jul 30 11:26:30.595068 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.595048    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:26:30.597761 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.597730    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6bccc947-dockercfg-gq6rn\""
Jul 30 11:26:30.597902 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.597764    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6bccc947\""
Jul 30 11:26:30.608283 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.608254    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"]
Jul 30 11:26:30.610623 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.610585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f23e63e-e9d8-46d7-9608-5ba40432389a-maas-api-tls\") pod \"maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:30.613947 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.613904    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f23e63e-e9d8-46d7-9608-5ba40432389a-maas-api-tls\") pod \"maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:30.711643 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.711600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4064bd40-5fd8-4f0d-93c2-900b1a51add3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b\" (UID: \"4064bd40-5fd8-4f0d-93c2-900b1a51add3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:26:30.711892 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.711801    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szwdx\" (UniqueName: \"kubernetes.io/projected/4064bd40-5fd8-4f0d-93c2-900b1a51add3-kube-api-access-szwdx\") pod \"payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b\" (UID: \"4064bd40-5fd8-4f0d-93c2-900b1a51add3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:26:30.812658 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.812613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4064bd40-5fd8-4f0d-93c2-900b1a51add3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b\" (UID: \"4064bd40-5fd8-4f0d-93c2-900b1a51add3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:26:30.812905 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.812692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szwdx\" (UniqueName: \"kubernetes.io/projected/4064bd40-5fd8-4f0d-93c2-900b1a51add3-kube-api-access-szwdx\") pod \"payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b\" (UID: \"4064bd40-5fd8-4f0d-93c2-900b1a51add3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:26:30.813413 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.813392    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4064bd40-5fd8-4f0d-93c2-900b1a51add3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b\" (UID: \"4064bd40-5fd8-4f0d-93c2-900b1a51add3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:26:30.821879 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.821834    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szwdx\" (UniqueName: \"kubernetes.io/projected/4064bd40-5fd8-4f0d-93c2-900b1a51add3-kube-api-access-szwdx\") pod \"payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b\" (UID: \"4064bd40-5fd8-4f0d-93c2-900b1a51add3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:26:30.855786 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.855681    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:30.908002 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:30.907724    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:26:31.026256 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:31.025778    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"]
Jul 30 11:26:31.028582 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:26:31.028518    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f23e63e_e9d8_46d7_9608_5ba40432389a.slice/crio-79493e40b8a49862ef3bb3ecfadf3a2f97abbcda480a072324f1df9cfb9aa632 WatchSource:0}: Error finding container 79493e40b8a49862ef3bb3ecfadf3a2f97abbcda480a072324f1df9cfb9aa632: Status 404 returned error can't find the container with id 79493e40b8a49862ef3bb3ecfadf3a2f97abbcda480a072324f1df9cfb9aa632
Jul 30 11:26:31.030586 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:31.030561    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 11:26:31.085286 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:31.085242    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"]
Jul 30 11:26:31.088604 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:26:31.088575    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4064bd40_5fd8_4f0d_93c2_900b1a51add3.slice/crio-ddab39b6710ff975db93006331a18e2a9e447bdb46c2b6512ce46a7aa2d7865e WatchSource:0}: Error finding container ddab39b6710ff975db93006331a18e2a9e447bdb46c2b6512ce46a7aa2d7865e: Status 404 returned error can't find the container with id ddab39b6710ff975db93006331a18e2a9e447bdb46c2b6512ce46a7aa2d7865e
Jul 30 11:26:31.921820 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:31.921769    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m" event={"ID":"3f23e63e-e9d8-46d7-9608-5ba40432389a","Type":"ContainerStarted","Data":"88891099ce5d1d6eb41e02ca9108ad83531e496e9375f5557cf375af16230d45"}
Jul 30 11:26:31.922030 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:31.921846    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:31.922030 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:31.921873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m" event={"ID":"3f23e63e-e9d8-46d7-9608-5ba40432389a","Type":"ContainerStarted","Data":"79493e40b8a49862ef3bb3ecfadf3a2f97abbcda480a072324f1df9cfb9aa632"}
Jul 30 11:26:31.923317 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:31.923288    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b" event={"ID":"4064bd40-5fd8-4f0d-93c2-900b1a51add3","Type":"ContainerStarted","Data":"188fb51a956fca0ac55bb8f239a654dbdc59861756fd7fa5697ebe49d772b79a"}
Jul 30 11:26:31.923466 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:31.923331    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b" event={"ID":"4064bd40-5fd8-4f0d-93c2-900b1a51add3","Type":"ContainerStarted","Data":"ddab39b6710ff975db93006331a18e2a9e447bdb46c2b6512ce46a7aa2d7865e"}
Jul 30 11:26:31.923466 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:31.923389    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:26:31.946517 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:31.946461    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m" podStartSLOduration=2.4689432780000002 podStartE2EDuration="2.946439187s" totalImagesPullingTime="477.495909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:26:31.943691915 +0000 UTC m=+2296.052333420" watchObservedRunningTime="2026-07-30 11:26:31.946439187 +0000 UTC m=+2296.055080679"
Jul 30 11:26:31.962931 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:31.962872    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b" podStartSLOduration=1.962857031 podStartE2EDuration="1.962857031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:26:31.960883983 +0000 UTC m=+2296.069525476" watchObservedRunningTime="2026-07-30 11:26:31.962857031 +0000 UTC m=+2296.071498522"
Jul 30 11:26:37.945636 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:37.945594    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:26:42.932741 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:42.932708    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:26:43.903454 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:43.903416    2583 patch_prober.go:28] interesting pod/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 30 11:26:43.903684 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:43.903510    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 30 11:26:43.997689 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:43.997654    2583 generic.go:356] "Generic (PLEG): container finished" podID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerID="aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303" exitCode=0
Jul 30 11:26:43.998083 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:43.997726    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" event={"ID":"844c5427-a1a5-47b5-9777-528ea5a0b1fe","Type":"ContainerDied","Data":"aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303"}
Jul 30 11:26:43.998201 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:43.998186    2583 scope.go:117] "RemoveContainer" containerID="aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303"
Jul 30 11:26:43.999308 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:43.999281    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:26:43.999377 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:43.999359    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:26:43.999426 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:43.999414    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:26:45.006424 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:45.006388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" event={"ID":"844c5427-a1a5-47b5-9777-528ea5a0b1fe","Type":"ContainerStarted","Data":"fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973"}
Jul 30 11:26:45.906124 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:45.906080    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:45.906373 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:45.906349    2583 patch_prober.go:28] interesting pod/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 30 11:26:45.906430 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:45.906398    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 30 11:26:46.906527 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:46.906482    2583 patch_prober.go:28] interesting pod/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 30 11:26:46.906943 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:46.906555    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 30 11:26:47.905816 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:47.905782    2583 patch_prober.go:28] interesting pod/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 30 11:26:47.906037 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:47.905842    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 30 11:26:48.906283 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:48.906212    2583 patch_prober.go:28] interesting pod/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 30 11:26:48.906685 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:48.906302    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 30 11:26:49.905968 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:49.905929    2583 patch_prober.go:28] interesting pod/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 30 11:26:49.906154 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:49.905987    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 30 11:26:50.910317 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:50.910282    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:50.910823 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:50.910567    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:26:50.911485 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:26:50.911468    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:27:43.078479 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.078438    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"]
Jul 30 11:27:43.078957 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.078707    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m" podUID="3f23e63e-e9d8-46d7-9608-5ba40432389a" containerName="maas-api" containerID="cri-o://88891099ce5d1d6eb41e02ca9108ad83531e496e9375f5557cf375af16230d45" gracePeriod=30
Jul 30 11:27:43.150871 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.150830    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"]
Jul 30 11:27:43.151104 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.151076    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b" podUID="4064bd40-5fd8-4f0d-93c2-900b1a51add3" containerName="payload-pre-processing" containerID="cri-o://188fb51a956fca0ac55bb8f239a654dbdc59861756fd7fa5697ebe49d772b79a" gracePeriod=30
Jul 30 11:27:43.307080 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.307039    2583 generic.go:356] "Generic (PLEG): container finished" podID="3f23e63e-e9d8-46d7-9608-5ba40432389a" containerID="88891099ce5d1d6eb41e02ca9108ad83531e496e9375f5557cf375af16230d45" exitCode=0
Jul 30 11:27:43.307286 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.307187    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m" event={"ID":"3f23e63e-e9d8-46d7-9608-5ba40432389a","Type":"ContainerDied","Data":"88891099ce5d1d6eb41e02ca9108ad83531e496e9375f5557cf375af16230d45"}
Jul 30 11:27:43.309728 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.309695    2583 generic.go:356] "Generic (PLEG): container finished" podID="4064bd40-5fd8-4f0d-93c2-900b1a51add3" containerID="188fb51a956fca0ac55bb8f239a654dbdc59861756fd7fa5697ebe49d772b79a" exitCode=0
Jul 30 11:27:43.309882 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.309749    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b" event={"ID":"4064bd40-5fd8-4f0d-93c2-900b1a51add3","Type":"ContainerDied","Data":"188fb51a956fca0ac55bb8f239a654dbdc59861756fd7fa5697ebe49d772b79a"}
Jul 30 11:27:43.421124 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.421006    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:27:43.453894 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.453860    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:27:43.534596 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.534557    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f23e63e-e9d8-46d7-9608-5ba40432389a-maas-api-tls\") pod \"3f23e63e-e9d8-46d7-9608-5ba40432389a\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") "
Jul 30 11:27:43.534763 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.534614    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgp4v\" (UniqueName: \"kubernetes.io/projected/3f23e63e-e9d8-46d7-9608-5ba40432389a-kube-api-access-cgp4v\") pod \"3f23e63e-e9d8-46d7-9608-5ba40432389a\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") "
Jul 30 11:27:43.534763 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.534748    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f23e63e-e9d8-46d7-9608-5ba40432389a-openshift-service-ca\") pod \"3f23e63e-e9d8-46d7-9608-5ba40432389a\" (UID: \"3f23e63e-e9d8-46d7-9608-5ba40432389a\") "
Jul 30 11:27:43.535158 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.535125    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f23e63e-e9d8-46d7-9608-5ba40432389a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f23e63e-e9d8-46d7-9608-5ba40432389a" (UID: "3f23e63e-e9d8-46d7-9608-5ba40432389a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:27:43.536780 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.536738    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f23e63e-e9d8-46d7-9608-5ba40432389a-kube-api-access-cgp4v" (OuterVolumeSpecName: "kube-api-access-cgp4v") pod "3f23e63e-e9d8-46d7-9608-5ba40432389a" (UID: "3f23e63e-e9d8-46d7-9608-5ba40432389a"). InnerVolumeSpecName "kube-api-access-cgp4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:27:43.536894 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.536783    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f23e63e-e9d8-46d7-9608-5ba40432389a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f23e63e-e9d8-46d7-9608-5ba40432389a" (UID: "3f23e63e-e9d8-46d7-9608-5ba40432389a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 11:27:43.636187 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.636101    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szwdx\" (UniqueName: \"kubernetes.io/projected/4064bd40-5fd8-4f0d-93c2-900b1a51add3-kube-api-access-szwdx\") pod \"4064bd40-5fd8-4f0d-93c2-900b1a51add3\" (UID: \"4064bd40-5fd8-4f0d-93c2-900b1a51add3\") "
Jul 30 11:27:43.636187 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.636165    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4064bd40-5fd8-4f0d-93c2-900b1a51add3-plugins-config-volume\") pod \"4064bd40-5fd8-4f0d-93c2-900b1a51add3\" (UID: \"4064bd40-5fd8-4f0d-93c2-900b1a51add3\") "
Jul 30 11:27:43.636617 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.636591    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4064bd40-5fd8-4f0d-93c2-900b1a51add3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4064bd40-5fd8-4f0d-93c2-900b1a51add3" (UID: "4064bd40-5fd8-4f0d-93c2-900b1a51add3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:27:43.636722 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.636701    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f23e63e-e9d8-46d7-9608-5ba40432389a-openshift-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:27:43.636722 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.636721    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4064bd40-5fd8-4f0d-93c2-900b1a51add3-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:27:43.636909 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.636731    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f23e63e-e9d8-46d7-9608-5ba40432389a-maas-api-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:27:43.636909 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.636742    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgp4v\" (UniqueName: \"kubernetes.io/projected/3f23e63e-e9d8-46d7-9608-5ba40432389a-kube-api-access-cgp4v\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:27:43.638509 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.638475    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4064bd40-5fd8-4f0d-93c2-900b1a51add3-kube-api-access-szwdx" (OuterVolumeSpecName: "kube-api-access-szwdx") pod "4064bd40-5fd8-4f0d-93c2-900b1a51add3" (UID: "4064bd40-5fd8-4f0d-93c2-900b1a51add3"). InnerVolumeSpecName "kube-api-access-szwdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:27:43.737925 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:43.737882    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szwdx\" (UniqueName: \"kubernetes.io/projected/4064bd40-5fd8-4f0d-93c2-900b1a51add3-kube-api-access-szwdx\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:27:44.315915 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.315883    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"
Jul 30 11:27:44.315915 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.315905    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b" event={"ID":"4064bd40-5fd8-4f0d-93c2-900b1a51add3","Type":"ContainerDied","Data":"ddab39b6710ff975db93006331a18e2a9e447bdb46c2b6512ce46a7aa2d7865e"}
Jul 30 11:27:44.316445 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.315972    2583 scope.go:117] "RemoveContainer" containerID="188fb51a956fca0ac55bb8f239a654dbdc59861756fd7fa5697ebe49d772b79a"
Jul 30 11:27:44.317387 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.317364    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"
Jul 30 11:27:44.317466 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.317356    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m" event={"ID":"3f23e63e-e9d8-46d7-9608-5ba40432389a","Type":"ContainerDied","Data":"79493e40b8a49862ef3bb3ecfadf3a2f97abbcda480a072324f1df9cfb9aa632"}
Jul 30 11:27:44.325664 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.325568    2583 scope.go:117] "RemoveContainer" containerID="88891099ce5d1d6eb41e02ca9108ad83531e496e9375f5557cf375af16230d45"
Jul 30 11:27:44.346034 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.345939    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"]
Jul 30 11:27:44.351827 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.351792    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-6bccc947-f57dbb968-87r8b"]
Jul 30 11:27:44.366759 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.366719    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"]
Jul 30 11:27:44.375264 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.373144    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6bccc947-6755b45d89-hrf9m"]
Jul 30 11:27:44.461187 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.461141    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f23e63e-e9d8-46d7-9608-5ba40432389a" path="/var/lib/kubelet/pods/3f23e63e-e9d8-46d7-9608-5ba40432389a/volumes"
Jul 30 11:27:44.461579 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:27:44.461563    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4064bd40-5fd8-4f0d-93c2-900b1a51add3" path="/var/lib/kubelet/pods/4064bd40-5fd8-4f0d-93c2-900b1a51add3/volumes"
Jul 30 11:28:36.277024 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:36.276989    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"]
Jul 30 11:28:36.277530 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:36.277207    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy" containerID="cri-o://fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973" gracePeriod=30
Jul 30 11:28:41.536360 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.536286    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:28:41.604597 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.604561    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-certs\") pod \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") "
Jul 30 11:28:41.604804 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.604619    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5zg5\" (UniqueName: \"kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-kube-api-access-d5zg5\") pod \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") "
Jul 30 11:28:41.604804 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.604659    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-socket\") pod \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") "
Jul 30 11:28:41.604804 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.604692    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-data\") pod \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") "
Jul 30 11:28:41.604804 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.604726    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-credential-socket\") pod \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") "
Jul 30 11:28:41.605020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.604861    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-envoy\") pod \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") "
Jul 30 11:28:41.605020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.604912    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-podinfo\") pod \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") "
Jul 30 11:28:41.605020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.604955    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istiod-ca-cert\") pod \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") "
Jul 30 11:28:41.605020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.604966    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "844c5427-a1a5-47b5-9777-528ea5a0b1fe" (UID: "844c5427-a1a5-47b5-9777-528ea5a0b1fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:28:41.605212 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.605019    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "844c5427-a1a5-47b5-9777-528ea5a0b1fe" (UID: "844c5427-a1a5-47b5-9777-528ea5a0b1fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:28:41.605212 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.605034    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "844c5427-a1a5-47b5-9777-528ea5a0b1fe" (UID: "844c5427-a1a5-47b5-9777-528ea5a0b1fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:28:41.605212 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.605031    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-token\") pod \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\" (UID: \"844c5427-a1a5-47b5-9777-528ea5a0b1fe\") "
Jul 30 11:28:41.605382 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.605321    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "844c5427-a1a5-47b5-9777-528ea5a0b1fe" (UID: "844c5427-a1a5-47b5-9777-528ea5a0b1fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:28:41.605437 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.605395    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "844c5427-a1a5-47b5-9777-528ea5a0b1fe" (UID: "844c5427-a1a5-47b5-9777-528ea5a0b1fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:28:41.605556 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.605538    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-certs\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:28:41.605618 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.605560    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-workload-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:28:41.605618 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.605575    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-data\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:28:41.605618 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.605590    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-credential-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:28:41.605618 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.605605    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istiod-ca-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:28:41.607093 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.607066    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-kube-api-access-d5zg5" (OuterVolumeSpecName: "kube-api-access-d5zg5") pod "844c5427-a1a5-47b5-9777-528ea5a0b1fe" (UID: "844c5427-a1a5-47b5-9777-528ea5a0b1fe"). InnerVolumeSpecName "kube-api-access-d5zg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:28:41.607476 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.607448    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "844c5427-a1a5-47b5-9777-528ea5a0b1fe" (UID: "844c5427-a1a5-47b5-9777-528ea5a0b1fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:28:41.607651 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.607578    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "844c5427-a1a5-47b5-9777-528ea5a0b1fe" (UID: "844c5427-a1a5-47b5-9777-528ea5a0b1fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:28:41.607651 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.607583    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "844c5427-a1a5-47b5-9777-528ea5a0b1fe" (UID: "844c5427-a1a5-47b5-9777-528ea5a0b1fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 11:28:41.620039 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.620007    2583 generic.go:356] "Generic (PLEG): container finished" podID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerID="fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973" exitCode=0
Jul 30 11:28:41.620217 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.620072    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"
Jul 30 11:28:41.620217 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.620083    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" event={"ID":"844c5427-a1a5-47b5-9777-528ea5a0b1fe","Type":"ContainerDied","Data":"fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973"}
Jul 30 11:28:41.620217 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.620143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb" event={"ID":"844c5427-a1a5-47b5-9777-528ea5a0b1fe","Type":"ContainerDied","Data":"8db260d0421acb5f2a51e31cc8b1518e7f10cf667e2a6a1b13b8363c5acdb1ea"}
Jul 30 11:28:41.620217 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.620166    2583 scope.go:117] "RemoveContainer" containerID="fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973"
Jul 30 11:28:41.630142 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.630119    2583 scope.go:117] "RemoveContainer" containerID="aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303"
Jul 30 11:28:41.639120 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.639098    2583 scope.go:117] "RemoveContainer" containerID="fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973"
Jul 30 11:28:41.639498 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:28:41.639475    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973\": container with ID starting with fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973 not found: ID does not exist" containerID="fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973"
Jul 30 11:28:41.639581 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.639510    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973"} err="failed to get container status \"fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973\": rpc error: code = NotFound desc = could not find container \"fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973\": container with ID starting with fb7c4674423b7220f97d3951fe72a39bc7fc7fa6ea2b60ca3df6e632bfcad973 not found: ID does not exist"
Jul 30 11:28:41.639581 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.639532    2583 scope.go:117] "RemoveContainer" containerID="aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303"
Jul 30 11:28:41.639849 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:28:41.639821    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303\": container with ID starting with aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303 not found: ID does not exist" containerID="aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303"
Jul 30 11:28:41.639898 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.639848    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303"} err="failed to get container status \"aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303\": rpc error: code = NotFound desc = could not find container \"aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303\": container with ID starting with aaa4a56d2ee657b6488378c19f63a424d38b64475bb184eaaadccf5b858ec303 not found: ID does not exist"
Jul 30 11:28:41.657588 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.657549    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"]
Jul 30 11:28:41.672164 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.672122    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6bccc947-openshift-default-68bbb999b-wdrdb"]
Jul 30 11:28:41.706427 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.706393    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5zg5\" (UniqueName: \"kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-kube-api-access-d5zg5\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:28:41.706427 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.706429    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-envoy\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:28:41.706582 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.706440    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-podinfo\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:28:41.706582 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:41.706448    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/844c5427-a1a5-47b5-9777-528ea5a0b1fe-istio-token\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:28:42.461364 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:28:42.461321    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" path="/var/lib/kubelet/pods/844c5427-a1a5-47b5-9777-528ea5a0b1fe/volumes"
Jul 30 11:29:47.661880 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.661841    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"]
Jul 30 11:29:47.662364 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662220    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4064bd40-5fd8-4f0d-93c2-900b1a51add3" containerName="payload-pre-processing"
Jul 30 11:29:47.662364 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662246    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4064bd40-5fd8-4f0d-93c2-900b1a51add3" containerName="payload-pre-processing"
Jul 30 11:29:47.662364 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662266    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f23e63e-e9d8-46d7-9608-5ba40432389a" containerName="maas-api"
Jul 30 11:29:47.662364 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662271    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f23e63e-e9d8-46d7-9608-5ba40432389a" containerName="maas-api"
Jul 30 11:29:47.662364 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662288    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy"
Jul 30 11:29:47.662364 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662295    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy"
Jul 30 11:29:47.662364 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662303    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy"
Jul 30 11:29:47.662364 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662308    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy"
Jul 30 11:29:47.662364 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662370    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4064bd40-5fd8-4f0d-93c2-900b1a51add3" containerName="payload-pre-processing"
Jul 30 11:29:47.662649 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662379    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy"
Jul 30 11:29:47.662649 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662387    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="844c5427-a1a5-47b5-9777-528ea5a0b1fe" containerName="istio-proxy"
Jul 30 11:29:47.662649 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.662394    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f23e63e-e9d8-46d7-9608-5ba40432389a" containerName="maas-api"
Jul 30 11:29:47.665523 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.665506    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.668443 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.668419    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-da4b33-openshift-default-dockercfg-nw7n7\""
Jul 30 11:29:47.680782 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.680751    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"]
Jul 30 11:29:47.745944 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.745894    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30b094d-6d6b-4991-a3da-4265b9317920-istiod-ca-cert\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.746158 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.745964    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-data\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.746158 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.745999    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-credential-socket\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.746158 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.746027    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-istio-token\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.746158 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.746067    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlh8h\" (UniqueName: \"kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-kube-api-access-hlh8h\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.746158 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.746102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-certs\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.746158 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.746133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-socket\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.746449 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.746176    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30b094d-6d6b-4991-a3da-4265b9317920-istio-podinfo\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.746449 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.746215    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-envoy\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.846863 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.846827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30b094d-6d6b-4991-a3da-4265b9317920-istiod-ca-cert\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847048 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.846878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-data\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847048 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.846902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-credential-socket\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847048 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.846917    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-istio-token\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847048 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.846949    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlh8h\" (UniqueName: \"kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-kube-api-access-hlh8h\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847048 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.846985    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-certs\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847048 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.847015    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-socket\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847414 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.847059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30b094d-6d6b-4991-a3da-4265b9317920-istio-podinfo\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847414 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.847102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-envoy\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847622 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.847601    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30b094d-6d6b-4991-a3da-4265b9317920-istiod-ca-cert\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847703 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.847615    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-credential-socket\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847703 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.847640    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-certs\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847703 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.847661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-data\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.847809 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.847709    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-socket\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.849908 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.849884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-envoy\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.850064 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.849935    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30b094d-6d6b-4991-a3da-4265b9317920-istio-podinfo\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.855575 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.855543    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-istio-token\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.855575 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.855578    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlh8h\" (UniqueName: \"kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-kube-api-access-hlh8h\") pod \"e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") " pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:47.976253 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:47.976130    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:48.136476 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:48.136450    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"]
Jul 30 11:29:48.138791 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:29:48.138755    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30b094d_6d6b_4991_a3da_4265b9317920.slice/crio-c52ade8f45ac9d3ff8a10d04e1178823da43641bf2b76a42e10a4141e90e5479 WatchSource:0}: Error finding container c52ade8f45ac9d3ff8a10d04e1178823da43641bf2b76a42e10a4141e90e5479: Status 404 returned error can't find the container with id c52ade8f45ac9d3ff8a10d04e1178823da43641bf2b76a42e10a4141e90e5479
Jul 30 11:29:48.141422 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:48.141388    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:29:48.141509 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:48.141459    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:29:48.141509 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:48.141489    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:29:48.959084 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:48.959047    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" event={"ID":"f30b094d-6d6b-4991-a3da-4265b9317920","Type":"ContainerStarted","Data":"3a2d37d4c4aea92a327c2d47a228dcf0b0bc1d85e622b28079680e5299e98357"}
Jul 30 11:29:48.959526 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:48.959103    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" event={"ID":"f30b094d-6d6b-4991-a3da-4265b9317920","Type":"ContainerStarted","Data":"c52ade8f45ac9d3ff8a10d04e1178823da43641bf2b76a42e10a4141e90e5479"}
Jul 30 11:29:48.976546 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:48.976509    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:48.979986 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:48.979926    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" podStartSLOduration=1.979907182 podStartE2EDuration="1.979907182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:29:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:29:48.979491668 +0000 UTC m=+2493.088133172" watchObservedRunningTime="2026-07-30 11:29:48.979907182 +0000 UTC m=+2493.088548675"
Jul 30 11:29:49.982526 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:49.982494    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:50.969860 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:50.969828    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:50.970828 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:50.970807    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:29:52.055676 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.055642    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"]
Jul 30 11:29:52.059532 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.059511    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:52.062360 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.062328    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-da4b33-serving-cert\""
Jul 30 11:29:52.062522 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.062435    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 11:29:52.062522 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.062515    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 11:29:52.063612 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.063594    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gvjcm\""
Jul 30 11:29:52.071066 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.071024    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"]
Jul 30 11:29:52.089828 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.089788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66tnn\" (UniqueName: \"kubernetes.io/projected/4f2219c1-a590-48dc-9927-f053a3d94e76-kube-api-access-66tnn\") pod \"maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:52.090025 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.089850    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2219c1-a590-48dc-9927-f053a3d94e76-openshift-service-ca\") pod \"maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:52.090025 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.089928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2219c1-a590-48dc-9927-f053a3d94e76-maas-api-tls\") pod \"maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:52.191430 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.191382    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2219c1-a590-48dc-9927-f053a3d94e76-openshift-service-ca\") pod \"maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:52.191644 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.191447    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2219c1-a590-48dc-9927-f053a3d94e76-maas-api-tls\") pod \"maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:52.191644 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.191502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66tnn\" (UniqueName: \"kubernetes.io/projected/4f2219c1-a590-48dc-9927-f053a3d94e76-kube-api-access-66tnn\") pod \"maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:52.191644 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:29:52.191607    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-serving-cert: secret "maas-api-e2e-inf-a-da4b33-serving-cert" not found
Jul 30 11:29:52.191853 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:29:52.191671    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f2219c1-a590-48dc-9927-f053a3d94e76-maas-api-tls podName:4f2219c1-a590-48dc-9927-f053a3d94e76 nodeName:}" failed. No retries permitted until 2026-07-30 11:29:52.691654713 +0000 UTC m=+2496.800296187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4f2219c1-a590-48dc-9927-f053a3d94e76-maas-api-tls") pod "maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq" (UID: "4f2219c1-a590-48dc-9927-f053a3d94e76") : secret "maas-api-e2e-inf-a-da4b33-serving-cert" not found
Jul 30 11:29:52.192151 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.192126    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2219c1-a590-48dc-9927-f053a3d94e76-openshift-service-ca\") pod \"maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:52.204979 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.204946    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66tnn\" (UniqueName: \"kubernetes.io/projected/4f2219c1-a590-48dc-9927-f053a3d94e76-kube-api-access-66tnn\") pod \"maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:52.697912 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.697873    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2219c1-a590-48dc-9927-f053a3d94e76-maas-api-tls\") pod \"maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:52.700312 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.700292    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2219c1-a590-48dc-9927-f053a3d94e76-maas-api-tls\") pod \"maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:52.894825 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.894780    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"]
Jul 30 11:29:52.898248 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.898209    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:29:52.901105 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.901068    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-da4b33\""
Jul 30 11:29:52.901279 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.901205    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-da4b33-dockercfg-jgx6f\""
Jul 30 11:29:52.914537 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.914495    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"]
Jul 30 11:29:52.972472 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:52.972377    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:53.000750 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.000714    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a6d3ead-fa47-4ce3-8260-241083b34c52-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2\" (UID: \"7a6d3ead-fa47-4ce3-8260-241083b34c52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:29:53.001022 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.000996    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zcfd\" (UniqueName: \"kubernetes.io/projected/7a6d3ead-fa47-4ce3-8260-241083b34c52-kube-api-access-5zcfd\") pod \"payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2\" (UID: \"7a6d3ead-fa47-4ce3-8260-241083b34c52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:29:53.101807 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.101760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zcfd\" (UniqueName: \"kubernetes.io/projected/7a6d3ead-fa47-4ce3-8260-241083b34c52-kube-api-access-5zcfd\") pod \"payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2\" (UID: \"7a6d3ead-fa47-4ce3-8260-241083b34c52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:29:53.102292 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.101852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a6d3ead-fa47-4ce3-8260-241083b34c52-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2\" (UID: \"7a6d3ead-fa47-4ce3-8260-241083b34c52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:29:53.102771 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.102746    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a6d3ead-fa47-4ce3-8260-241083b34c52-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2\" (UID: \"7a6d3ead-fa47-4ce3-8260-241083b34c52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:29:53.111332 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.111303    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zcfd\" (UniqueName: \"kubernetes.io/projected/7a6d3ead-fa47-4ce3-8260-241083b34c52-kube-api-access-5zcfd\") pod \"payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2\" (UID: \"7a6d3ead-fa47-4ce3-8260-241083b34c52\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:29:53.123022 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.122990    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"]
Jul 30 11:29:53.124390 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:29:53.124364    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2219c1_a590_48dc_9927_f053a3d94e76.slice/crio-8486927f942f83b9b254eba64a418581b23f74b830eda2684afa33560eb7c124 WatchSource:0}: Error finding container 8486927f942f83b9b254eba64a418581b23f74b830eda2684afa33560eb7c124: Status 404 returned error can't find the container with id 8486927f942f83b9b254eba64a418581b23f74b830eda2684afa33560eb7c124
Jul 30 11:29:53.211325 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.211283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:29:53.374037 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.374008    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"]
Jul 30 11:29:53.375294 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:29:53.375268    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6d3ead_fa47_4ce3_8260_241083b34c52.slice/crio-cc37a54eb6791d070e1afa481950ddfb3ec182219258a1dddaa586018bb6b9e7 WatchSource:0}: Error finding container cc37a54eb6791d070e1afa481950ddfb3ec182219258a1dddaa586018bb6b9e7: Status 404 returned error can't find the container with id cc37a54eb6791d070e1afa481950ddfb3ec182219258a1dddaa586018bb6b9e7
Jul 30 11:29:53.986077 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.986037    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2" event={"ID":"7a6d3ead-fa47-4ce3-8260-241083b34c52","Type":"ContainerStarted","Data":"420853b73f4c710b64206f012fe58e066c1691193f8572ec3c05f566ceb180ca"}
Jul 30 11:29:53.986308 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.986104    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2" event={"ID":"7a6d3ead-fa47-4ce3-8260-241083b34c52","Type":"ContainerStarted","Data":"cc37a54eb6791d070e1afa481950ddfb3ec182219258a1dddaa586018bb6b9e7"}
Jul 30 11:29:53.986308 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.986253    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:29:53.987711 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.987681    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq" event={"ID":"4f2219c1-a590-48dc-9927-f053a3d94e76","Type":"ContainerStarted","Data":"33c52d1f99cc39555847a3439d4eabe6833cecd31f099d3fe5ec1f8e745f316e"}
Jul 30 11:29:53.987844 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.987728    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq" event={"ID":"4f2219c1-a590-48dc-9927-f053a3d94e76","Type":"ContainerStarted","Data":"8486927f942f83b9b254eba64a418581b23f74b830eda2684afa33560eb7c124"}
Jul 30 11:29:53.987844 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:53.987764    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:29:54.005514 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:54.005454    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2" podStartSLOduration=2.005437097 podStartE2EDuration="2.005437097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:29:54.003401766 +0000 UTC m=+2498.112043271" watchObservedRunningTime="2026-07-30 11:29:54.005437097 +0000 UTC m=+2498.114078588"
Jul 30 11:29:54.025396 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:54.025337    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq" podStartSLOduration=1.537538517 podStartE2EDuration="2.025313001s" totalImagesPullingTime="487.774484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:29:54.02421355 +0000 UTC m=+2498.132855065" watchObservedRunningTime="2026-07-30 11:29:54.025313001 +0000 UTC m=+2498.133954493"
Jul 30 11:29:59.999402 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:29:59.999369    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:30:04.995969 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:04.995853    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:30:05.052016 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:05.051979    2583 generic.go:356] "Generic (PLEG): container finished" podID="f30b094d-6d6b-4991-a3da-4265b9317920" containerID="3a2d37d4c4aea92a327c2d47a228dcf0b0bc1d85e622b28079680e5299e98357" exitCode=0
Jul 30 11:30:05.052193 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:05.052060    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" event={"ID":"f30b094d-6d6b-4991-a3da-4265b9317920","Type":"ContainerDied","Data":"3a2d37d4c4aea92a327c2d47a228dcf0b0bc1d85e622b28079680e5299e98357"}
Jul 30 11:30:05.052637 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:05.052618    2583 scope.go:117] "RemoveContainer" containerID="3a2d37d4c4aea92a327c2d47a228dcf0b0bc1d85e622b28079680e5299e98357"
Jul 30 11:30:05.053856 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:05.053826    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:30:05.053968 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:05.053915    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:30:05.054031 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:05.053964    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:30:05.970723 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:05.970683    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:30:06.059613 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:06.059574    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" event={"ID":"f30b094d-6d6b-4991-a3da-4265b9317920","Type":"ContainerStarted","Data":"a6b1dd21d1adbc22fd2943efdbe3605c43891757f224b7911303bea355952fca"}
Jul 30 11:30:06.976786 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:06.976744    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:30:06.977998 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:06.977967    2583 patch_prober.go:28] interesting pod/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 30 11:30:06.978141 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:06.978019    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 30 11:30:07.977194 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:07.977104    2583 patch_prober.go:28] interesting pod/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 30 11:30:07.977194 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:07.977162    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 30 11:30:08.977249 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:08.977180    2583 patch_prober.go:28] interesting pod/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 30 11:30:08.977664 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:08.977273    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 30 11:30:09.976602 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:09.976559    2583 patch_prober.go:28] interesting pod/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 30 11:30:09.976799 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:09.976621    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 30 11:30:10.976967 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:10.976926    2583 patch_prober.go:28] interesting pod/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Jul 30 11:30:10.977428 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:10.977000    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Jul 30 11:30:11.981102 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:11.981063    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:30:11.981504 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:11.981455    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:30:11.982266 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:11.982249    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:30:16.635419 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.635384    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"]
Jul 30 11:30:16.638593 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.638566    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.641586 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.641555    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-cac774-openshift-default-dockercfg-kq8fs\""
Jul 30 11:30:16.651712 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.651676    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"]
Jul 30 11:30:16.750163 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.750125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-data\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.750391 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.750186    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-socket\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.750391 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.750299    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghv6m\" (UniqueName: \"kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-kube-api-access-ghv6m\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.750526 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.750502    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-certs\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.750585 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.750535    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-podinfo\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.750585 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.750565    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-credential-socket\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.750684 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.750611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-envoy\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.750742 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.750690    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-token\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.750904 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.750866    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istiod-ca-cert\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.851939 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.851883    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-data\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852154 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.851956    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-socket\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852154 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.852004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghv6m\" (UniqueName: \"kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-kube-api-access-ghv6m\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852154 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.852134    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-certs\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852386 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.852170    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-podinfo\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852386 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.852190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-credential-socket\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852386 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.852263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-envoy\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852386 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.852326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-token\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852825 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.852406    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-data\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852825 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.852421    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istiod-ca-cert\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852825 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.852501    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-certs\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852825 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.852537    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-socket\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.852825 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.852586    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-credential-socket\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.853025 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.853006    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istiod-ca-cert\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.854472 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.854454    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-envoy\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.854680 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.854661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-podinfo\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.860767 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.860740    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-token\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.860879 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.860863    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghv6m\" (UniqueName: \"kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-kube-api-access-ghv6m\") pod \"e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") " pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:16.952291 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:16.952252    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:17.109014 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:17.108979    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"]
Jul 30 11:30:17.112199 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:30:17.112169    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99891dd9_2e65_488c_8be5_6f1fd94c8bff.slice/crio-07c9a2627300017f6dc664f7a74138bc7f9b22d219b461773e000614fc6b1c9e WatchSource:0}: Error finding container 07c9a2627300017f6dc664f7a74138bc7f9b22d219b461773e000614fc6b1c9e: Status 404 returned error can't find the container with id 07c9a2627300017f6dc664f7a74138bc7f9b22d219b461773e000614fc6b1c9e
Jul 30 11:30:17.114789 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:17.114749    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:30:17.114891 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:17.114834    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:30:17.114891 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:17.114875    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:30:18.124423 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:18.124387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" event={"ID":"99891dd9-2e65-488c-8be5-6f1fd94c8bff","Type":"ContainerStarted","Data":"a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6"}
Jul 30 11:30:18.124964 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:18.124446    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" event={"ID":"99891dd9-2e65-488c-8be5-6f1fd94c8bff","Type":"ContainerStarted","Data":"07c9a2627300017f6dc664f7a74138bc7f9b22d219b461773e000614fc6b1c9e"}
Jul 30 11:30:18.147675 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:18.147623    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" podStartSLOduration=2.147603959 podStartE2EDuration="2.147603959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:30:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:30:18.146734391 +0000 UTC m=+2522.255375897" watchObservedRunningTime="2026-07-30 11:30:18.147603959 +0000 UTC m=+2522.256245450"
Jul 30 11:30:18.953301 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:18.953266    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:18.957925 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:18.957897    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:19.129732 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:19.129696    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:19.130810 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:19.130789    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:22.126899 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.126861    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"]
Jul 30 11:30:22.129759 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.129732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:30:22.132850 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.132824    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-cac774-dockercfg-mk8kx\""
Jul 30 11:30:22.132997 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.132932    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-cac774\""
Jul 30 11:30:22.140055 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.140027    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"]
Jul 30 11:30:22.311333 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.311296    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm2j8\" (UniqueName: \"kubernetes.io/projected/5a453f61-fc19-45d8-ba5c-2fd12e78519d-kube-api-access-hm2j8\") pod \"payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb\" (UID: \"5a453f61-fc19-45d8-ba5c-2fd12e78519d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:30:22.311333 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.311337    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a453f61-fc19-45d8-ba5c-2fd12e78519d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb\" (UID: \"5a453f61-fc19-45d8-ba5c-2fd12e78519d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:30:22.412811 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.412770    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm2j8\" (UniqueName: \"kubernetes.io/projected/5a453f61-fc19-45d8-ba5c-2fd12e78519d-kube-api-access-hm2j8\") pod \"payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb\" (UID: \"5a453f61-fc19-45d8-ba5c-2fd12e78519d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:30:22.412811 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.412814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a453f61-fc19-45d8-ba5c-2fd12e78519d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb\" (UID: \"5a453f61-fc19-45d8-ba5c-2fd12e78519d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:30:22.413657 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.413630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a453f61-fc19-45d8-ba5c-2fd12e78519d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb\" (UID: \"5a453f61-fc19-45d8-ba5c-2fd12e78519d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:30:22.422321 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.422287    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm2j8\" (UniqueName: \"kubernetes.io/projected/5a453f61-fc19-45d8-ba5c-2fd12e78519d-kube-api-access-hm2j8\") pod \"payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb\" (UID: \"5a453f61-fc19-45d8-ba5c-2fd12e78519d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:30:22.443346 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.443309    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:30:22.595702 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:22.595673    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"]
Jul 30 11:30:22.597896 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:30:22.597856    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a453f61_fc19_45d8_ba5c_2fd12e78519d.slice/crio-9aa084372d28d4b0b953034e5415efe233460d93e1af3bcbcfc14c9600fe0280 WatchSource:0}: Error finding container 9aa084372d28d4b0b953034e5415efe233460d93e1af3bcbcfc14c9600fe0280: Status 404 returned error can't find the container with id 9aa084372d28d4b0b953034e5415efe233460d93e1af3bcbcfc14c9600fe0280
Jul 30 11:30:23.152288 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:23.152245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb" event={"ID":"5a453f61-fc19-45d8-ba5c-2fd12e78519d","Type":"ContainerStarted","Data":"5ba13393913e5f3debd4d7d1e52c69f47873d22b80758a39f0c498d86ee81df2"}
Jul 30 11:30:23.152712 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:23.152308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb" event={"ID":"5a453f61-fc19-45d8-ba5c-2fd12e78519d","Type":"ContainerStarted","Data":"9aa084372d28d4b0b953034e5415efe233460d93e1af3bcbcfc14c9600fe0280"}
Jul 30 11:30:23.152712 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:23.152446    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:30:23.173438 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:23.173379    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb" podStartSLOduration=1.173359816 podStartE2EDuration="1.173359816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:30:23.171778892 +0000 UTC m=+2527.280420386" watchObservedRunningTime="2026-07-30 11:30:23.173359816 +0000 UTC m=+2527.282001307"
Jul 30 11:30:34.159627 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:34.159593    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:30:34.393859 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:34.393490    2583 patch_prober.go:28] interesting pod/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": read tcp 10.134.0.2:53126->10.134.0.53:15021: read: connection reset by peer" start-of-body=
Jul 30 11:30:34.393859 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:34.393557    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": read tcp 10.134.0.2:53126->10.134.0.53:15021: read: connection reset by peer"
Jul 30 11:30:35.221302 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:35.221267    2583 generic.go:356] "Generic (PLEG): container finished" podID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerID="a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6" exitCode=0
Jul 30 11:30:35.221700 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:35.221343    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" event={"ID":"99891dd9-2e65-488c-8be5-6f1fd94c8bff","Type":"ContainerDied","Data":"a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6"}
Jul 30 11:30:35.221771 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:35.221756    2583 scope.go:117] "RemoveContainer" containerID="a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6"
Jul 30 11:30:35.222920 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:35.222894    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:30:35.222984 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:35.222969    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:30:35.223024 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:35.223009    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:30:36.231459 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:36.231411    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" event={"ID":"99891dd9-2e65-488c-8be5-6f1fd94c8bff","Type":"ContainerStarted","Data":"200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d"}
Jul 30 11:30:36.953152 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:36.953113    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:36.953405 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:36.953381    2583 patch_prober.go:28] interesting pod/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 30 11:30:36.953454 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:36.953429    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 30 11:30:37.953312 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:37.953271    2583 patch_prober.go:28] interesting pod/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 30 11:30:37.953718 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:37.953332    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 30 11:30:38.953634 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:38.953596    2583 patch_prober.go:28] interesting pod/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 30 11:30:38.954026 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:38.953656    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 30 11:30:39.953011 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:39.952972    2583 patch_prober.go:28] interesting pod/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 30 11:30:39.953238 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:39.953040    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 30 11:30:40.953721 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:40.953677    2583 patch_prober.go:28] interesting pod/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Jul 30 11:30:40.954131 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:40.953745    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Jul 30 11:30:41.956769 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:41.956734    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:41.957194 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:41.957128    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:30:41.957986 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:30:41.957966    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:32:06.504866 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.504821    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"]
Jul 30 11:32:06.505470 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.505262    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq" podUID="4f2219c1-a590-48dc-9927-f053a3d94e76" containerName="maas-api" containerID="cri-o://33c52d1f99cc39555847a3439d4eabe6833cecd31f099d3fe5ec1f8e745f316e" gracePeriod=30
Jul 30 11:32:06.561038 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.560991    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"]
Jul 30 11:32:06.561256 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.561214    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2" podUID="7a6d3ead-fa47-4ce3-8260-241083b34c52" containerName="payload-pre-processing" containerID="cri-o://420853b73f4c710b64206f012fe58e066c1691193f8572ec3c05f566ceb180ca" gracePeriod=30
Jul 30 11:32:06.737553 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.737156    2583 generic.go:356] "Generic (PLEG): container finished" podID="7a6d3ead-fa47-4ce3-8260-241083b34c52" containerID="420853b73f4c710b64206f012fe58e066c1691193f8572ec3c05f566ceb180ca" exitCode=0
Jul 30 11:32:06.737553 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.737279    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2" event={"ID":"7a6d3ead-fa47-4ce3-8260-241083b34c52","Type":"ContainerDied","Data":"420853b73f4c710b64206f012fe58e066c1691193f8572ec3c05f566ceb180ca"}
Jul 30 11:32:06.740406 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.740203    2583 generic.go:356] "Generic (PLEG): container finished" podID="4f2219c1-a590-48dc-9927-f053a3d94e76" containerID="33c52d1f99cc39555847a3439d4eabe6833cecd31f099d3fe5ec1f8e745f316e" exitCode=0
Jul 30 11:32:06.740406 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.740287    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq" event={"ID":"4f2219c1-a590-48dc-9927-f053a3d94e76","Type":"ContainerDied","Data":"33c52d1f99cc39555847a3439d4eabe6833cecd31f099d3fe5ec1f8e745f316e"}
Jul 30 11:32:06.834989 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.834960    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:32:06.878651 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.878619    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:32:06.978354 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.978315    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zcfd\" (UniqueName: \"kubernetes.io/projected/7a6d3ead-fa47-4ce3-8260-241083b34c52-kube-api-access-5zcfd\") pod \"7a6d3ead-fa47-4ce3-8260-241083b34c52\" (UID: \"7a6d3ead-fa47-4ce3-8260-241083b34c52\") "
Jul 30 11:32:06.978536 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.978369    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66tnn\" (UniqueName: \"kubernetes.io/projected/4f2219c1-a590-48dc-9927-f053a3d94e76-kube-api-access-66tnn\") pod \"4f2219c1-a590-48dc-9927-f053a3d94e76\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") "
Jul 30 11:32:06.978536 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.978436    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2219c1-a590-48dc-9927-f053a3d94e76-maas-api-tls\") pod \"4f2219c1-a590-48dc-9927-f053a3d94e76\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") "
Jul 30 11:32:06.978536 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.978495    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a6d3ead-fa47-4ce3-8260-241083b34c52-plugins-config-volume\") pod \"7a6d3ead-fa47-4ce3-8260-241083b34c52\" (UID: \"7a6d3ead-fa47-4ce3-8260-241083b34c52\") "
Jul 30 11:32:06.978536 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.978530    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2219c1-a590-48dc-9927-f053a3d94e76-openshift-service-ca\") pod \"4f2219c1-a590-48dc-9927-f053a3d94e76\" (UID: \"4f2219c1-a590-48dc-9927-f053a3d94e76\") "
Jul 30 11:32:06.978965 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.978934    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f2219c1-a590-48dc-9927-f053a3d94e76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4f2219c1-a590-48dc-9927-f053a3d94e76" (UID: "4f2219c1-a590-48dc-9927-f053a3d94e76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:32:06.979035 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.978943    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a6d3ead-fa47-4ce3-8260-241083b34c52-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a6d3ead-fa47-4ce3-8260-241083b34c52" (UID: "7a6d3ead-fa47-4ce3-8260-241083b34c52"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:32:06.980701 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.980671    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f2219c1-a590-48dc-9927-f053a3d94e76-kube-api-access-66tnn" (OuterVolumeSpecName: "kube-api-access-66tnn") pod "4f2219c1-a590-48dc-9927-f053a3d94e76" (UID: "4f2219c1-a590-48dc-9927-f053a3d94e76"). InnerVolumeSpecName "kube-api-access-66tnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:32:06.981000 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.980981    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f2219c1-a590-48dc-9927-f053a3d94e76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4f2219c1-a590-48dc-9927-f053a3d94e76" (UID: "4f2219c1-a590-48dc-9927-f053a3d94e76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 11:32:06.981237 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:06.981206    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a6d3ead-fa47-4ce3-8260-241083b34c52-kube-api-access-5zcfd" (OuterVolumeSpecName: "kube-api-access-5zcfd") pod "7a6d3ead-fa47-4ce3-8260-241083b34c52" (UID: "7a6d3ead-fa47-4ce3-8260-241083b34c52"). InnerVolumeSpecName "kube-api-access-5zcfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:32:07.079411 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.079317    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f2219c1-a590-48dc-9927-f053a3d94e76-maas-api-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:07.079411 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.079347    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a6d3ead-fa47-4ce3-8260-241083b34c52-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:07.079411 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.079362    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f2219c1-a590-48dc-9927-f053a3d94e76-openshift-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:07.079411 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.079399    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zcfd\" (UniqueName: \"kubernetes.io/projected/7a6d3ead-fa47-4ce3-8260-241083b34c52-kube-api-access-5zcfd\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:07.079411 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.079409    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66tnn\" (UniqueName: \"kubernetes.io/projected/4f2219c1-a590-48dc-9927-f053a3d94e76-kube-api-access-66tnn\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:07.746478 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.746446    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"
Jul 30 11:32:07.746921 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.746452    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2" event={"ID":"7a6d3ead-fa47-4ce3-8260-241083b34c52","Type":"ContainerDied","Data":"cc37a54eb6791d070e1afa481950ddfb3ec182219258a1dddaa586018bb6b9e7"}
Jul 30 11:32:07.746921 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.746613    2583 scope.go:117] "RemoveContainer" containerID="420853b73f4c710b64206f012fe58e066c1691193f8572ec3c05f566ceb180ca"
Jul 30 11:32:07.748043 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.747994    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"
Jul 30 11:32:07.748115 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.748038    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq" event={"ID":"4f2219c1-a590-48dc-9927-f053a3d94e76","Type":"ContainerDied","Data":"8486927f942f83b9b254eba64a418581b23f74b830eda2684afa33560eb7c124"}
Jul 30 11:32:07.758622 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.758601    2583 scope.go:117] "RemoveContainer" containerID="33c52d1f99cc39555847a3439d4eabe6833cecd31f099d3fe5ec1f8e745f316e"
Jul 30 11:32:07.777472 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.777396    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"]
Jul 30 11:32:07.781353 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.781324    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-da4b33-6f4d799d6f-ld2pq"]
Jul 30 11:32:07.793523 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.793493    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"]
Jul 30 11:32:07.800500 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:07.800467    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-da4b33-5dcf6f5764-8kwb2"]
Jul 30 11:32:08.461065 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:08.461034    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f2219c1-a590-48dc-9927-f053a3d94e76" path="/var/lib/kubelet/pods/4f2219c1-a590-48dc-9927-f053a3d94e76/volumes"
Jul 30 11:32:08.461426 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:08.461412    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a6d3ead-fa47-4ce3-8260-241083b34c52" path="/var/lib/kubelet/pods/7a6d3ead-fa47-4ce3-8260-241083b34c52/volumes"
Jul 30 11:32:13.618481 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:13.618443    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"]
Jul 30 11:32:13.618972 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:13.618689    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy" containerID="cri-o://a6b1dd21d1adbc22fd2943efdbe3605c43891757f224b7911303bea355952fca" gracePeriod=30
Jul 30 11:32:18.812693 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:18.812651    2583 generic.go:356] "Generic (PLEG): container finished" podID="f30b094d-6d6b-4991-a3da-4265b9317920" containerID="a6b1dd21d1adbc22fd2943efdbe3605c43891757f224b7911303bea355952fca" exitCode=0
Jul 30 11:32:18.813105 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:18.812704    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" event={"ID":"f30b094d-6d6b-4991-a3da-4265b9317920","Type":"ContainerDied","Data":"a6b1dd21d1adbc22fd2943efdbe3605c43891757f224b7911303bea355952fca"}
Jul 30 11:32:18.813105 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:18.812762    2583 scope.go:117] "RemoveContainer" containerID="3a2d37d4c4aea92a327c2d47a228dcf0b0bc1d85e622b28079680e5299e98357"
Jul 30 11:32:18.870188 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:18.870160    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:32:19.000705 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.000673    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30b094d-6d6b-4991-a3da-4265b9317920-istiod-ca-cert\") pod \"f30b094d-6d6b-4991-a3da-4265b9317920\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") "
Jul 30 11:32:19.000915 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.000717    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-certs\") pod \"f30b094d-6d6b-4991-a3da-4265b9317920\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") "
Jul 30 11:32:19.000915 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.000767    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-data\") pod \"f30b094d-6d6b-4991-a3da-4265b9317920\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") "
Jul 30 11:32:19.000915 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.000849    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-credential-socket\") pod \"f30b094d-6d6b-4991-a3da-4265b9317920\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") "
Jul 30 11:32:19.001071 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.000916    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlh8h\" (UniqueName: \"kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-kube-api-access-hlh8h\") pod \"f30b094d-6d6b-4991-a3da-4265b9317920\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") "
Jul 30 11:32:19.001071 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.000951    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30b094d-6d6b-4991-a3da-4265b9317920-istio-podinfo\") pod \"f30b094d-6d6b-4991-a3da-4265b9317920\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") "
Jul 30 11:32:19.001071 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.000993    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-istio-token\") pod \"f30b094d-6d6b-4991-a3da-4265b9317920\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") "
Jul 30 11:32:19.001071 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.001027    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-envoy\") pod \"f30b094d-6d6b-4991-a3da-4265b9317920\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") "
Jul 30 11:32:19.001071 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.001030    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f30b094d-6d6b-4991-a3da-4265b9317920" (UID: "f30b094d-6d6b-4991-a3da-4265b9317920"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:32:19.001071 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.001069    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-socket\") pod \"f30b094d-6d6b-4991-a3da-4265b9317920\" (UID: \"f30b094d-6d6b-4991-a3da-4265b9317920\") "
Jul 30 11:32:19.001418 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.001116    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f30b094d-6d6b-4991-a3da-4265b9317920-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f30b094d-6d6b-4991-a3da-4265b9317920" (UID: "f30b094d-6d6b-4991-a3da-4265b9317920"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:32:19.001418 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.001172    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-data" (OuterVolumeSpecName: "istio-data") pod "f30b094d-6d6b-4991-a3da-4265b9317920" (UID: "f30b094d-6d6b-4991-a3da-4265b9317920"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:32:19.001511 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.001436    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f30b094d-6d6b-4991-a3da-4265b9317920" (UID: "f30b094d-6d6b-4991-a3da-4265b9317920"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:32:19.001511 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.001459    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-certs\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:19.001511 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.001499    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-data\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:19.001619 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.001512    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f30b094d-6d6b-4991-a3da-4265b9317920-istiod-ca-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:19.001619 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.001455    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f30b094d-6d6b-4991-a3da-4265b9317920" (UID: "f30b094d-6d6b-4991-a3da-4265b9317920"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:32:19.003737 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.003710    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f30b094d-6d6b-4991-a3da-4265b9317920-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f30b094d-6d6b-4991-a3da-4265b9317920" (UID: "f30b094d-6d6b-4991-a3da-4265b9317920"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 11:32:19.003737 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.003729    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-kube-api-access-hlh8h" (OuterVolumeSpecName: "kube-api-access-hlh8h") pod "f30b094d-6d6b-4991-a3da-4265b9317920" (UID: "f30b094d-6d6b-4991-a3da-4265b9317920"). InnerVolumeSpecName "kube-api-access-hlh8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:32:19.003885 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.003736    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f30b094d-6d6b-4991-a3da-4265b9317920" (UID: "f30b094d-6d6b-4991-a3da-4265b9317920"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:32:19.003885 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.003780    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-istio-token" (OuterVolumeSpecName: "istio-token") pod "f30b094d-6d6b-4991-a3da-4265b9317920" (UID: "f30b094d-6d6b-4991-a3da-4265b9317920"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:32:19.102455 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.102412    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-istio-envoy\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:19.102455 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.102448    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-workload-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:19.102455 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.102463    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f30b094d-6d6b-4991-a3da-4265b9317920-credential-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:19.102707 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.102478    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlh8h\" (UniqueName: \"kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-kube-api-access-hlh8h\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:19.102707 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.102490    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f30b094d-6d6b-4991-a3da-4265b9317920-istio-podinfo\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:19.102707 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.102502    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f30b094d-6d6b-4991-a3da-4265b9317920-istio-token\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:19.819519 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.819488    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"
Jul 30 11:32:19.819952 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.819486    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz" event={"ID":"f30b094d-6d6b-4991-a3da-4265b9317920","Type":"ContainerDied","Data":"c52ade8f45ac9d3ff8a10d04e1178823da43641bf2b76a42e10a4141e90e5479"}
Jul 30 11:32:19.819952 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.819624    2583 scope.go:117] "RemoveContainer" containerID="a6b1dd21d1adbc22fd2943efdbe3605c43891757f224b7911303bea355952fca"
Jul 30 11:32:19.844456 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.844423    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"]
Jul 30 11:32:19.848115 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:19.848087    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-da4b33-openshift-default-9b6c947b8-l6lmz"]
Jul 30 11:32:20.461535 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:20.461498    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" path="/var/lib/kubelet/pods/f30b094d-6d6b-4991-a3da-4265b9317920/volumes"
Jul 30 11:32:24.589496 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:24.589457    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"]
Jul 30 11:32:24.589971 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:24.589716    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb" podUID="5a453f61-fc19-45d8-ba5c-2fd12e78519d" containerName="payload-processing" containerID="cri-o://5ba13393913e5f3debd4d7d1e52c69f47873d22b80758a39f0c498d86ee81df2" gracePeriod=30
Jul 30 11:32:24.848634 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:24.848601    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a453f61-fc19-45d8-ba5c-2fd12e78519d" containerID="5ba13393913e5f3debd4d7d1e52c69f47873d22b80758a39f0c498d86ee81df2" exitCode=0
Jul 30 11:32:24.848805 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:24.848678    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb" event={"ID":"5a453f61-fc19-45d8-ba5c-2fd12e78519d","Type":"ContainerDied","Data":"5ba13393913e5f3debd4d7d1e52c69f47873d22b80758a39f0c498d86ee81df2"}
Jul 30 11:32:24.848805 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:24.848757    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb" event={"ID":"5a453f61-fc19-45d8-ba5c-2fd12e78519d","Type":"ContainerDied","Data":"9aa084372d28d4b0b953034e5415efe233460d93e1af3bcbcfc14c9600fe0280"}
Jul 30 11:32:24.848805 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:24.848782    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9aa084372d28d4b0b953034e5415efe233460d93e1af3bcbcfc14c9600fe0280"
Jul 30 11:32:24.864866 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:24.864839    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:32:24.955535 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:24.955505    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a453f61-fc19-45d8-ba5c-2fd12e78519d-plugins-config-volume\") pod \"5a453f61-fc19-45d8-ba5c-2fd12e78519d\" (UID: \"5a453f61-fc19-45d8-ba5c-2fd12e78519d\") "
Jul 30 11:32:24.955700 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:24.955563    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm2j8\" (UniqueName: \"kubernetes.io/projected/5a453f61-fc19-45d8-ba5c-2fd12e78519d-kube-api-access-hm2j8\") pod \"5a453f61-fc19-45d8-ba5c-2fd12e78519d\" (UID: \"5a453f61-fc19-45d8-ba5c-2fd12e78519d\") "
Jul 30 11:32:24.956023 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:24.955993    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a453f61-fc19-45d8-ba5c-2fd12e78519d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a453f61-fc19-45d8-ba5c-2fd12e78519d" (UID: "5a453f61-fc19-45d8-ba5c-2fd12e78519d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:32:24.957780 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:24.957751    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a453f61-fc19-45d8-ba5c-2fd12e78519d-kube-api-access-hm2j8" (OuterVolumeSpecName: "kube-api-access-hm2j8") pod "5a453f61-fc19-45d8-ba5c-2fd12e78519d" (UID: "5a453f61-fc19-45d8-ba5c-2fd12e78519d"). InnerVolumeSpecName "kube-api-access-hm2j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:32:25.056195 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:25.056152    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm2j8\" (UniqueName: \"kubernetes.io/projected/5a453f61-fc19-45d8-ba5c-2fd12e78519d-kube-api-access-hm2j8\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:25.056195 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:25.056187    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a453f61-fc19-45d8-ba5c-2fd12e78519d-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:25.853210 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:25.853139    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"
Jul 30 11:32:25.877914 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:25.877875    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"]
Jul 30 11:32:25.882157 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:25.882122    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-cac774-dc6985b98-gjhzb"]
Jul 30 11:32:26.461941 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:26.461901    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a453f61-fc19-45d8-ba5c-2fd12e78519d" path="/var/lib/kubelet/pods/5a453f61-fc19-45d8-ba5c-2fd12e78519d/volumes"
Jul 30 11:32:31.637306 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:31.637264    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"]
Jul 30 11:32:31.637709 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:31.637556    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy" containerID="cri-o://200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d" gracePeriod=30
Jul 30 11:32:36.898901 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.898872    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:32:36.908747 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.908641    2583 generic.go:356] "Generic (PLEG): container finished" podID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerID="200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d" exitCode=0
Jul 30 11:32:36.908747 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.908695    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"
Jul 30 11:32:36.908942 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.908740    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" event={"ID":"99891dd9-2e65-488c-8be5-6f1fd94c8bff","Type":"ContainerDied","Data":"200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d"}
Jul 30 11:32:36.908942 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.908799    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc" event={"ID":"99891dd9-2e65-488c-8be5-6f1fd94c8bff","Type":"ContainerDied","Data":"07c9a2627300017f6dc664f7a74138bc7f9b22d219b461773e000614fc6b1c9e"}
Jul 30 11:32:36.908942 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.908823    2583 scope.go:117] "RemoveContainer" containerID="200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d"
Jul 30 11:32:36.918220 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.918195    2583 scope.go:117] "RemoveContainer" containerID="a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6"
Jul 30 11:32:36.927095 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.927074    2583 scope.go:117] "RemoveContainer" containerID="200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d"
Jul 30 11:32:36.927453 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:32:36.927429    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d\": container with ID starting with 200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d not found: ID does not exist" containerID="200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d"
Jul 30 11:32:36.927562 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.927465    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d"} err="failed to get container status \"200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d\": rpc error: code = NotFound desc = could not find container \"200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d\": container with ID starting with 200a5c85aaf64f577593373c4e3ba456e4fd62116155bab7bdf9e95da3a6f86d not found: ID does not exist"
Jul 30 11:32:36.927562 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.927490    2583 scope.go:117] "RemoveContainer" containerID="a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6"
Jul 30 11:32:36.927754 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:32:36.927735    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6\": container with ID starting with a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6 not found: ID does not exist" containerID="a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6"
Jul 30 11:32:36.927795 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.927761    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6"} err="failed to get container status \"a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6\": rpc error: code = NotFound desc = could not find container \"a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6\": container with ID starting with a69ef730aa7e88dd43d0283303452bad0e1f7b16183c8acc46e34d27f9d144c6 not found: ID does not exist"
Jul 30 11:32:36.973615 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.973579    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istiod-ca-cert\") pod \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") "
Jul 30 11:32:36.973615 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.973623    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-certs\") pod \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") "
Jul 30 11:32:36.973826 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.973657    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-envoy\") pod \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") "
Jul 30 11:32:36.973826 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.973685    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-podinfo\") pod \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") "
Jul 30 11:32:36.973826 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.973741    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-socket\") pod \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") "
Jul 30 11:32:36.973826 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.973777    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-credential-socket\") pod \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") "
Jul 30 11:32:36.973826 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.973818    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghv6m\" (UniqueName: \"kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-kube-api-access-ghv6m\") pod \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") "
Jul 30 11:32:36.974110 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.973875    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-data\") pod \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") "
Jul 30 11:32:36.974110 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.973939    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-token\") pod \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\" (UID: \"99891dd9-2e65-488c-8be5-6f1fd94c8bff\") "
Jul 30 11:32:36.974110 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.973963    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "99891dd9-2e65-488c-8be5-6f1fd94c8bff" (UID: "99891dd9-2e65-488c-8be5-6f1fd94c8bff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:32:36.974110 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.974008    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "99891dd9-2e65-488c-8be5-6f1fd94c8bff" (UID: "99891dd9-2e65-488c-8be5-6f1fd94c8bff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:32:36.974110 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.974060    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "99891dd9-2e65-488c-8be5-6f1fd94c8bff" (UID: "99891dd9-2e65-488c-8be5-6f1fd94c8bff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:32:36.974385 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.974213    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-data" (OuterVolumeSpecName: "istio-data") pod "99891dd9-2e65-488c-8be5-6f1fd94c8bff" (UID: "99891dd9-2e65-488c-8be5-6f1fd94c8bff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:32:36.974444 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.974382    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istiod-ca-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:36.974444 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.974404    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-certs\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:36.974444 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.974418    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-credential-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:36.974444 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.974432    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-data\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:36.974710 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.974674    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "99891dd9-2e65-488c-8be5-6f1fd94c8bff" (UID: "99891dd9-2e65-488c-8be5-6f1fd94c8bff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:32:36.976203 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.976177    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-kube-api-access-ghv6m" (OuterVolumeSpecName: "kube-api-access-ghv6m") pod "99891dd9-2e65-488c-8be5-6f1fd94c8bff" (UID: "99891dd9-2e65-488c-8be5-6f1fd94c8bff"). InnerVolumeSpecName "kube-api-access-ghv6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:32:36.976406 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.976383    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "99891dd9-2e65-488c-8be5-6f1fd94c8bff" (UID: "99891dd9-2e65-488c-8be5-6f1fd94c8bff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 11:32:36.976641 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.976614    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-token" (OuterVolumeSpecName: "istio-token") pod "99891dd9-2e65-488c-8be5-6f1fd94c8bff" (UID: "99891dd9-2e65-488c-8be5-6f1fd94c8bff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:32:36.976741 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:36.976614    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "99891dd9-2e65-488c-8be5-6f1fd94c8bff" (UID: "99891dd9-2e65-488c-8be5-6f1fd94c8bff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:32:37.075089 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.075053    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-envoy\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:37.075089 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.075090    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-podinfo\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:37.075369 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.075105    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99891dd9-2e65-488c-8be5-6f1fd94c8bff-workload-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:37.075369 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.075121    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghv6m\" (UniqueName: \"kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-kube-api-access-ghv6m\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:37.075369 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.075133    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99891dd9-2e65-488c-8be5-6f1fd94c8bff-istio-token\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:32:37.244284 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.244244    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"]
Jul 30 11:32:37.270312 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.270277    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-cac774-openshift-default-7bd68fcff4-m8wnc"]
Jul 30 11:32:37.356314 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.356274    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"]
Jul 30 11:32:37.356894 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.356872    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy"
Jul 30 11:32:37.356948 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.356898    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy"
Jul 30 11:32:37.356948 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.356913    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a453f61-fc19-45d8-ba5c-2fd12e78519d" containerName="payload-processing"
Jul 30 11:32:37.356948 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.356923    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a453f61-fc19-45d8-ba5c-2fd12e78519d" containerName="payload-processing"
Jul 30 11:32:37.357041 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.356951    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f2219c1-a590-48dc-9927-f053a3d94e76" containerName="maas-api"
Jul 30 11:32:37.357041 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.356961    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f2219c1-a590-48dc-9927-f053a3d94e76" containerName="maas-api"
Jul 30 11:32:37.357041 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.356973    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy"
Jul 30 11:32:37.357041 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.356981    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy"
Jul 30 11:32:37.357041 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.356995    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy"
Jul 30 11:32:37.357041 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.357003    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy"
Jul 30 11:32:37.357041 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.357019    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6d3ead-fa47-4ce3-8260-241083b34c52" containerName="payload-pre-processing"
Jul 30 11:32:37.357041 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.357027    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6d3ead-fa47-4ce3-8260-241083b34c52" containerName="payload-pre-processing"
Jul 30 11:32:37.357312 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.357133    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f2219c1-a590-48dc-9927-f053a3d94e76" containerName="maas-api"
Jul 30 11:32:37.357312 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.357145    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy"
Jul 30 11:32:37.357312 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.357155    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy"
Jul 30 11:32:37.357312 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.357166    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy"
Jul 30 11:32:37.357312 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.357176    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a6d3ead-fa47-4ce3-8260-241083b34c52" containerName="payload-pre-processing"
Jul 30 11:32:37.357312 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.357188    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a453f61-fc19-45d8-ba5c-2fd12e78519d" containerName="payload-processing"
Jul 30 11:32:37.362418 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.362386    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:37.367761 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.367737    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-d6bcbf-serving-cert\""
Jul 30 11:32:37.368287 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.368262    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gvjcm\""
Jul 30 11:32:37.368432 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.368292    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 11:32:37.368504 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.368434    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 11:32:37.376196 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.376160    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"]
Jul 30 11:32:37.478856 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.478758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s9nw\" (UniqueName: \"kubernetes.io/projected/18ba8bdc-b840-4ccd-9287-944d61eaa77c-kube-api-access-9s9nw\") pod \"maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:37.478856 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.478824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18ba8bdc-b840-4ccd-9287-944d61eaa77c-openshift-service-ca\") pod \"maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:37.479104 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.478904    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ba8bdc-b840-4ccd-9287-944d61eaa77c-maas-api-tls\") pod \"maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:37.580117 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.580069    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18ba8bdc-b840-4ccd-9287-944d61eaa77c-openshift-service-ca\") pod \"maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:37.580370 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.580143    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ba8bdc-b840-4ccd-9287-944d61eaa77c-maas-api-tls\") pod \"maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:37.580370 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.580293    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s9nw\" (UniqueName: \"kubernetes.io/projected/18ba8bdc-b840-4ccd-9287-944d61eaa77c-kube-api-access-9s9nw\") pod \"maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:37.580370 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:32:37.580307    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-serving-cert: secret "maas-api-e2e-api-a-d6bcbf-serving-cert" not found
Jul 30 11:32:37.580551 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:32:37.580388    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ba8bdc-b840-4ccd-9287-944d61eaa77c-maas-api-tls podName:18ba8bdc-b840-4ccd-9287-944d61eaa77c nodeName:}" failed. No retries permitted until 2026-07-30 11:32:38.080364489 +0000 UTC m=+2662.189005971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/18ba8bdc-b840-4ccd-9287-944d61eaa77c-maas-api-tls") pod "maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb" (UID: "18ba8bdc-b840-4ccd-9287-944d61eaa77c") : secret "maas-api-e2e-api-a-d6bcbf-serving-cert" not found
Jul 30 11:32:37.580813 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.580791    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18ba8bdc-b840-4ccd-9287-944d61eaa77c-openshift-service-ca\") pod \"maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:37.594348 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:37.594318    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s9nw\" (UniqueName: \"kubernetes.io/projected/18ba8bdc-b840-4ccd-9287-944d61eaa77c-kube-api-access-9s9nw\") pod \"maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:38.085340 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.085294    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ba8bdc-b840-4ccd-9287-944d61eaa77c-maas-api-tls\") pod \"maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:38.087769 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.087743    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ba8bdc-b840-4ccd-9287-944d61eaa77c-maas-api-tls\") pod \"maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:38.274337 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.274289    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:38.429430 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.429403    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"]
Jul 30 11:32:38.432218 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:32:38.432185    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ba8bdc_b840_4ccd_9287_944d61eaa77c.slice/crio-fa00ca7bc75405605480bd67a9b7fb44036ed864b4207ae38ef10d0afb9b5e97 WatchSource:0}: Error finding container fa00ca7bc75405605480bd67a9b7fb44036ed864b4207ae38ef10d0afb9b5e97: Status 404 returned error can't find the container with id fa00ca7bc75405605480bd67a9b7fb44036ed864b4207ae38ef10d0afb9b5e97
Jul 30 11:32:38.433654 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.433633    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 11:32:38.462498 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.462463    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" path="/var/lib/kubelet/pods/99891dd9-2e65-488c-8be5-6f1fd94c8bff/volumes"
Jul 30 11:32:38.497200 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.497160    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"]
Jul 30 11:32:38.497636 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.497621    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy"
Jul 30 11:32:38.497681 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.497638    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="99891dd9-2e65-488c-8be5-6f1fd94c8bff" containerName="istio-proxy"
Jul 30 11:32:38.497727 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.497718    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f30b094d-6d6b-4991-a3da-4265b9317920" containerName="istio-proxy"
Jul 30 11:32:38.502355 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.502330    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:32:38.505391 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.505364    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-d6bcbf-dockercfg-w2rjg\""
Jul 30 11:32:38.505686 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.505670    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-d6bcbf\""
Jul 30 11:32:38.517875 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.517833    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"]
Jul 30 11:32:38.530975 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.530938    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"]
Jul 30 11:32:38.535010 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.534974    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:32:38.548690 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.548654    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"]
Jul 30 11:32:38.589528 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.589494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj\" (UID: \"4ea2dd48-8ad0-42a8-9205-bd9d58b21076\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:32:38.589528 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.589534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwfn7\" (UniqueName: \"kubernetes.io/projected/8e41c16f-f9e0-4387-ad77-83299a99be12-kube-api-access-fwfn7\") pod \"payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5\" (UID: \"8e41c16f-f9e0-4387-ad77-83299a99be12\") " pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:32:38.589788 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.589661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw5xq\" (UniqueName: \"kubernetes.io/projected/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-kube-api-access-rw5xq\") pod \"payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj\" (UID: \"4ea2dd48-8ad0-42a8-9205-bd9d58b21076\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:32:38.589788 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.589766    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e41c16f-f9e0-4387-ad77-83299a99be12-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5\" (UID: \"8e41c16f-f9e0-4387-ad77-83299a99be12\") " pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:32:38.690856 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.690812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw5xq\" (UniqueName: \"kubernetes.io/projected/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-kube-api-access-rw5xq\") pod \"payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj\" (UID: \"4ea2dd48-8ad0-42a8-9205-bd9d58b21076\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:32:38.691065 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.690980    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e41c16f-f9e0-4387-ad77-83299a99be12-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5\" (UID: \"8e41c16f-f9e0-4387-ad77-83299a99be12\") " pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:32:38.691065 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.691056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj\" (UID: \"4ea2dd48-8ad0-42a8-9205-bd9d58b21076\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:32:38.691188 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.691077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwfn7\" (UniqueName: \"kubernetes.io/projected/8e41c16f-f9e0-4387-ad77-83299a99be12-kube-api-access-fwfn7\") pod \"payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5\" (UID: \"8e41c16f-f9e0-4387-ad77-83299a99be12\") " pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:32:38.691774 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.691749    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e41c16f-f9e0-4387-ad77-83299a99be12-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5\" (UID: \"8e41c16f-f9e0-4387-ad77-83299a99be12\") " pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:32:38.691869 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.691798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj\" (UID: \"4ea2dd48-8ad0-42a8-9205-bd9d58b21076\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:32:38.699492 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.699457    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwfn7\" (UniqueName: \"kubernetes.io/projected/8e41c16f-f9e0-4387-ad77-83299a99be12-kube-api-access-fwfn7\") pod \"payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5\" (UID: \"8e41c16f-f9e0-4387-ad77-83299a99be12\") " pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:32:38.699638 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.699492    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw5xq\" (UniqueName: \"kubernetes.io/projected/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-kube-api-access-rw5xq\") pod \"payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj\" (UID: \"4ea2dd48-8ad0-42a8-9205-bd9d58b21076\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:32:38.813426 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.813386    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:32:38.847856 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.847820    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:32:38.923726 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.923687    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb" event={"ID":"18ba8bdc-b840-4ccd-9287-944d61eaa77c","Type":"ContainerStarted","Data":"fa00ca7bc75405605480bd67a9b7fb44036ed864b4207ae38ef10d0afb9b5e97"}
Jul 30 11:32:38.971046 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:38.971017    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"]
Jul 30 11:32:38.973994 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:32:38.973958    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea2dd48_8ad0_42a8_9205_bd9d58b21076.slice/crio-720627e2a4fb5629e727a2760b8ce5c83948836512ba6bfbf36da67795766d8a WatchSource:0}: Error finding container 720627e2a4fb5629e727a2760b8ce5c83948836512ba6bfbf36da67795766d8a: Status 404 returned error can't find the container with id 720627e2a4fb5629e727a2760b8ce5c83948836512ba6bfbf36da67795766d8a
Jul 30 11:32:39.023952 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.023922    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"]
Jul 30 11:32:39.026094 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:32:39.026063    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e41c16f_f9e0_4387_ad77_83299a99be12.slice/crio-732c966dee7de6b8208a5d35415866c6faab387e7af732be4c0f9adeae2de27d WatchSource:0}: Error finding container 732c966dee7de6b8208a5d35415866c6faab387e7af732be4c0f9adeae2de27d: Status 404 returned error can't find the container with id 732c966dee7de6b8208a5d35415866c6faab387e7af732be4c0f9adeae2de27d
Jul 30 11:32:39.931576 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.931534    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5" event={"ID":"8e41c16f-f9e0-4387-ad77-83299a99be12","Type":"ContainerStarted","Data":"bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b"}
Jul 30 11:32:39.932048 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.931594    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5" event={"ID":"8e41c16f-f9e0-4387-ad77-83299a99be12","Type":"ContainerStarted","Data":"732c966dee7de6b8208a5d35415866c6faab387e7af732be4c0f9adeae2de27d"}
Jul 30 11:32:39.932048 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.931736    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:32:39.933297 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.933267    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb" event={"ID":"18ba8bdc-b840-4ccd-9287-944d61eaa77c","Type":"ContainerStarted","Data":"842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8"}
Jul 30 11:32:39.933440 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.933339    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:39.935150 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.935126    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj" event={"ID":"4ea2dd48-8ad0-42a8-9205-bd9d58b21076","Type":"ContainerStarted","Data":"669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3"}
Jul 30 11:32:39.935298 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.935174    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj" event={"ID":"4ea2dd48-8ad0-42a8-9205-bd9d58b21076","Type":"ContainerStarted","Data":"720627e2a4fb5629e727a2760b8ce5c83948836512ba6bfbf36da67795766d8a"}
Jul 30 11:32:39.935298 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.935205    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:32:39.951334 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.951266    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5" podStartSLOduration=1.9512493659999999 podStartE2EDuration="1.951249366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:32:39.948752221 +0000 UTC m=+2664.057393714" watchObservedRunningTime="2026-07-30 11:32:39.951249366 +0000 UTC m=+2664.059890858"
Jul 30 11:32:39.967477 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.967423    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb" podStartSLOduration=2.371598119 podStartE2EDuration="2.967406726s" totalImagesPullingTime="595.808607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:32:39.965218831 +0000 UTC m=+2664.073860338" watchObservedRunningTime="2026-07-30 11:32:39.967406726 +0000 UTC m=+2664.076048218"
Jul 30 11:32:39.982931 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:39.982865    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj" podStartSLOduration=1.982840671 podStartE2EDuration="1.982840671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:32:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:32:39.980704564 +0000 UTC m=+2664.089346079" watchObservedRunningTime="2026-07-30 11:32:39.982840671 +0000 UTC m=+2664.091482166"
Jul 30 11:32:45.947362 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:45.947329    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:32:50.942861 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:50.942812    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj" podUID="4ea2dd48-8ad0-42a8-9205-bd9d58b21076" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.56:9004: connect: connection refused"
Jul 30 11:32:50.943545 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:32:50.943523    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:33:00.942366 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:00.942336    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:33:01.775824 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.775789    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"]
Jul 30 11:33:01.779546 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.779517    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.782331 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.782304    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-3c382f-openshift-default-dockercfg-s55jh\""
Jul 30 11:33:01.790076 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.790046    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"]
Jul 30 11:33:01.818494 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.818437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4863d5ea-911f-452e-9723-3574218a7cb5-istiod-ca-cert\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.818685 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.818503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-certs\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.818685 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.818531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh7hb\" (UniqueName: \"kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-kube-api-access-hh7hb\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.818685 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.818562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-istio-token\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.818685 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.818611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-envoy\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.818685 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.818643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-socket\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.818864 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.818691    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-data\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.818864 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.818742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4863d5ea-911f-452e-9723-3574218a7cb5-istio-podinfo\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.818864 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.818832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-credential-socket\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.919554 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.919508    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-data\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.919737 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.919575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4863d5ea-911f-452e-9723-3574218a7cb5-istio-podinfo\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.919737 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.919635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-credential-socket\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.919737 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.919688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4863d5ea-911f-452e-9723-3574218a7cb5-istiod-ca-cert\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.919737 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.919717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-certs\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.919975 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.919740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh7hb\" (UniqueName: \"kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-kube-api-access-hh7hb\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.919975 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.919773    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-istio-token\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.919975 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.919803    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-envoy\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.919975 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.919840    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-socket\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.920165 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.920033    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-data\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.920265 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.920221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-credential-socket\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.920343 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.920305    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-certs\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.920343 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.920337    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-socket\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.920507 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.920488    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4863d5ea-911f-452e-9723-3574218a7cb5-istiod-ca-cert\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.922218 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.922195    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4863d5ea-911f-452e-9723-3574218a7cb5-istio-podinfo\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.922218 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.922208    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-envoy\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.929915 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.929872    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-istio-token\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:01.930078 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:01.930057    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh7hb\" (UniqueName: \"kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-kube-api-access-hh7hb\") pod \"e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") " pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:02.093534 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:02.093433    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:02.249991 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:02.249963    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"]
Jul 30 11:33:02.251863 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:33:02.251828    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4863d5ea_911f_452e_9723_3574218a7cb5.slice/crio-db28dfe82a2d94c62b9cc9af8fa25cdbf19522f456bd2dd1c0d73a6bdce64fed WatchSource:0}: Error finding container db28dfe82a2d94c62b9cc9af8fa25cdbf19522f456bd2dd1c0d73a6bdce64fed: Status 404 returned error can't find the container with id db28dfe82a2d94c62b9cc9af8fa25cdbf19522f456bd2dd1c0d73a6bdce64fed
Jul 30 11:33:02.254152 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:02.254117    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:33:02.254283 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:02.254201    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:33:02.254283 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:02.254266    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:33:03.060694 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:03.060651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" event={"ID":"4863d5ea-911f-452e-9723-3574218a7cb5","Type":"ContainerStarted","Data":"421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9"}
Jul 30 11:33:03.060892 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:03.060713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" event={"ID":"4863d5ea-911f-452e-9723-3574218a7cb5","Type":"ContainerStarted","Data":"db28dfe82a2d94c62b9cc9af8fa25cdbf19522f456bd2dd1c0d73a6bdce64fed"}
Jul 30 11:33:03.084641 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:03.084583    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" podStartSLOduration=2.08456639 podStartE2EDuration="2.08456639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:33:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:33:03.083930104 +0000 UTC m=+2687.192571599" watchObservedRunningTime="2026-07-30 11:33:03.08456639 +0000 UTC m=+2687.193207881"
Jul 30 11:33:03.094204 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:03.094163    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:03.099724 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:03.099688    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:04.066458 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:04.066428    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:04.068270 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:04.068220    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:06.115997 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.115961    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"]
Jul 30 11:33:06.119849 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.119823    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:06.122706 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.122681    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-3c382f-serving-cert\""
Jul 30 11:33:06.132527 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.132495    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"]
Jul 30 11:33:06.172587 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.172547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fce8fc54-77f5-4c50-90e3-d126e4c09668-openshift-service-ca\") pod \"maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:06.172769 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.172728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thpwv\" (UniqueName: \"kubernetes.io/projected/fce8fc54-77f5-4c50-90e3-d126e4c09668-kube-api-access-thpwv\") pod \"maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:06.172927 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.172903    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fce8fc54-77f5-4c50-90e3-d126e4c09668-maas-api-tls\") pod \"maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:06.274190 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.274149    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fce8fc54-77f5-4c50-90e3-d126e4c09668-openshift-service-ca\") pod \"maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:06.274430 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.274200    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thpwv\" (UniqueName: \"kubernetes.io/projected/fce8fc54-77f5-4c50-90e3-d126e4c09668-kube-api-access-thpwv\") pod \"maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:06.274430 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.274273    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fce8fc54-77f5-4c50-90e3-d126e4c09668-maas-api-tls\") pod \"maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:06.274551 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:33:06.274479    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-serving-cert: secret "maas-api-e2e-api-b-3c382f-serving-cert" not found
Jul 30 11:33:06.274551 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:33:06.274549    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fce8fc54-77f5-4c50-90e3-d126e4c09668-maas-api-tls podName:fce8fc54-77f5-4c50-90e3-d126e4c09668 nodeName:}" failed. No retries permitted until 2026-07-30 11:33:06.774532387 +0000 UTC m=+2690.883173857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fce8fc54-77f5-4c50-90e3-d126e4c09668-maas-api-tls") pod "maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr" (UID: "fce8fc54-77f5-4c50-90e3-d126e4c09668") : secret "maas-api-e2e-api-b-3c382f-serving-cert" not found
Jul 30 11:33:06.274883 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.274862    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fce8fc54-77f5-4c50-90e3-d126e4c09668-openshift-service-ca\") pod \"maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:06.286599 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.286563    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thpwv\" (UniqueName: \"kubernetes.io/projected/fce8fc54-77f5-4c50-90e3-d126e4c09668-kube-api-access-thpwv\") pod \"maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:06.779722 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.779681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fce8fc54-77f5-4c50-90e3-d126e4c09668-maas-api-tls\") pod \"maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:06.782293 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.782258    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fce8fc54-77f5-4c50-90e3-d126e4c09668-maas-api-tls\") pod \"maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:06.791912 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.791877    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"]
Jul 30 11:33:06.796038 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.796010    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:33:06.798928 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.798896    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-3c382f\""
Jul 30 11:33:06.798928 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.798921    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-3c382f-dockercfg-fp25b\""
Jul 30 11:33:06.807897 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.807866    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"]
Jul 30 11:33:06.881054 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.881016    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k8t6\" (UniqueName: \"kubernetes.io/projected/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-kube-api-access-8k8t6\") pod \"payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5\" (UID: \"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:33:06.881269 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.881075    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5\" (UID: \"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:33:06.982211 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.982161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5\" (UID: \"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:33:06.982459 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.982348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k8t6\" (UniqueName: \"kubernetes.io/projected/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-kube-api-access-8k8t6\") pod \"payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5\" (UID: \"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:33:06.982943 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.982918    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-plugins-config-volume\") pod \"payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5\" (UID: \"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:33:06.992605 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:06.992571    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k8t6\" (UniqueName: \"kubernetes.io/projected/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-kube-api-access-8k8t6\") pod \"payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5\" (UID: \"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329\") " pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:33:07.032059 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:07.031958    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:07.110455 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:07.110386    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:33:07.206756 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:07.206706    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"]
Jul 30 11:33:07.209170 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:33:07.209137    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce8fc54_77f5_4c50_90e3_d126e4c09668.slice/crio-c92c09ee6a558849a8321bae3ecfe94a5a2b6eb56fe84edc5b3711a12a8dbc6f WatchSource:0}: Error finding container c92c09ee6a558849a8321bae3ecfe94a5a2b6eb56fe84edc5b3711a12a8dbc6f: Status 404 returned error can't find the container with id c92c09ee6a558849a8321bae3ecfe94a5a2b6eb56fe84edc5b3711a12a8dbc6f
Jul 30 11:33:07.272869 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:07.272839    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"]
Jul 30 11:33:07.274538 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:33:07.274513    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce4e3bb_cabf_435e_bfbd_2c5f56d29329.slice/crio-12c85744c186d2737012d4f6bda1f67398a75ed482d75afce4a96a4072e1b6d5 WatchSource:0}: Error finding container 12c85744c186d2737012d4f6bda1f67398a75ed482d75afce4a96a4072e1b6d5: Status 404 returned error can't find the container with id 12c85744c186d2737012d4f6bda1f67398a75ed482d75afce4a96a4072e1b6d5
Jul 30 11:33:08.089804 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:08.089766    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr" event={"ID":"fce8fc54-77f5-4c50-90e3-d126e4c09668","Type":"ContainerStarted","Data":"c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339"}
Jul 30 11:33:08.090135 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:08.089847    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:08.090135 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:08.089877    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr" event={"ID":"fce8fc54-77f5-4c50-90e3-d126e4c09668","Type":"ContainerStarted","Data":"c92c09ee6a558849a8321bae3ecfe94a5a2b6eb56fe84edc5b3711a12a8dbc6f"}
Jul 30 11:33:08.091406 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:08.091376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5" event={"ID":"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329","Type":"ContainerStarted","Data":"fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d"}
Jul 30 11:33:08.091537 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:08.091419    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5" event={"ID":"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329","Type":"ContainerStarted","Data":"12c85744c186d2737012d4f6bda1f67398a75ed482d75afce4a96a4072e1b6d5"}
Jul 30 11:33:08.091537 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:08.091499    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:33:08.109992 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:08.109931    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr" podStartSLOduration=1.8269224020000001 podStartE2EDuration="2.109914626s" totalImagesPullingTime="282.992224ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:33:08.108756897 +0000 UTC m=+2692.217398393" watchObservedRunningTime="2026-07-30 11:33:08.109914626 +0000 UTC m=+2692.218556118"
Jul 30 11:33:08.128011 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:08.127959    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5" podStartSLOduration=2.127938857 podStartE2EDuration="2.127938857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:33:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:33:08.125595108 +0000 UTC m=+2692.234236624" watchObservedRunningTime="2026-07-30 11:33:08.127938857 +0000 UTC m=+2692.236580349"
Jul 30 11:33:14.103690 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:14.103656    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:33:18.152391 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:18.152356    2583 generic.go:356] "Generic (PLEG): container finished" podID="4863d5ea-911f-452e-9723-3574218a7cb5" containerID="421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9" exitCode=0
Jul 30 11:33:18.152940 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:18.152411    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" event={"ID":"4863d5ea-911f-452e-9723-3574218a7cb5","Type":"ContainerDied","Data":"421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9"}
Jul 30 11:33:18.153008 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:18.152962    2583 scope.go:117] "RemoveContainer" containerID="421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9"
Jul 30 11:33:18.154218 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:18.154183    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:33:18.154344 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:18.154291    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:33:18.154344 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:18.154333    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:33:19.066522 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:19.066459    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:19.100726 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:19.100698    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:33:19.163802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:19.163765    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" event={"ID":"4863d5ea-911f-452e-9723-3574218a7cb5","Type":"ContainerStarted","Data":"b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715"}
Jul 30 11:33:20.094440 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:20.094403    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:20.095786 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:20.095756    2583 patch_prober.go:28] interesting pod/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 30 11:33:20.095915 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:20.095814    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 30 11:33:21.094071 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:21.094031    2583 patch_prober.go:28] interesting pod/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 30 11:33:21.094517 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:21.094095    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 30 11:33:22.094659 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:22.094622    2583 patch_prober.go:28] interesting pod/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 30 11:33:22.095076 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:22.094676    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 30 11:33:23.094430 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:23.094386    2583 patch_prober.go:28] interesting pod/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 30 11:33:23.094623 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:23.094449    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 30 11:33:24.094406 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:24.094367    2583 patch_prober.go:28] interesting pod/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 30 11:33:24.094842 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:24.094427    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 30 11:33:25.097917 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:25.097883    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:25.098315 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:25.098154    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:25.098784 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:25.098768    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:33:48.806161 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:48.806115    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"]
Jul 30 11:33:48.806788 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:48.806419    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb" podUID="18ba8bdc-b840-4ccd-9287-944d61eaa77c" containerName="maas-api" containerID="cri-o://842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8" gracePeriod=30
Jul 30 11:33:48.878811 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:48.878774    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"]
Jul 30 11:33:48.879018 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:48.878986    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5" podUID="8e41c16f-f9e0-4387-ad77-83299a99be12" containerName="payload-processing" containerID="cri-o://bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b" gracePeriod=30
Jul 30 11:33:48.883632 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:48.883599    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"]
Jul 30 11:33:48.883889 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:48.883842    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj" podUID="4ea2dd48-8ad0-42a8-9205-bd9d58b21076" containerName="payload-pre-processing" containerID="cri-o://669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3" gracePeriod=30
Jul 30 11:33:49.159906 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.159864    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:33:49.181206 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.181136    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:33:49.196829 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.196802    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:33:49.223823 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.223782    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18ba8bdc-b840-4ccd-9287-944d61eaa77c-openshift-service-ca\") pod \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") "
Jul 30 11:33:49.224012 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.223875    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s9nw\" (UniqueName: \"kubernetes.io/projected/18ba8bdc-b840-4ccd-9287-944d61eaa77c-kube-api-access-9s9nw\") pod \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") "
Jul 30 11:33:49.224012 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.223955    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ba8bdc-b840-4ccd-9287-944d61eaa77c-maas-api-tls\") pod \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\" (UID: \"18ba8bdc-b840-4ccd-9287-944d61eaa77c\") "
Jul 30 11:33:49.224116 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.224040    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwfn7\" (UniqueName: \"kubernetes.io/projected/8e41c16f-f9e0-4387-ad77-83299a99be12-kube-api-access-fwfn7\") pod \"8e41c16f-f9e0-4387-ad77-83299a99be12\" (UID: \"8e41c16f-f9e0-4387-ad77-83299a99be12\") "
Jul 30 11:33:49.224116 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.224064    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e41c16f-f9e0-4387-ad77-83299a99be12-plugins-config-volume\") pod \"8e41c16f-f9e0-4387-ad77-83299a99be12\" (UID: \"8e41c16f-f9e0-4387-ad77-83299a99be12\") "
Jul 30 11:33:49.224864 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.224243    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18ba8bdc-b840-4ccd-9287-944d61eaa77c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "18ba8bdc-b840-4ccd-9287-944d61eaa77c" (UID: "18ba8bdc-b840-4ccd-9287-944d61eaa77c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:33:49.224864 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.224475    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18ba8bdc-b840-4ccd-9287-944d61eaa77c-openshift-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:33:49.224864 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.224789    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e41c16f-f9e0-4387-ad77-83299a99be12-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8e41c16f-f9e0-4387-ad77-83299a99be12" (UID: "8e41c16f-f9e0-4387-ad77-83299a99be12"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:33:49.226616 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.226572    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ba8bdc-b840-4ccd-9287-944d61eaa77c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "18ba8bdc-b840-4ccd-9287-944d61eaa77c" (UID: "18ba8bdc-b840-4ccd-9287-944d61eaa77c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 11:33:49.226741 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.226692    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18ba8bdc-b840-4ccd-9287-944d61eaa77c-kube-api-access-9s9nw" (OuterVolumeSpecName: "kube-api-access-9s9nw") pod "18ba8bdc-b840-4ccd-9287-944d61eaa77c" (UID: "18ba8bdc-b840-4ccd-9287-944d61eaa77c"). InnerVolumeSpecName "kube-api-access-9s9nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:33:49.226909 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.226885    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e41c16f-f9e0-4387-ad77-83299a99be12-kube-api-access-fwfn7" (OuterVolumeSpecName: "kube-api-access-fwfn7") pod "8e41c16f-f9e0-4387-ad77-83299a99be12" (UID: "8e41c16f-f9e0-4387-ad77-83299a99be12"). InnerVolumeSpecName "kube-api-access-fwfn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:33:49.325766 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.325720    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-plugins-config-volume\") pod \"4ea2dd48-8ad0-42a8-9205-bd9d58b21076\" (UID: \"4ea2dd48-8ad0-42a8-9205-bd9d58b21076\") "
Jul 30 11:33:49.325971 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.325937    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw5xq\" (UniqueName: \"kubernetes.io/projected/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-kube-api-access-rw5xq\") pod \"4ea2dd48-8ad0-42a8-9205-bd9d58b21076\" (UID: \"4ea2dd48-8ad0-42a8-9205-bd9d58b21076\") "
Jul 30 11:33:49.326108 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.326082    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ea2dd48-8ad0-42a8-9205-bd9d58b21076" (UID: "4ea2dd48-8ad0-42a8-9205-bd9d58b21076"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:33:49.326281 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.326258    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:33:49.326281 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.326279    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18ba8bdc-b840-4ccd-9287-944d61eaa77c-maas-api-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:33:49.326474 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.326291    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwfn7\" (UniqueName: \"kubernetes.io/projected/8e41c16f-f9e0-4387-ad77-83299a99be12-kube-api-access-fwfn7\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:33:49.326474 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.326303    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e41c16f-f9e0-4387-ad77-83299a99be12-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:33:49.326474 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.326316    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s9nw\" (UniqueName: \"kubernetes.io/projected/18ba8bdc-b840-4ccd-9287-944d61eaa77c-kube-api-access-9s9nw\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:33:49.328285 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.328219    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-kube-api-access-rw5xq" (OuterVolumeSpecName: "kube-api-access-rw5xq") pod "4ea2dd48-8ad0-42a8-9205-bd9d58b21076" (UID: "4ea2dd48-8ad0-42a8-9205-bd9d58b21076"). InnerVolumeSpecName "kube-api-access-rw5xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:33:49.332349 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.332314    2583 generic.go:356] "Generic (PLEG): container finished" podID="8e41c16f-f9e0-4387-ad77-83299a99be12" containerID="bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b" exitCode=0
Jul 30 11:33:49.332476 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.332357    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"
Jul 30 11:33:49.332476 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.332392    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5" event={"ID":"8e41c16f-f9e0-4387-ad77-83299a99be12","Type":"ContainerDied","Data":"bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b"}
Jul 30 11:33:49.332476 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.332445    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5" event={"ID":"8e41c16f-f9e0-4387-ad77-83299a99be12","Type":"ContainerDied","Data":"732c966dee7de6b8208a5d35415866c6faab387e7af732be4c0f9adeae2de27d"}
Jul 30 11:33:49.332476 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.332473    2583 scope.go:117] "RemoveContainer" containerID="bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b"
Jul 30 11:33:49.333753 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.333730    2583 generic.go:356] "Generic (PLEG): container finished" podID="18ba8bdc-b840-4ccd-9287-944d61eaa77c" containerID="842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8" exitCode=0
Jul 30 11:33:49.333853 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.333766    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb" event={"ID":"18ba8bdc-b840-4ccd-9287-944d61eaa77c","Type":"ContainerDied","Data":"842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8"}
Jul 30 11:33:49.333853 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.333792    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"
Jul 30 11:33:49.333853 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.333823    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb" event={"ID":"18ba8bdc-b840-4ccd-9287-944d61eaa77c","Type":"ContainerDied","Data":"fa00ca7bc75405605480bd67a9b7fb44036ed864b4207ae38ef10d0afb9b5e97"}
Jul 30 11:33:49.335299 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.335275    2583 generic.go:356] "Generic (PLEG): container finished" podID="4ea2dd48-8ad0-42a8-9205-bd9d58b21076" containerID="669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3" exitCode=0
Jul 30 11:33:49.335428 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.335325    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"
Jul 30 11:33:49.335428 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.335360    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj" event={"ID":"4ea2dd48-8ad0-42a8-9205-bd9d58b21076","Type":"ContainerDied","Data":"669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3"}
Jul 30 11:33:49.335428 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.335424    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj" event={"ID":"4ea2dd48-8ad0-42a8-9205-bd9d58b21076","Type":"ContainerDied","Data":"720627e2a4fb5629e727a2760b8ce5c83948836512ba6bfbf36da67795766d8a"}
Jul 30 11:33:49.342102 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.342083    2583 scope.go:117] "RemoveContainer" containerID="bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b"
Jul 30 11:33:49.342524 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:33:49.342496    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b\": container with ID starting with bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b not found: ID does not exist" containerID="bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b"
Jul 30 11:33:49.342624 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.342539    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b"} err="failed to get container status \"bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b\": rpc error: code = NotFound desc = could not find container \"bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b\": container with ID starting with bca795ca229aab21abe7da040865072f8c360a11e2729298ef04b08ca9eb926b not found: ID does not exist"
Jul 30 11:33:49.342624 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.342569    2583 scope.go:117] "RemoveContainer" containerID="842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8"
Jul 30 11:33:49.352793 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.352775    2583 scope.go:117] "RemoveContainer" containerID="842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8"
Jul 30 11:33:49.353094 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:33:49.353076    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8\": container with ID starting with 842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8 not found: ID does not exist" containerID="842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8"
Jul 30 11:33:49.353186 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.353101    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8"} err="failed to get container status \"842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8\": rpc error: code = NotFound desc = could not find container \"842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8\": container with ID starting with 842fc3240dc1e19bffdfaad828dc528b3c1c3bd026d7e1d90497ab6a5210d7f8 not found: ID does not exist"
Jul 30 11:33:49.353186 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.353117    2583 scope.go:117] "RemoveContainer" containerID="669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3"
Jul 30 11:33:49.361735 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.361716    2583 scope.go:117] "RemoveContainer" containerID="669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3"
Jul 30 11:33:49.362035 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:33:49.362012    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3\": container with ID starting with 669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3 not found: ID does not exist" containerID="669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3"
Jul 30 11:33:49.362109 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.362042    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3"} err="failed to get container status \"669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3\": rpc error: code = NotFound desc = could not find container \"669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3\": container with ID starting with 669fb2b7f03e491a9ef295324b9beadfae09c354b6817e4b1787571ad6514ee3 not found: ID does not exist"
Jul 30 11:33:49.368374 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.368343    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"]
Jul 30 11:33:49.374987 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.374955    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d6bcbf-84dd64dd6-l4ngb"]
Jul 30 11:33:49.387795 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.387758    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"]
Jul 30 11:33:49.392080 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.392046    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d6bcbf-f97b649fd-qrzk5"]
Jul 30 11:33:49.405921 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.405889    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"]
Jul 30 11:33:49.410214 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.410182    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d6bcbf-79fffbdcb8-rv8lj"]
Jul 30 11:33:49.427044 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:49.427004    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw5xq\" (UniqueName: \"kubernetes.io/projected/4ea2dd48-8ad0-42a8-9205-bd9d58b21076-kube-api-access-rw5xq\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:33:50.461770 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:50.461733    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18ba8bdc-b840-4ccd-9287-944d61eaa77c" path="/var/lib/kubelet/pods/18ba8bdc-b840-4ccd-9287-944d61eaa77c/volumes"
Jul 30 11:33:50.462148 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:50.462098    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ea2dd48-8ad0-42a8-9205-bd9d58b21076" path="/var/lib/kubelet/pods/4ea2dd48-8ad0-42a8-9205-bd9d58b21076/volumes"
Jul 30 11:33:50.462457 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:33:50.462443    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e41c16f-f9e0-4387-ad77-83299a99be12" path="/var/lib/kubelet/pods/8e41c16f-f9e0-4387-ad77-83299a99be12/volumes"
Jul 30 11:34:11.692392 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:11.692356    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"]
Jul 30 11:34:11.693001 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:11.692612    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr" podUID="fce8fc54-77f5-4c50-90e3-d126e4c09668" containerName="maas-api" containerID="cri-o://c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339" gracePeriod=30
Jul 30 11:34:11.745902 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:11.745867    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"]
Jul 30 11:34:11.746137 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:11.746087    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5" podUID="8ce4e3bb-cabf-435e-bfbd-2c5f56d29329" containerName="payload-processing" containerID="cri-o://fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d" gracePeriod=30
Jul 30 11:34:12.023891 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.023435    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:34:12.057584 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.057552    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fce8fc54-77f5-4c50-90e3-d126e4c09668-maas-api-tls\") pod \"fce8fc54-77f5-4c50-90e3-d126e4c09668\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") "
Jul 30 11:34:12.057721 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.057641    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thpwv\" (UniqueName: \"kubernetes.io/projected/fce8fc54-77f5-4c50-90e3-d126e4c09668-kube-api-access-thpwv\") pod \"fce8fc54-77f5-4c50-90e3-d126e4c09668\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") "
Jul 30 11:34:12.057721 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.057673    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fce8fc54-77f5-4c50-90e3-d126e4c09668-openshift-service-ca\") pod \"fce8fc54-77f5-4c50-90e3-d126e4c09668\" (UID: \"fce8fc54-77f5-4c50-90e3-d126e4c09668\") "
Jul 30 11:34:12.058155 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.058121    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fce8fc54-77f5-4c50-90e3-d126e4c09668-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fce8fc54-77f5-4c50-90e3-d126e4c09668" (UID: "fce8fc54-77f5-4c50-90e3-d126e4c09668"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:34:12.059890 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.059860    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce8fc54-77f5-4c50-90e3-d126e4c09668-kube-api-access-thpwv" (OuterVolumeSpecName: "kube-api-access-thpwv") pod "fce8fc54-77f5-4c50-90e3-d126e4c09668" (UID: "fce8fc54-77f5-4c50-90e3-d126e4c09668"). InnerVolumeSpecName "kube-api-access-thpwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:34:12.060481 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.060442    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fce8fc54-77f5-4c50-90e3-d126e4c09668-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fce8fc54-77f5-4c50-90e3-d126e4c09668" (UID: "fce8fc54-77f5-4c50-90e3-d126e4c09668"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 11:34:12.063659 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.063639    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:34:12.158486 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.158447    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k8t6\" (UniqueName: \"kubernetes.io/projected/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-kube-api-access-8k8t6\") pod \"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329\" (UID: \"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329\") "
Jul 30 11:34:12.158681 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.158562    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-plugins-config-volume\") pod \"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329\" (UID: \"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329\") "
Jul 30 11:34:12.158889 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.158867    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ce4e3bb-cabf-435e-bfbd-2c5f56d29329" (UID: "8ce4e3bb-cabf-435e-bfbd-2c5f56d29329"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:34:12.158959 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.158906    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fce8fc54-77f5-4c50-90e3-d126e4c09668-maas-api-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:12.158959 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.158920    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thpwv\" (UniqueName: \"kubernetes.io/projected/fce8fc54-77f5-4c50-90e3-d126e4c09668-kube-api-access-thpwv\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:12.158959 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.158931    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fce8fc54-77f5-4c50-90e3-d126e4c09668-openshift-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:12.160572 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.160548    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-kube-api-access-8k8t6" (OuterVolumeSpecName: "kube-api-access-8k8t6") pod "8ce4e3bb-cabf-435e-bfbd-2c5f56d29329" (UID: "8ce4e3bb-cabf-435e-bfbd-2c5f56d29329"). InnerVolumeSpecName "kube-api-access-8k8t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:34:12.260291 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.260140    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k8t6\" (UniqueName: \"kubernetes.io/projected/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-kube-api-access-8k8t6\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:12.260291 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.260182    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:12.461519 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.461481    2583 generic.go:356] "Generic (PLEG): container finished" podID="fce8fc54-77f5-4c50-90e3-d126e4c09668" containerID="c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339" exitCode=0
Jul 30 11:34:12.461718 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.461596    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"
Jul 30 11:34:12.462387 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.462358    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr" event={"ID":"fce8fc54-77f5-4c50-90e3-d126e4c09668","Type":"ContainerDied","Data":"c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339"}
Jul 30 11:34:12.462519 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.462412    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr" event={"ID":"fce8fc54-77f5-4c50-90e3-d126e4c09668","Type":"ContainerDied","Data":"c92c09ee6a558849a8321bae3ecfe94a5a2b6eb56fe84edc5b3711a12a8dbc6f"}
Jul 30 11:34:12.462519 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.462451    2583 scope.go:117] "RemoveContainer" containerID="c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339"
Jul 30 11:34:12.463143 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.463117    2583 generic.go:356] "Generic (PLEG): container finished" podID="8ce4e3bb-cabf-435e-bfbd-2c5f56d29329" containerID="fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d" exitCode=0
Jul 30 11:34:12.463279 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.463167    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"
Jul 30 11:34:12.463279 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.463179    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5" event={"ID":"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329","Type":"ContainerDied","Data":"fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d"}
Jul 30 11:34:12.463279 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.463216    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5" event={"ID":"8ce4e3bb-cabf-435e-bfbd-2c5f56d29329","Type":"ContainerDied","Data":"12c85744c186d2737012d4f6bda1f67398a75ed482d75afce4a96a4072e1b6d5"}
Jul 30 11:34:12.472454 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.472287    2583 scope.go:117] "RemoveContainer" containerID="c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339"
Jul 30 11:34:12.472672 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:34:12.472642    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339\": container with ID starting with c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339 not found: ID does not exist" containerID="c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339"
Jul 30 11:34:12.472797 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.472684    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339"} err="failed to get container status \"c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339\": rpc error: code = NotFound desc = could not find container \"c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339\": container with ID starting with c9c87ed912be11db1f77a20cd63c017a3f61b6fcb4ef6e95bb7a8c25bfee4339 not found: ID does not exist"
Jul 30 11:34:12.472797 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.472708    2583 scope.go:117] "RemoveContainer" containerID="fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d"
Jul 30 11:34:12.481868 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.481847    2583 scope.go:117] "RemoveContainer" containerID="fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d"
Jul 30 11:34:12.482196 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:34:12.482170    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d\": container with ID starting with fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d not found: ID does not exist" containerID="fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d"
Jul 30 11:34:12.482282 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.482207    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d"} err="failed to get container status \"fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d\": rpc error: code = NotFound desc = could not find container \"fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d\": container with ID starting with fa6b85ee1462d53b1527bd6aa13dc09926489ad1f8cdd22fc843f471abddef8d not found: ID does not exist"
Jul 30 11:34:12.493118 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.493079    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"]
Jul 30 11:34:12.497271 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.497240    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3c382f-569ccd7b7c-gzfxr"]
Jul 30 11:34:12.511471 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.511379    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"]
Jul 30 11:34:12.517536 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:12.517503    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-3c382f-5f757c94bd-9dbd5"]
Jul 30 11:34:14.461950 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:14.461911    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce4e3bb-cabf-435e-bfbd-2c5f56d29329" path="/var/lib/kubelet/pods/8ce4e3bb-cabf-435e-bfbd-2c5f56d29329/volumes"
Jul 30 11:34:14.462354 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:14.462339    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce8fc54-77f5-4c50-90e3-d126e4c09668" path="/var/lib/kubelet/pods/fce8fc54-77f5-4c50-90e3-d126e4c09668/volumes"
Jul 30 11:34:18.497436 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:18.497400    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"]
Jul 30 11:34:18.497871 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:18.497676    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy" containerID="cri-o://b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715" gracePeriod=30
Jul 30 11:34:23.755667 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.755639    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:34:23.848529 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848452    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"]
Jul 30 11:34:23.848845 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848832    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy"
Jul 30 11:34:23.848896 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848846    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy"
Jul 30 11:34:23.848896 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848860    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ea2dd48-8ad0-42a8-9205-bd9d58b21076" containerName="payload-pre-processing"
Jul 30 11:34:23.848896 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848866    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ea2dd48-8ad0-42a8-9205-bd9d58b21076" containerName="payload-pre-processing"
Jul 30 11:34:23.848896 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848878    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce8fc54-77f5-4c50-90e3-d126e4c09668" containerName="maas-api"
Jul 30 11:34:23.848896 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848883    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce8fc54-77f5-4c50-90e3-d126e4c09668" containerName="maas-api"
Jul 30 11:34:23.848896 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848890    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e41c16f-f9e0-4387-ad77-83299a99be12" containerName="payload-processing"
Jul 30 11:34:23.848896 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848896    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e41c16f-f9e0-4387-ad77-83299a99be12" containerName="payload-processing"
Jul 30 11:34:23.849123 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848910    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18ba8bdc-b840-4ccd-9287-944d61eaa77c" containerName="maas-api"
Jul 30 11:34:23.849123 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848915    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="18ba8bdc-b840-4ccd-9287-944d61eaa77c" containerName="maas-api"
Jul 30 11:34:23.849123 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848923    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce4e3bb-cabf-435e-bfbd-2c5f56d29329" containerName="payload-processing"
Jul 30 11:34:23.849123 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848929    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce4e3bb-cabf-435e-bfbd-2c5f56d29329" containerName="payload-processing"
Jul 30 11:34:23.849123 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848981    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="18ba8bdc-b840-4ccd-9287-944d61eaa77c" containerName="maas-api"
Jul 30 11:34:23.849123 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848988    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ea2dd48-8ad0-42a8-9205-bd9d58b21076" containerName="payload-pre-processing"
Jul 30 11:34:23.849123 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.848995    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce8fc54-77f5-4c50-90e3-d126e4c09668" containerName="maas-api"
Jul 30 11:34:23.849123 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.849001    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy"
Jul 30 11:34:23.849123 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.849007    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy"
Jul 30 11:34:23.849123 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.849013    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce4e3bb-cabf-435e-bfbd-2c5f56d29329" containerName="payload-processing"
Jul 30 11:34:23.849123 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.849020    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e41c16f-f9e0-4387-ad77-83299a99be12" containerName="payload-processing"
Jul 30 11:34:23.852204 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.852184    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:23.854922 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.854895    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-060e9f-serving-cert\""
Jul 30 11:34:23.855084 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.855058    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 11:34:23.855163 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.855077    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gvjcm\""
Jul 30 11:34:23.855622 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.855606    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 11:34:23.864387 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.864351    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"]
Jul 30 11:34:23.873945 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.873910    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-socket\") pod \"4863d5ea-911f-452e-9723-3574218a7cb5\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") "
Jul 30 11:34:23.873945 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.873949    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-data\") pod \"4863d5ea-911f-452e-9723-3574218a7cb5\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") "
Jul 30 11:34:23.874221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.873989    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-credential-socket\") pod \"4863d5ea-911f-452e-9723-3574218a7cb5\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") "
Jul 30 11:34:23.874221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874017    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-envoy\") pod \"4863d5ea-911f-452e-9723-3574218a7cb5\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") "
Jul 30 11:34:23.874221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874048    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh7hb\" (UniqueName: \"kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-kube-api-access-hh7hb\") pod \"4863d5ea-911f-452e-9723-3574218a7cb5\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") "
Jul 30 11:34:23.874221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874089    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-istio-token\") pod \"4863d5ea-911f-452e-9723-3574218a7cb5\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") "
Jul 30 11:34:23.874221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874134    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-certs\") pod \"4863d5ea-911f-452e-9723-3574218a7cb5\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") "
Jul 30 11:34:23.874221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874168    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4863d5ea-911f-452e-9723-3574218a7cb5-istio-podinfo\") pod \"4863d5ea-911f-452e-9723-3574218a7cb5\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") "
Jul 30 11:34:23.874221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874218    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4863d5ea-911f-452e-9723-3574218a7cb5-istiod-ca-cert\") pod \"4863d5ea-911f-452e-9723-3574218a7cb5\" (UID: \"4863d5ea-911f-452e-9723-3574218a7cb5\") "
Jul 30 11:34:23.874636 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874330    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4863d5ea-911f-452e-9723-3574218a7cb5" (UID: "4863d5ea-911f-452e-9723-3574218a7cb5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:34:23.874636 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874474    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4863d5ea-911f-452e-9723-3574218a7cb5" (UID: "4863d5ea-911f-452e-9723-3574218a7cb5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:34:23.874761 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874653    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-credential-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:23.874761 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874674    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:23.874857 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874777    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4863d5ea-911f-452e-9723-3574218a7cb5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4863d5ea-911f-452e-9723-3574218a7cb5" (UID: "4863d5ea-911f-452e-9723-3574218a7cb5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:34:23.874857 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874834    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4863d5ea-911f-452e-9723-3574218a7cb5" (UID: "4863d5ea-911f-452e-9723-3574218a7cb5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:34:23.874965 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.874918    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-data" (OuterVolumeSpecName: "istio-data") pod "4863d5ea-911f-452e-9723-3574218a7cb5" (UID: "4863d5ea-911f-452e-9723-3574218a7cb5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:34:23.877659 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.877074    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4863d5ea-911f-452e-9723-3574218a7cb5" (UID: "4863d5ea-911f-452e-9723-3574218a7cb5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:34:23.877659 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.877212    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-kube-api-access-hh7hb" (OuterVolumeSpecName: "kube-api-access-hh7hb") pod "4863d5ea-911f-452e-9723-3574218a7cb5" (UID: "4863d5ea-911f-452e-9723-3574218a7cb5"). InnerVolumeSpecName "kube-api-access-hh7hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:34:23.878119 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.877808    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4863d5ea-911f-452e-9723-3574218a7cb5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4863d5ea-911f-452e-9723-3574218a7cb5" (UID: "4863d5ea-911f-452e-9723-3574218a7cb5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 11:34:23.878187 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.878163    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-istio-token" (OuterVolumeSpecName: "istio-token") pod "4863d5ea-911f-452e-9723-3574218a7cb5" (UID: "4863d5ea-911f-452e-9723-3574218a7cb5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:34:23.975494 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.975446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8slk\" (UniqueName: \"kubernetes.io/projected/288a1882-4651-4070-a1be-c0e9b72039ff-kube-api-access-p8slk\") pod \"maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:23.975678 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.975530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/288a1882-4651-4070-a1be-c0e9b72039ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:23.975678 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.975570    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/288a1882-4651-4070-a1be-c0e9b72039ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:23.975678 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.975652    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-workload-certs\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:23.975678 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.975672    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4863d5ea-911f-452e-9723-3574218a7cb5-istio-podinfo\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:23.975817 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.975682    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4863d5ea-911f-452e-9723-3574218a7cb5-istiod-ca-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:23.975817 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.975692    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-data\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:23.975817 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.975700    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4863d5ea-911f-452e-9723-3574218a7cb5-istio-envoy\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:23.975817 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.975709    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh7hb\" (UniqueName: \"kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-kube-api-access-hh7hb\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:23.975817 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:23.975717    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4863d5ea-911f-452e-9723-3574218a7cb5-istio-token\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:34:24.076421 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.076378    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/288a1882-4651-4070-a1be-c0e9b72039ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:24.076634 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.076465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8slk\" (UniqueName: \"kubernetes.io/projected/288a1882-4651-4070-a1be-c0e9b72039ff-kube-api-access-p8slk\") pod \"maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:24.076634 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.076543    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/288a1882-4651-4070-a1be-c0e9b72039ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:24.077166 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.077142    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/288a1882-4651-4070-a1be-c0e9b72039ff-openshift-service-ca\") pod \"maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:24.078846 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.078824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/288a1882-4651-4070-a1be-c0e9b72039ff-maas-api-tls\") pod \"maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:24.085882 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.085858    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8slk\" (UniqueName: \"kubernetes.io/projected/288a1882-4651-4070-a1be-c0e9b72039ff-kube-api-access-p8slk\") pod \"maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:24.165039 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.165007    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:24.319139 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.319116    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"]
Jul 30 11:34:24.320881 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:34:24.320854    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod288a1882_4651_4070_a1be_c0e9b72039ff.slice/crio-4dd043864c690489259932db90c85dca51c93227eff509a3a14a1c74915d9200 WatchSource:0}: Error finding container 4dd043864c690489259932db90c85dca51c93227eff509a3a14a1c74915d9200: Status 404 returned error can't find the container with id 4dd043864c690489259932db90c85dca51c93227eff509a3a14a1c74915d9200
Jul 30 11:34:24.532297 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.532259    2583 generic.go:356] "Generic (PLEG): container finished" podID="4863d5ea-911f-452e-9723-3574218a7cb5" containerID="b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715" exitCode=0
Jul 30 11:34:24.532474 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.532303    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"
Jul 30 11:34:24.532474 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.532324    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" event={"ID":"4863d5ea-911f-452e-9723-3574218a7cb5","Type":"ContainerDied","Data":"b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715"}
Jul 30 11:34:24.532474 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.532389    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z" event={"ID":"4863d5ea-911f-452e-9723-3574218a7cb5","Type":"ContainerDied","Data":"db28dfe82a2d94c62b9cc9af8fa25cdbf19522f456bd2dd1c0d73a6bdce64fed"}
Jul 30 11:34:24.532474 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.532422    2583 scope.go:117] "RemoveContainer" containerID="b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715"
Jul 30 11:34:24.534082 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.534056    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm" event={"ID":"288a1882-4651-4070-a1be-c0e9b72039ff","Type":"ContainerStarted","Data":"4dd043864c690489259932db90c85dca51c93227eff509a3a14a1c74915d9200"}
Jul 30 11:34:24.542067 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.542043    2583 scope.go:117] "RemoveContainer" containerID="421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9"
Jul 30 11:34:24.550664 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.550640    2583 scope.go:117] "RemoveContainer" containerID="b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715"
Jul 30 11:34:24.551089 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:34:24.551033    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715\": container with ID starting with b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715 not found: ID does not exist" containerID="b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715"
Jul 30 11:34:24.551221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.551100    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715"} err="failed to get container status \"b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715\": rpc error: code = NotFound desc = could not find container \"b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715\": container with ID starting with b847faccb18e059329bfa34dc0d14108031b6cc7c546ab6bbfd61a90bcb8f715 not found: ID does not exist"
Jul 30 11:34:24.551221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.551136    2583 scope.go:117] "RemoveContainer" containerID="421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9"
Jul 30 11:34:24.551838 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:34:24.551812    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9\": container with ID starting with 421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9 not found: ID does not exist" containerID="421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9"
Jul 30 11:34:24.551838 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.551845    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9"} err="failed to get container status \"421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9\": rpc error: code = NotFound desc = could not find container \"421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9\": container with ID starting with 421a7f467232fce17486c873d8b11c6110b0b53783274a5077ad2a31b6d8c6d9 not found: ID does not exist"
Jul 30 11:34:24.553949 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.553928    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"]
Jul 30 11:34:24.573582 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.573031    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-3c382f-openshift-default-76484b8744-rxb8z"]
Jul 30 11:34:24.709020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.708984    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"]
Jul 30 11:34:24.709534 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.709515    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy"
Jul 30 11:34:24.709534 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.709535    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" containerName="istio-proxy"
Jul 30 11:34:24.712668 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.712643    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:34:24.715313 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.715287    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-060e9f\""
Jul 30 11:34:24.715436 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.715329    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-060e9f-dockercfg-lfxw8\""
Jul 30 11:34:24.723042 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.723011    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"]
Jul 30 11:34:24.785628 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.785592    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29\" (UID: \"e6a979b5-b35b-4124-9689-e2b4cdda8a9c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:34:24.786049 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.785731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq5p5\" (UniqueName: \"kubernetes.io/projected/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-kube-api-access-bq5p5\") pod \"payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29\" (UID: \"e6a979b5-b35b-4124-9689-e2b4cdda8a9c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:34:24.801605 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.801569    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"]
Jul 30 11:34:24.805076 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.805057    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:34:24.816544 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.816517    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"]
Jul 30 11:34:24.886494 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.886432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq5p5\" (UniqueName: \"kubernetes.io/projected/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-kube-api-access-bq5p5\") pod \"payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29\" (UID: \"e6a979b5-b35b-4124-9689-e2b4cdda8a9c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:34:24.886696 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.886533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96379f9e-6612-46cf-b8fd-6ee36e540b57-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr\" (UID: \"96379f9e-6612-46cf-b8fd-6ee36e540b57\") " pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:34:24.886696 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.886556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf6m4\" (UniqueName: \"kubernetes.io/projected/96379f9e-6612-46cf-b8fd-6ee36e540b57-kube-api-access-xf6m4\") pod \"payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr\" (UID: \"96379f9e-6612-46cf-b8fd-6ee36e540b57\") " pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:34:24.886696 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.886580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29\" (UID: \"e6a979b5-b35b-4124-9689-e2b4cdda8a9c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:34:24.887255 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.887210    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29\" (UID: \"e6a979b5-b35b-4124-9689-e2b4cdda8a9c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:34:24.895062 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.895029    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq5p5\" (UniqueName: \"kubernetes.io/projected/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-kube-api-access-bq5p5\") pod \"payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29\" (UID: \"e6a979b5-b35b-4124-9689-e2b4cdda8a9c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:34:24.987877 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.987777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96379f9e-6612-46cf-b8fd-6ee36e540b57-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr\" (UID: \"96379f9e-6612-46cf-b8fd-6ee36e540b57\") " pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:34:24.987877 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.987820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf6m4\" (UniqueName: \"kubernetes.io/projected/96379f9e-6612-46cf-b8fd-6ee36e540b57-kube-api-access-xf6m4\") pod \"payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr\" (UID: \"96379f9e-6612-46cf-b8fd-6ee36e540b57\") " pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:34:24.988566 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.988547    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96379f9e-6612-46cf-b8fd-6ee36e540b57-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr\" (UID: \"96379f9e-6612-46cf-b8fd-6ee36e540b57\") " pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:34:24.997335 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:24.997306    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf6m4\" (UniqueName: \"kubernetes.io/projected/96379f9e-6612-46cf-b8fd-6ee36e540b57-kube-api-access-xf6m4\") pod \"payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr\" (UID: \"96379f9e-6612-46cf-b8fd-6ee36e540b57\") " pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:34:25.023951 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.023910    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:34:25.118549 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.118516    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:34:25.172078 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.172048    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"]
Jul 30 11:34:25.272447 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.272419    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"]
Jul 30 11:34:25.274594 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:34:25.274562    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96379f9e_6612_46cf_b8fd_6ee36e540b57.slice/crio-aac43c6f6f7156a19fd78e85346b88b38660f3e482e749719f6b945def9be284 WatchSource:0}: Error finding container aac43c6f6f7156a19fd78e85346b88b38660f3e482e749719f6b945def9be284: Status 404 returned error can't find the container with id aac43c6f6f7156a19fd78e85346b88b38660f3e482e749719f6b945def9be284
Jul 30 11:34:25.542662 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.542545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm" event={"ID":"288a1882-4651-4070-a1be-c0e9b72039ff","Type":"ContainerStarted","Data":"0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2"}
Jul 30 11:34:25.542662 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.542624    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:25.544283 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.544252    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29" event={"ID":"e6a979b5-b35b-4124-9689-e2b4cdda8a9c","Type":"ContainerStarted","Data":"aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a"}
Jul 30 11:34:25.544427 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.544310    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29" event={"ID":"e6a979b5-b35b-4124-9689-e2b4cdda8a9c","Type":"ContainerStarted","Data":"38fd1ed25723923ff5e0afab4806f2f698eb0883ed4783d6e5ec4ba72b2eb7aa"}
Jul 30 11:34:25.544427 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.544373    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:34:25.545994 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.545965    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr" event={"ID":"96379f9e-6612-46cf-b8fd-6ee36e540b57","Type":"ContainerStarted","Data":"135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b"}
Jul 30 11:34:25.546139 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.546025    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:34:25.546139 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.546048    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr" event={"ID":"96379f9e-6612-46cf-b8fd-6ee36e540b57","Type":"ContainerStarted","Data":"aac43c6f6f7156a19fd78e85346b88b38660f3e482e749719f6b945def9be284"}
Jul 30 11:34:25.563495 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.563435    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm" podStartSLOduration=2.15609165 podStartE2EDuration="2.563417638s" totalImagesPullingTime="407.325988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:34:25.561376308 +0000 UTC m=+2769.670017813" watchObservedRunningTime="2026-07-30 11:34:25.563417638 +0000 UTC m=+2769.672059130"
Jul 30 11:34:25.580554 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.580500    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr" podStartSLOduration=1.5804816659999998 podStartE2EDuration="1.580481666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:34:25.578550737 +0000 UTC m=+2769.687192230" watchObservedRunningTime="2026-07-30 11:34:25.580481666 +0000 UTC m=+2769.689123175"
Jul 30 11:34:25.603044 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:25.602991    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29" podStartSLOduration=1.602973318 podStartE2EDuration="1.602973318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:34:25.60221653 +0000 UTC m=+2769.710858013" watchObservedRunningTime="2026-07-30 11:34:25.602973318 +0000 UTC m=+2769.711614810"
Jul 30 11:34:26.462139 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:26.462099    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4863d5ea-911f-452e-9723-3574218a7cb5" path="/var/lib/kubelet/pods/4863d5ea-911f-452e-9723-3574218a7cb5/volumes"
Jul 30 11:34:31.557174 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:31.557137    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:34:36.553933 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:36.553896    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:34:36.554350 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:36.553980    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:34:48.415976 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.415936    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"]
Jul 30 11:34:48.421541 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.421513    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.424398 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.424370    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-945db9-openshift-default-dockercfg-klllm\""
Jul 30 11:34:48.434474 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.434440    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"]
Jul 30 11:34:48.524443 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.524403    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-certs\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.524443 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.524445    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-podinfo\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.524686 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.524517    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istiod-ca-cert\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.524686 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.524588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-envoy\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.524686 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.524630    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-socket\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.524686 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.524652    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-credential-socket\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.524922 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.524753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7zkw\" (UniqueName: \"kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-kube-api-access-d7zkw\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.524922 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.524788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-token\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.524922 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.524815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-data\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.625782 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.625742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7zkw\" (UniqueName: \"kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-kube-api-access-d7zkw\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.625994 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.625845    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-token\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626094 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626044    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-data\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626154 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-certs\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626217 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-podinfo\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626217 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istiod-ca-cert\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626363 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626333    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-envoy\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626416 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-socket\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626416 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-credential-socket\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626563 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626513    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-data\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626647 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626526    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-certs\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626826 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626804    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-socket\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626910 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626803    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-credential-socket\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.626974 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.626956    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istiod-ca-cert\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.628785 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.628756    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-podinfo\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.628874 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.628799    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-envoy\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.634761 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.634732    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-token\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.634930 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.634907    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7zkw\" (UniqueName: \"kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-kube-api-access-d7zkw\") pod \"e2e-shared-b-945db9-openshift-default-6648499d88-574td\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") " pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.733710 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.733600    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:48.890479 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.890451    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"]
Jul 30 11:34:48.892304 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:34:48.892272    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7a15e4_4daa_4641_ac6c_7445d8f78046.slice/crio-eee2cf37ccf94241cd813ea2aca66031662b4758e2fdfc5baa86771f5bf01434 WatchSource:0}: Error finding container eee2cf37ccf94241cd813ea2aca66031662b4758e2fdfc5baa86771f5bf01434: Status 404 returned error can't find the container with id eee2cf37ccf94241cd813ea2aca66031662b4758e2fdfc5baa86771f5bf01434
Jul 30 11:34:48.894838 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.894801    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:34:48.894961 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.894874    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:34:48.894961 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:48.894905    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:34:49.678504 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:49.678457    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" event={"ID":"ae7a15e4-4daa-4641-ac6c-7445d8f78046","Type":"ContainerStarted","Data":"e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014"}
Jul 30 11:34:49.678504 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:49.678514    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" event={"ID":"ae7a15e4-4daa-4641-ac6c-7445d8f78046","Type":"ContainerStarted","Data":"eee2cf37ccf94241cd813ea2aca66031662b4758e2fdfc5baa86771f5bf01434"}
Jul 30 11:34:49.699909 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:49.699850    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" podStartSLOduration=1.699829148 podStartE2EDuration="1.699829148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:34:49.698079808 +0000 UTC m=+2793.806721301" watchObservedRunningTime="2026-07-30 11:34:49.699829148 +0000 UTC m=+2793.808470640"
Jul 30 11:34:49.733942 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:49.733899    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:49.739240 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:49.739193    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:50.683896 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:50.683865    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:50.685009 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:50.684991    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:34:52.892447 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:52.892402    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"]
Jul 30 11:34:52.896373 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:52.896351    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:52.899179 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:52.899159    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-945db9-serving-cert\""
Jul 30 11:34:52.906908 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:52.906880    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"]
Jul 30 11:34:52.968839 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:52.968797    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed8f09b-4695-43dd-a9ee-17b927c47009-openshift-service-ca\") pod \"maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:52.969027 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:52.968866    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed8f09b-4695-43dd-a9ee-17b927c47009-maas-api-tls\") pod \"maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:52.969027 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:52.968930    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhdb4\" (UniqueName: \"kubernetes.io/projected/8ed8f09b-4695-43dd-a9ee-17b927c47009-kube-api-access-jhdb4\") pod \"maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:53.070209 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:53.070173    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed8f09b-4695-43dd-a9ee-17b927c47009-openshift-service-ca\") pod \"maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:53.070443 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:53.070258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed8f09b-4695-43dd-a9ee-17b927c47009-maas-api-tls\") pod \"maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:53.070443 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:53.070350    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhdb4\" (UniqueName: \"kubernetes.io/projected/8ed8f09b-4695-43dd-a9ee-17b927c47009-kube-api-access-jhdb4\") pod \"maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:53.070443 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:34:53.070406    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-serving-cert: secret "maas-api-e2e-shared-b-945db9-serving-cert" not found
Jul 30 11:34:53.070591 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:34:53.070480    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed8f09b-4695-43dd-a9ee-17b927c47009-maas-api-tls podName:8ed8f09b-4695-43dd-a9ee-17b927c47009 nodeName:}" failed. No retries permitted until 2026-07-30 11:34:53.57046193 +0000 UTC m=+2797.679103406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8ed8f09b-4695-43dd-a9ee-17b927c47009-maas-api-tls") pod "maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc" (UID: "8ed8f09b-4695-43dd-a9ee-17b927c47009") : secret "maas-api-e2e-shared-b-945db9-serving-cert" not found
Jul 30 11:34:53.070805 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:53.070787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed8f09b-4695-43dd-a9ee-17b927c47009-openshift-service-ca\") pod \"maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:53.080382 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:53.080361    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhdb4\" (UniqueName: \"kubernetes.io/projected/8ed8f09b-4695-43dd-a9ee-17b927c47009-kube-api-access-jhdb4\") pod \"maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:53.575992 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:53.575952    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed8f09b-4695-43dd-a9ee-17b927c47009-maas-api-tls\") pod \"maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:53.578348 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:53.578314    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed8f09b-4695-43dd-a9ee-17b927c47009-maas-api-tls\") pod \"maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:53.808850 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:53.808806    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:53.976126 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:53.976091    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"]
Jul 30 11:34:53.978864 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:34:53.978835    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed8f09b_4695_43dd_a9ee_17b927c47009.slice/crio-76bcd99a084be00af95886611ba5dbf62fdaffdde0668829d68b3cd3da132f9f WatchSource:0}: Error finding container 76bcd99a084be00af95886611ba5dbf62fdaffdde0668829d68b3cd3da132f9f: Status 404 returned error can't find the container with id 76bcd99a084be00af95886611ba5dbf62fdaffdde0668829d68b3cd3da132f9f
Jul 30 11:34:54.705991 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:54.705902    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc" event={"ID":"8ed8f09b-4695-43dd-a9ee-17b927c47009","Type":"ContainerStarted","Data":"04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa"}
Jul 30 11:34:54.705991 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:54.705953    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc" event={"ID":"8ed8f09b-4695-43dd-a9ee-17b927c47009","Type":"ContainerStarted","Data":"76bcd99a084be00af95886611ba5dbf62fdaffdde0668829d68b3cd3da132f9f"}
Jul 30 11:34:54.706214 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:54.706038    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:34:54.730118 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:34:54.730054    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc" podStartSLOduration=2.2699205129999998 podStartE2EDuration="2.730035728s" totalImagesPullingTime="460.115215ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:34:54.726974632 +0000 UTC m=+2798.835616125" watchObservedRunningTime="2026-07-30 11:34:54.730035728 +0000 UTC m=+2798.838677253"
Jul 30 11:35:00.716706 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:00.716673    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:35:05.685622 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:05.685579    2583 patch_prober.go:28] interesting pod/e2e-shared-b-945db9-openshift-default-6648499d88-574td container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 30 11:35:05.686058 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:05.685656    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 30 11:35:05.779062 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:05.778976    2583 generic.go:356] "Generic (PLEG): container finished" podID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerID="e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014" exitCode=0
Jul 30 11:35:05.779062 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:05.779043    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" event={"ID":"ae7a15e4-4daa-4641-ac6c-7445d8f78046","Type":"ContainerDied","Data":"e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014"}
Jul 30 11:35:05.779516 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:05.779503    2583 scope.go:117] "RemoveContainer" containerID="e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014"
Jul 30 11:35:05.780673 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:05.780635    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:35:05.780745 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:05.780712    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:35:05.780785 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:05.780754    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 11:35:06.786455 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:06.786416    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" event={"ID":"ae7a15e4-4daa-4641-ac6c-7445d8f78046","Type":"ContainerStarted","Data":"ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526"}
Jul 30 11:35:07.734681 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:07.734624    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:35:07.735920 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:07.735811    2583 patch_prober.go:28] interesting pod/e2e-shared-b-945db9-openshift-default-6648499d88-574td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 30 11:35:07.736153 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:07.736130    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 30 11:35:08.734947 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:08.734904    2583 patch_prober.go:28] interesting pod/e2e-shared-b-945db9-openshift-default-6648499d88-574td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 30 11:35:08.735589 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:08.735553    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 30 11:35:09.734300 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:09.734257    2583 patch_prober.go:28] interesting pod/e2e-shared-b-945db9-openshift-default-6648499d88-574td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 30 11:35:09.734618 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:09.734580    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 30 11:35:10.734692 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:10.734651    2583 patch_prober.go:28] interesting pod/e2e-shared-b-945db9-openshift-default-6648499d88-574td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 30 11:35:10.735332 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:10.735296    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 30 11:35:11.734154 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:11.734111    2583 patch_prober.go:28] interesting pod/e2e-shared-b-945db9-openshift-default-6648499d88-574td container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 30 11:35:11.734374 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:11.734189    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 30 11:35:12.738728 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:12.738698    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:35:12.739179 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:12.738967    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:35:12.739854 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:35:12.739833    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:37:16.732148 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:37:16.732113    2583 scope.go:117] "RemoveContainer" containerID="5ba13393913e5f3debd4d7d1e52c69f47873d22b80758a39f0c498d86ee81df2"
Jul 30 11:43:19.714988 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.714951    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"]
Jul 30 11:43:19.717757 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.717730    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:19.720390 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.720363    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-d722d1-serving-cert\""
Jul 30 11:43:19.730722 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.730321    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"]
Jul 30 11:43:19.882991 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.882951    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sttk\" (UniqueName: \"kubernetes.io/projected/550ca33c-645b-48b4-b2fb-30802435e841-kube-api-access-5sttk\") pod \"maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:19.883221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.883002    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/550ca33c-645b-48b4-b2fb-30802435e841-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:19.883221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.883066    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/550ca33c-645b-48b4-b2fb-30802435e841-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:19.983978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.983876    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sttk\" (UniqueName: \"kubernetes.io/projected/550ca33c-645b-48b4-b2fb-30802435e841-kube-api-access-5sttk\") pod \"maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:19.983978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.983924    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/550ca33c-645b-48b4-b2fb-30802435e841-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:19.983978 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.983957    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/550ca33c-645b-48b4-b2fb-30802435e841-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:19.984841 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.984810    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/550ca33c-645b-48b4-b2fb-30802435e841-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:19.986689 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.986662    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/550ca33c-645b-48b4-b2fb-30802435e841-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:19.992584 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:19.992552    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sttk\" (UniqueName: \"kubernetes.io/projected/550ca33c-645b-48b4-b2fb-30802435e841-kube-api-access-5sttk\") pod \"maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:20.032292 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:20.032248    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:20.187048 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:20.186922    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"]
Jul 30 11:43:20.189730 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:43:20.189691    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550ca33c_645b_48b4_b2fb_30802435e841.slice/crio-86ea1fe2222ce85a7ad25e0183bcb738a04e6ec07c96e146bc739f993c698634 WatchSource:0}: Error finding container 86ea1fe2222ce85a7ad25e0183bcb738a04e6ec07c96e146bc739f993c698634: Status 404 returned error can't find the container with id 86ea1fe2222ce85a7ad25e0183bcb738a04e6ec07c96e146bc739f993c698634
Jul 30 11:43:20.191143 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:20.191121    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 11:43:20.388821 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:20.388698    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77" event={"ID":"550ca33c-645b-48b4-b2fb-30802435e841","Type":"ContainerStarted","Data":"86ea1fe2222ce85a7ad25e0183bcb738a04e6ec07c96e146bc739f993c698634"}
Jul 30 11:43:21.396095 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:21.396062    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77" event={"ID":"550ca33c-645b-48b4-b2fb-30802435e841","Type":"ContainerStarted","Data":"77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb"}
Jul 30 11:43:21.396510 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:21.396182    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:43:21.415327 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:21.415266    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77" podStartSLOduration=2.05372979 podStartE2EDuration="2.415250206s" totalImagesPullingTime="361.520416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:43:21.41433505 +0000 UTC m=+3305.522976543" watchObservedRunningTime="2026-07-30 11:43:21.415250206 +0000 UTC m=+3305.523891737"
Jul 30 11:43:27.407453 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:43:27.407421    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:45:16.391209 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.391172    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"]
Jul 30 11:45:16.395263 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.395240    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:16.397898 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.397878    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-a93cc2-serving-cert\""
Jul 30 11:45:16.408629 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.408606    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"]
Jul 30 11:45:16.464165 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.464136    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53404a20-d963-4118-8c80-082a982cffad-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:16.464332 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.464168    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53404a20-d963-4118-8c80-082a982cffad-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:16.464332 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.464254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr2dj\" (UniqueName: \"kubernetes.io/projected/53404a20-d963-4118-8c80-082a982cffad-kube-api-access-pr2dj\") pod \"maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:16.565065 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.565032    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53404a20-d963-4118-8c80-082a982cffad-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:16.565307 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.565071    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53404a20-d963-4118-8c80-082a982cffad-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:16.565307 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.565126    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr2dj\" (UniqueName: \"kubernetes.io/projected/53404a20-d963-4118-8c80-082a982cffad-kube-api-access-pr2dj\") pod \"maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:16.565777 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.565754    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53404a20-d963-4118-8c80-082a982cffad-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:16.567623 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.567604    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53404a20-d963-4118-8c80-082a982cffad-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:16.573417 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.573395    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr2dj\" (UniqueName: \"kubernetes.io/projected/53404a20-d963-4118-8c80-082a982cffad-kube-api-access-pr2dj\") pod \"maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:16.707258 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.707199    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:16.852969 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:16.852943    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"]
Jul 30 11:45:16.855213 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:45:16.855187    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53404a20_d963_4118_8c80_082a982cffad.slice/crio-0090925f42d5bfe5c64ed38d5d3a326188b877b9cf0430cd739140c65360effe WatchSource:0}: Error finding container 0090925f42d5bfe5c64ed38d5d3a326188b877b9cf0430cd739140c65360effe: Status 404 returned error can't find the container with id 0090925f42d5bfe5c64ed38d5d3a326188b877b9cf0430cd739140c65360effe
Jul 30 11:45:17.023417 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.023334    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr" event={"ID":"53404a20-d963-4118-8c80-082a982cffad","Type":"ContainerStarted","Data":"0090925f42d5bfe5c64ed38d5d3a326188b877b9cf0430cd739140c65360effe"}
Jul 30 11:45:17.032783 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.032750    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"]
Jul 30 11:45:17.037556 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.037538    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:17.040537 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.040519    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-a93cc2\""
Jul 30 11:45:17.041371 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.041356    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-a93cc2-dockercfg-585qh\""
Jul 30 11:45:17.056374 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.056341    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"]
Jul 30 11:45:17.058451 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.058423    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"]
Jul 30 11:45:17.062283 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.062264    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:17.069834 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.069802    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t74pz\" (UniqueName: \"kubernetes.io/projected/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-kube-api-access-t74pz\") pod \"payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6\" (UID: \"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:17.070018 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.069988    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6\" (UID: \"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:17.077966 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.077932    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"]
Jul 30 11:45:17.171161 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.171123    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec6d3ff4-7865-4333-8910-80071512679c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9\" (UID: \"ec6d3ff4-7865-4333-8910-80071512679c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:17.171704 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.171457    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6\" (UID: \"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:17.171704 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.171600    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t74pz\" (UniqueName: \"kubernetes.io/projected/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-kube-api-access-t74pz\") pod \"payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6\" (UID: \"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:17.171704 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.171653    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmhlf\" (UniqueName: \"kubernetes.io/projected/ec6d3ff4-7865-4333-8910-80071512679c-kube-api-access-zmhlf\") pod \"payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9\" (UID: \"ec6d3ff4-7865-4333-8910-80071512679c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:17.173009 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.172986    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6\" (UID: \"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:17.185167 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.185141    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t74pz\" (UniqueName: \"kubernetes.io/projected/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-kube-api-access-t74pz\") pod \"payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6\" (UID: \"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:17.272344 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.272316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmhlf\" (UniqueName: \"kubernetes.io/projected/ec6d3ff4-7865-4333-8910-80071512679c-kube-api-access-zmhlf\") pod \"payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9\" (UID: \"ec6d3ff4-7865-4333-8910-80071512679c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:17.272451 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.272438    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec6d3ff4-7865-4333-8910-80071512679c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9\" (UID: \"ec6d3ff4-7865-4333-8910-80071512679c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:17.273122 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.273102    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec6d3ff4-7865-4333-8910-80071512679c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9\" (UID: \"ec6d3ff4-7865-4333-8910-80071512679c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:17.282946 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.282913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmhlf\" (UniqueName: \"kubernetes.io/projected/ec6d3ff4-7865-4333-8910-80071512679c-kube-api-access-zmhlf\") pod \"payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9\" (UID: \"ec6d3ff4-7865-4333-8910-80071512679c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:17.348626 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.348587    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:17.373487 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.373452    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:17.506362 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.506245    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"]
Jul 30 11:45:17.508637 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:45:17.508598    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6f0d35_9048_4f2b_821f_8087e4ad5e7f.slice/crio-a23cd485ac57e85735745b01b1a9e39147aff8a693c113fc029194cac83e1bd9 WatchSource:0}: Error finding container a23cd485ac57e85735745b01b1a9e39147aff8a693c113fc029194cac83e1bd9: Status 404 returned error can't find the container with id a23cd485ac57e85735745b01b1a9e39147aff8a693c113fc029194cac83e1bd9
Jul 30 11:45:17.744415 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:17.744386    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"]
Jul 30 11:45:17.746401 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:45:17.746374    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec6d3ff4_7865_4333_8910_80071512679c.slice/crio-b08977caf1941a9f0500f87d2d64688038a80ba5bccd8c5515d9b777d77e7150 WatchSource:0}: Error finding container b08977caf1941a9f0500f87d2d64688038a80ba5bccd8c5515d9b777d77e7150: Status 404 returned error can't find the container with id b08977caf1941a9f0500f87d2d64688038a80ba5bccd8c5515d9b777d77e7150
Jul 30 11:45:18.031329 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:18.031291    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6" event={"ID":"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f","Type":"ContainerStarted","Data":"90a795174a611fafbba50a3e979b6ad0ee7b3606cc497b1edf50555d2e070e0a"}
Jul 30 11:45:18.031528 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:18.031353    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6" event={"ID":"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f","Type":"ContainerStarted","Data":"a23cd485ac57e85735745b01b1a9e39147aff8a693c113fc029194cac83e1bd9"}
Jul 30 11:45:18.031528 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:18.031467    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:18.033656 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:18.033620    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr" event={"ID":"53404a20-d963-4118-8c80-082a982cffad","Type":"ContainerStarted","Data":"3a0c97d0fd8becf9beead4b7cb94faa9016f435dfac5205af58dfc4e40728928"}
Jul 30 11:45:18.033815 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:18.033796    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:18.035294 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:18.035274    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9" event={"ID":"ec6d3ff4-7865-4333-8910-80071512679c","Type":"ContainerStarted","Data":"38d3263991d93c132d3f3b056a3c8af60ece9a142689a32296609288942e4c7a"}
Jul 30 11:45:18.035429 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:18.035315    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9" event={"ID":"ec6d3ff4-7865-4333-8910-80071512679c","Type":"ContainerStarted","Data":"b08977caf1941a9f0500f87d2d64688038a80ba5bccd8c5515d9b777d77e7150"}
Jul 30 11:45:18.035429 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:18.035342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:18.052957 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:18.052916    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6" podStartSLOduration=1.052903345 podStartE2EDuration="1.052903345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:45:18.050493964 +0000 UTC m=+3422.159135457" watchObservedRunningTime="2026-07-30 11:45:18.052903345 +0000 UTC m=+3422.161544837"
Jul 30 11:45:18.070086 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:18.070009    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr" podStartSLOduration=1.6892098789999999 podStartE2EDuration="2.069996167s" totalImagesPullingTime="380.786288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:45:18.067797975 +0000 UTC m=+3422.176439469" watchObservedRunningTime="2026-07-30 11:45:18.069996167 +0000 UTC m=+3422.178637657"
Jul 30 11:45:18.084325 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:18.084284    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9" podStartSLOduration=1.084269594 podStartE2EDuration="1.084269594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 11:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:45:18.083777697 +0000 UTC m=+3422.192419190" watchObservedRunningTime="2026-07-30 11:45:18.084269594 +0000 UTC m=+3422.192911086"
Jul 30 11:45:24.046162 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:24.046132    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:29.043235 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:29.043202    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:29.043695 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:29.043379    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:38.884018 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:38.883986    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"]
Jul 30 11:45:38.884413 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:38.884245    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr" podUID="53404a20-d963-4118-8c80-082a982cffad" containerName="maas-api" containerID="cri-o://3a0c97d0fd8becf9beead4b7cb94faa9016f435dfac5205af58dfc4e40728928" gracePeriod=30
Jul 30 11:45:38.948975 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:38.948937    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"]
Jul 30 11:45:38.949217 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:38.949189    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9" podUID="ec6d3ff4-7865-4333-8910-80071512679c" containerName="payload-processing" containerID="cri-o://38d3263991d93c132d3f3b056a3c8af60ece9a142689a32296609288942e4c7a" gracePeriod=30
Jul 30 11:45:38.961852 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:38.961820    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"]
Jul 30 11:45:38.962078 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:38.962054    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6" podUID="8e6f0d35-9048-4f2b-821f-8087e4ad5e7f" containerName="payload-pre-processing" containerID="cri-o://90a795174a611fafbba50a3e979b6ad0ee7b3606cc497b1edf50555d2e070e0a" gracePeriod=30
Jul 30 11:45:39.041872 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.041832    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9" podUID="ec6d3ff4-7865-4333-8910-80071512679c" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.69:9004: connect: connection refused"
Jul 30 11:45:39.042017 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.041842    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr" podUID="53404a20-d963-4118-8c80-082a982cffad" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.67:8443/health\": dial tcp 10.134.0.67:8443: connect: connection refused"
Jul 30 11:45:39.042017 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.041839    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6" podUID="8e6f0d35-9048-4f2b-821f-8087e4ad5e7f" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.68:9004: connect: connection refused"
Jul 30 11:45:39.159846 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.159798    2583 generic.go:356] "Generic (PLEG): container finished" podID="8e6f0d35-9048-4f2b-821f-8087e4ad5e7f" containerID="90a795174a611fafbba50a3e979b6ad0ee7b3606cc497b1edf50555d2e070e0a" exitCode=0
Jul 30 11:45:39.160515 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.159932    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6" event={"ID":"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f","Type":"ContainerDied","Data":"90a795174a611fafbba50a3e979b6ad0ee7b3606cc497b1edf50555d2e070e0a"}
Jul 30 11:45:39.161794 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.161747    2583 generic.go:356] "Generic (PLEG): container finished" podID="53404a20-d963-4118-8c80-082a982cffad" containerID="3a0c97d0fd8becf9beead4b7cb94faa9016f435dfac5205af58dfc4e40728928" exitCode=0
Jul 30 11:45:39.161959 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.161844    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr" event={"ID":"53404a20-d963-4118-8c80-082a982cffad","Type":"ContainerDied","Data":"3a0c97d0fd8becf9beead4b7cb94faa9016f435dfac5205af58dfc4e40728928"}
Jul 30 11:45:39.163616 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.163588    2583 generic.go:356] "Generic (PLEG): container finished" podID="ec6d3ff4-7865-4333-8910-80071512679c" containerID="38d3263991d93c132d3f3b056a3c8af60ece9a142689a32296609288942e4c7a" exitCode=0
Jul 30 11:45:39.163713 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.163648    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9" event={"ID":"ec6d3ff4-7865-4333-8910-80071512679c","Type":"ContainerDied","Data":"38d3263991d93c132d3f3b056a3c8af60ece9a142689a32296609288942e4c7a"}
Jul 30 11:45:39.237058 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.237020    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:39.274914 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.274885    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:39.287402 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.287376    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:39.299186 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.299149    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec6d3ff4-7865-4333-8910-80071512679c-plugins-config-volume\") pod \"ec6d3ff4-7865-4333-8910-80071512679c\" (UID: \"ec6d3ff4-7865-4333-8910-80071512679c\") "
Jul 30 11:45:39.299412 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.299201    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmhlf\" (UniqueName: \"kubernetes.io/projected/ec6d3ff4-7865-4333-8910-80071512679c-kube-api-access-zmhlf\") pod \"ec6d3ff4-7865-4333-8910-80071512679c\" (UID: \"ec6d3ff4-7865-4333-8910-80071512679c\") "
Jul 30 11:45:39.299412 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.299281    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-plugins-config-volume\") pod \"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f\" (UID: \"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f\") "
Jul 30 11:45:39.299412 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.299331    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53404a20-d963-4118-8c80-082a982cffad-openshift-service-ca\") pod \"53404a20-d963-4118-8c80-082a982cffad\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") "
Jul 30 11:45:39.299592 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.299416    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53404a20-d963-4118-8c80-082a982cffad-maas-api-tls\") pod \"53404a20-d963-4118-8c80-082a982cffad\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") "
Jul 30 11:45:39.299592 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.299454    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr2dj\" (UniqueName: \"kubernetes.io/projected/53404a20-d963-4118-8c80-082a982cffad-kube-api-access-pr2dj\") pod \"53404a20-d963-4118-8c80-082a982cffad\" (UID: \"53404a20-d963-4118-8c80-082a982cffad\") "
Jul 30 11:45:39.299592 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.299501    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t74pz\" (UniqueName: \"kubernetes.io/projected/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-kube-api-access-t74pz\") pod \"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f\" (UID: \"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f\") "
Jul 30 11:45:39.300193 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.300164    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8e6f0d35-9048-4f2b-821f-8087e4ad5e7f" (UID: "8e6f0d35-9048-4f2b-821f-8087e4ad5e7f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:45:39.300549 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.300206    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec6d3ff4-7865-4333-8910-80071512679c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ec6d3ff4-7865-4333-8910-80071512679c" (UID: "ec6d3ff4-7865-4333-8910-80071512679c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:45:39.300680 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.300503    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53404a20-d963-4118-8c80-082a982cffad-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "53404a20-d963-4118-8c80-082a982cffad" (UID: "53404a20-d963-4118-8c80-082a982cffad"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:45:39.301794 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.301763    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec6d3ff4-7865-4333-8910-80071512679c-kube-api-access-zmhlf" (OuterVolumeSpecName: "kube-api-access-zmhlf") pod "ec6d3ff4-7865-4333-8910-80071512679c" (UID: "ec6d3ff4-7865-4333-8910-80071512679c"). InnerVolumeSpecName "kube-api-access-zmhlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:45:39.302117 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.302076    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53404a20-d963-4118-8c80-082a982cffad-kube-api-access-pr2dj" (OuterVolumeSpecName: "kube-api-access-pr2dj") pod "53404a20-d963-4118-8c80-082a982cffad" (UID: "53404a20-d963-4118-8c80-082a982cffad"). InnerVolumeSpecName "kube-api-access-pr2dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:45:39.302193 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.302172    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53404a20-d963-4118-8c80-082a982cffad-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "53404a20-d963-4118-8c80-082a982cffad" (UID: "53404a20-d963-4118-8c80-082a982cffad"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 11:45:39.302322 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.302214    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-kube-api-access-t74pz" (OuterVolumeSpecName: "kube-api-access-t74pz") pod "8e6f0d35-9048-4f2b-821f-8087e4ad5e7f" (UID: "8e6f0d35-9048-4f2b-821f-8087e4ad5e7f"). InnerVolumeSpecName "kube-api-access-t74pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:45:39.401108 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.401076    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr2dj\" (UniqueName: \"kubernetes.io/projected/53404a20-d963-4118-8c80-082a982cffad-kube-api-access-pr2dj\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:45:39.401108 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.401107    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t74pz\" (UniqueName: \"kubernetes.io/projected/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-kube-api-access-t74pz\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:45:39.401412 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.401117    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec6d3ff4-7865-4333-8910-80071512679c-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:45:39.401412 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.401128    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmhlf\" (UniqueName: \"kubernetes.io/projected/ec6d3ff4-7865-4333-8910-80071512679c-kube-api-access-zmhlf\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:45:39.401412 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.401137    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:45:39.401412 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.401145    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53404a20-d963-4118-8c80-082a982cffad-openshift-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:45:39.401412 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:39.401154    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53404a20-d963-4118-8c80-082a982cffad-maas-api-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:45:40.170577 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.170544    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"
Jul 30 11:45:40.171089 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.170552    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr" event={"ID":"53404a20-d963-4118-8c80-082a982cffad","Type":"ContainerDied","Data":"0090925f42d5bfe5c64ed38d5d3a326188b877b9cf0430cd739140c65360effe"}
Jul 30 11:45:40.171089 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.170712    2583 scope.go:117] "RemoveContainer" containerID="3a0c97d0fd8becf9beead4b7cb94faa9016f435dfac5205af58dfc4e40728928"
Jul 30 11:45:40.172074 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.171959    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"
Jul 30 11:45:40.172074 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.171987    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9" event={"ID":"ec6d3ff4-7865-4333-8910-80071512679c","Type":"ContainerDied","Data":"b08977caf1941a9f0500f87d2d64688038a80ba5bccd8c5515d9b777d77e7150"}
Jul 30 11:45:40.173579 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.173556    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6" event={"ID":"8e6f0d35-9048-4f2b-821f-8087e4ad5e7f","Type":"ContainerDied","Data":"a23cd485ac57e85735745b01b1a9e39147aff8a693c113fc029194cac83e1bd9"}
Jul 30 11:45:40.173692 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.173589    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"
Jul 30 11:45:40.183387 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.183343    2583 scope.go:117] "RemoveContainer" containerID="38d3263991d93c132d3f3b056a3c8af60ece9a142689a32296609288942e4c7a"
Jul 30 11:45:40.192784 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.192766    2583 scope.go:117] "RemoveContainer" containerID="90a795174a611fafbba50a3e979b6ad0ee7b3606cc497b1edf50555d2e070e0a"
Jul 30 11:45:40.203331 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.203308    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"]
Jul 30 11:45:40.205495 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.205472    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a93cc2-5ddff59d6-22zvr"]
Jul 30 11:45:40.218241 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.218195    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"]
Jul 30 11:45:40.222350 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.222323    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-a93cc2-74b4647c84-b8wl6"]
Jul 30 11:45:40.235911 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.235877    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"]
Jul 30 11:45:40.239685 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.239657    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a93cc2-5c4f54994-prfr9"]
Jul 30 11:45:40.461940 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.461859    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53404a20-d963-4118-8c80-082a982cffad" path="/var/lib/kubelet/pods/53404a20-d963-4118-8c80-082a982cffad/volumes"
Jul 30 11:45:40.462276 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.462262    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e6f0d35-9048-4f2b-821f-8087e4ad5e7f" path="/var/lib/kubelet/pods/8e6f0d35-9048-4f2b-821f-8087e4ad5e7f/volumes"
Jul 30 11:45:40.462604 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:45:40.462592    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec6d3ff4-7865-4333-8910-80071512679c" path="/var/lib/kubelet/pods/ec6d3ff4-7865-4333-8910-80071512679c/volumes"
Jul 30 11:46:07.351654 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.351619    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"]
Jul 30 11:46:07.352255 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.351870    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77" podUID="550ca33c-645b-48b4-b2fb-30802435e841" containerName="maas-api" containerID="cri-o://77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb" gracePeriod=30
Jul 30 11:46:07.401493 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.401456    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77" podUID="550ca33c-645b-48b4-b2fb-30802435e841" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.66:8443/health\": dial tcp 10.134.0.66:8443: connect: connection refused"
Jul 30 11:46:07.619012 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.618950    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:46:07.802572 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.802540    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sttk\" (UniqueName: \"kubernetes.io/projected/550ca33c-645b-48b4-b2fb-30802435e841-kube-api-access-5sttk\") pod \"550ca33c-645b-48b4-b2fb-30802435e841\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") "
Jul 30 11:46:07.802776 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.802596    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/550ca33c-645b-48b4-b2fb-30802435e841-maas-api-tls\") pod \"550ca33c-645b-48b4-b2fb-30802435e841\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") "
Jul 30 11:46:07.802776 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.802639    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/550ca33c-645b-48b4-b2fb-30802435e841-openshift-service-ca\") pod \"550ca33c-645b-48b4-b2fb-30802435e841\" (UID: \"550ca33c-645b-48b4-b2fb-30802435e841\") "
Jul 30 11:46:07.802991 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.802964    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/550ca33c-645b-48b4-b2fb-30802435e841-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "550ca33c-645b-48b4-b2fb-30802435e841" (UID: "550ca33c-645b-48b4-b2fb-30802435e841"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:46:07.804611 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.804585    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/550ca33c-645b-48b4-b2fb-30802435e841-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "550ca33c-645b-48b4-b2fb-30802435e841" (UID: "550ca33c-645b-48b4-b2fb-30802435e841"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 11:46:07.804728 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.804682    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550ca33c-645b-48b4-b2fb-30802435e841-kube-api-access-5sttk" (OuterVolumeSpecName: "kube-api-access-5sttk") pod "550ca33c-645b-48b4-b2fb-30802435e841" (UID: "550ca33c-645b-48b4-b2fb-30802435e841"). InnerVolumeSpecName "kube-api-access-5sttk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:46:07.903555 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.903521    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/550ca33c-645b-48b4-b2fb-30802435e841-openshift-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:46:07.903555 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.903553    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sttk\" (UniqueName: \"kubernetes.io/projected/550ca33c-645b-48b4-b2fb-30802435e841-kube-api-access-5sttk\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:46:07.903781 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:07.903564    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/550ca33c-645b-48b4-b2fb-30802435e841-maas-api-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:46:08.329711 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:08.329623    2583 generic.go:356] "Generic (PLEG): container finished" podID="550ca33c-645b-48b4-b2fb-30802435e841" containerID="77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb" exitCode=0
Jul 30 11:46:08.329711 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:08.329683    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"
Jul 30 11:46:08.330013 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:08.329717    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77" event={"ID":"550ca33c-645b-48b4-b2fb-30802435e841","Type":"ContainerDied","Data":"77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb"}
Jul 30 11:46:08.330013 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:08.329783    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77" event={"ID":"550ca33c-645b-48b4-b2fb-30802435e841","Type":"ContainerDied","Data":"86ea1fe2222ce85a7ad25e0183bcb738a04e6ec07c96e146bc739f993c698634"}
Jul 30 11:46:08.330013 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:08.329813    2583 scope.go:117] "RemoveContainer" containerID="77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb"
Jul 30 11:46:08.342143 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:08.342115    2583 scope.go:117] "RemoveContainer" containerID="77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb"
Jul 30 11:46:08.342577 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:46:08.342553    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb\": container with ID starting with 77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb not found: ID does not exist" containerID="77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb"
Jul 30 11:46:08.342678 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:08.342586    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb"} err="failed to get container status \"77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb\": rpc error: code = NotFound desc = could not find container \"77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb\": container with ID starting with 77208576b1e866bf665c867e4bb24f051425b2f4ff68d2d169c3b60799381dfb not found: ID does not exist"
Jul 30 11:46:08.353504 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:08.353477    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"]
Jul 30 11:46:08.360245 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:08.360203    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d722d1-7bc649d9fb-j5n77"]
Jul 30 11:46:08.462344 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:46:08.462311    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="550ca33c-645b-48b4-b2fb-30802435e841" path="/var/lib/kubelet/pods/550ca33c-645b-48b4-b2fb-30802435e841/volumes"
Jul 30 11:47:20.272880 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.272843    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"]
Jul 30 11:47:20.273422 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.273096    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm" podUID="288a1882-4651-4070-a1be-c0e9b72039ff" containerName="maas-api" containerID="cri-o://0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2" gracePeriod=30
Jul 30 11:47:20.338397 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.338350    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"]
Jul 30 11:47:20.338683 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.338593    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr" podUID="96379f9e-6612-46cf-b8fd-6ee36e540b57" containerName="payload-processing" containerID="cri-o://135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b" gracePeriod=30
Jul 30 11:47:20.347419 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.345166    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"]
Jul 30 11:47:20.347419 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.345407    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29" podUID="e6a979b5-b35b-4124-9689-e2b4cdda8a9c" containerName="payload-pre-processing" containerID="cri-o://aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a" gracePeriod=30
Jul 30 11:47:20.638357 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.638329    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:47:20.641537 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.641515    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:47:20.673046 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.673017    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:47:20.693181 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.693149    2583 generic.go:356] "Generic (PLEG): container finished" podID="288a1882-4651-4070-a1be-c0e9b72039ff" containerID="0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2" exitCode=0
Jul 30 11:47:20.693332 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.693202    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"
Jul 30 11:47:20.693332 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.693238    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm" event={"ID":"288a1882-4651-4070-a1be-c0e9b72039ff","Type":"ContainerDied","Data":"0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2"}
Jul 30 11:47:20.693332 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.693289    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm" event={"ID":"288a1882-4651-4070-a1be-c0e9b72039ff","Type":"ContainerDied","Data":"4dd043864c690489259932db90c85dca51c93227eff509a3a14a1c74915d9200"}
Jul 30 11:47:20.693332 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.693312    2583 scope.go:117] "RemoveContainer" containerID="0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2"
Jul 30 11:47:20.694710 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.694684    2583 generic.go:356] "Generic (PLEG): container finished" podID="e6a979b5-b35b-4124-9689-e2b4cdda8a9c" containerID="aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a" exitCode=0
Jul 30 11:47:20.694834 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.694728    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"
Jul 30 11:47:20.694834 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.694772    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29" event={"ID":"e6a979b5-b35b-4124-9689-e2b4cdda8a9c","Type":"ContainerDied","Data":"aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a"}
Jul 30 11:47:20.694834 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.694821    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29" event={"ID":"e6a979b5-b35b-4124-9689-e2b4cdda8a9c","Type":"ContainerDied","Data":"38fd1ed25723923ff5e0afab4806f2f698eb0883ed4783d6e5ec4ba72b2eb7aa"}
Jul 30 11:47:20.696190 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.696166    2583 generic.go:356] "Generic (PLEG): container finished" podID="96379f9e-6612-46cf-b8fd-6ee36e540b57" containerID="135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b" exitCode=0
Jul 30 11:47:20.696329 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.696235    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"
Jul 30 11:47:20.696329 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.696251    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr" event={"ID":"96379f9e-6612-46cf-b8fd-6ee36e540b57","Type":"ContainerDied","Data":"135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b"}
Jul 30 11:47:20.696329 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.696308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr" event={"ID":"96379f9e-6612-46cf-b8fd-6ee36e540b57","Type":"ContainerDied","Data":"aac43c6f6f7156a19fd78e85346b88b38660f3e482e749719f6b945def9be284"}
Jul 30 11:47:20.704512 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.704497    2583 scope.go:117] "RemoveContainer" containerID="0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2"
Jul 30 11:47:20.704793 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:47:20.704774    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2\": container with ID starting with 0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2 not found: ID does not exist" containerID="0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2"
Jul 30 11:47:20.704866 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.704801    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2"} err="failed to get container status \"0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2\": rpc error: code = NotFound desc = could not find container \"0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2\": container with ID starting with 0579df85a8fcc788900ffbfec08b22366e709c82c4bab70f9c10814d3fa156e2 not found: ID does not exist"
Jul 30 11:47:20.704866 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.704817    2583 scope.go:117] "RemoveContainer" containerID="aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a"
Jul 30 11:47:20.713439 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.713406    2583 scope.go:117] "RemoveContainer" containerID="aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a"
Jul 30 11:47:20.713972 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:47:20.713942    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a\": container with ID starting with aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a not found: ID does not exist" containerID="aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a"
Jul 30 11:47:20.714083 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.713977    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a"} err="failed to get container status \"aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a\": rpc error: code = NotFound desc = could not find container \"aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a\": container with ID starting with aa116d5de51c42083f6ada244d6a0e9582ac15b436c135f4bbe5024b9c8f2f1a not found: ID does not exist"
Jul 30 11:47:20.714083 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.713998    2583 scope.go:117] "RemoveContainer" containerID="135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b"
Jul 30 11:47:20.722547 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.722527    2583 scope.go:117] "RemoveContainer" containerID="135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b"
Jul 30 11:47:20.722806 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:47:20.722785    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b\": container with ID starting with 135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b not found: ID does not exist" containerID="135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b"
Jul 30 11:47:20.722876 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.722812    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b"} err="failed to get container status \"135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b\": rpc error: code = NotFound desc = could not find container \"135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b\": container with ID starting with 135aeb21734e8e0d10b2fcdae41b59f9ad6bc4d79b4a029f0189290b12223a2b not found: ID does not exist"
Jul 30 11:47:20.730824 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.730796    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf6m4\" (UniqueName: \"kubernetes.io/projected/96379f9e-6612-46cf-b8fd-6ee36e540b57-kube-api-access-xf6m4\") pod \"96379f9e-6612-46cf-b8fd-6ee36e540b57\" (UID: \"96379f9e-6612-46cf-b8fd-6ee36e540b57\") "
Jul 30 11:47:20.730913 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.730843    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/288a1882-4651-4070-a1be-c0e9b72039ff-openshift-service-ca\") pod \"288a1882-4651-4070-a1be-c0e9b72039ff\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") "
Jul 30 11:47:20.730913 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.730899    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-plugins-config-volume\") pod \"e6a979b5-b35b-4124-9689-e2b4cdda8a9c\" (UID: \"e6a979b5-b35b-4124-9689-e2b4cdda8a9c\") "
Jul 30 11:47:20.730996 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.730960    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8slk\" (UniqueName: \"kubernetes.io/projected/288a1882-4651-4070-a1be-c0e9b72039ff-kube-api-access-p8slk\") pod \"288a1882-4651-4070-a1be-c0e9b72039ff\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") "
Jul 30 11:47:20.731049 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.731000    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/288a1882-4651-4070-a1be-c0e9b72039ff-maas-api-tls\") pod \"288a1882-4651-4070-a1be-c0e9b72039ff\" (UID: \"288a1882-4651-4070-a1be-c0e9b72039ff\") "
Jul 30 11:47:20.731049 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.731025    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96379f9e-6612-46cf-b8fd-6ee36e540b57-plugins-config-volume\") pod \"96379f9e-6612-46cf-b8fd-6ee36e540b57\" (UID: \"96379f9e-6612-46cf-b8fd-6ee36e540b57\") "
Jul 30 11:47:20.731160 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.731078    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq5p5\" (UniqueName: \"kubernetes.io/projected/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-kube-api-access-bq5p5\") pod \"e6a979b5-b35b-4124-9689-e2b4cdda8a9c\" (UID: \"e6a979b5-b35b-4124-9689-e2b4cdda8a9c\") "
Jul 30 11:47:20.731292 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.731268    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/288a1882-4651-4070-a1be-c0e9b72039ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "288a1882-4651-4070-a1be-c0e9b72039ff" (UID: "288a1882-4651-4070-a1be-c0e9b72039ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:47:20.731532 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.731500    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96379f9e-6612-46cf-b8fd-6ee36e540b57-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "96379f9e-6612-46cf-b8fd-6ee36e540b57" (UID: "96379f9e-6612-46cf-b8fd-6ee36e540b57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:47:20.731620 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.731559    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/288a1882-4651-4070-a1be-c0e9b72039ff-openshift-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:20.731620 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.731596    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e6a979b5-b35b-4124-9689-e2b4cdda8a9c" (UID: "e6a979b5-b35b-4124-9689-e2b4cdda8a9c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:47:20.733118 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.733091    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/288a1882-4651-4070-a1be-c0e9b72039ff-kube-api-access-p8slk" (OuterVolumeSpecName: "kube-api-access-p8slk") pod "288a1882-4651-4070-a1be-c0e9b72039ff" (UID: "288a1882-4651-4070-a1be-c0e9b72039ff"). InnerVolumeSpecName "kube-api-access-p8slk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:47:20.733321 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.733299    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-kube-api-access-bq5p5" (OuterVolumeSpecName: "kube-api-access-bq5p5") pod "e6a979b5-b35b-4124-9689-e2b4cdda8a9c" (UID: "e6a979b5-b35b-4124-9689-e2b4cdda8a9c"). InnerVolumeSpecName "kube-api-access-bq5p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:47:20.733565 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.733532    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96379f9e-6612-46cf-b8fd-6ee36e540b57-kube-api-access-xf6m4" (OuterVolumeSpecName: "kube-api-access-xf6m4") pod "96379f9e-6612-46cf-b8fd-6ee36e540b57" (UID: "96379f9e-6612-46cf-b8fd-6ee36e540b57"). InnerVolumeSpecName "kube-api-access-xf6m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:47:20.733565 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.733542    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/288a1882-4651-4070-a1be-c0e9b72039ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "288a1882-4651-4070-a1be-c0e9b72039ff" (UID: "288a1882-4651-4070-a1be-c0e9b72039ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 11:47:20.832172 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.832097    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/288a1882-4651-4070-a1be-c0e9b72039ff-maas-api-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:20.832172 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.832125    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/96379f9e-6612-46cf-b8fd-6ee36e540b57-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:20.832172 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.832136    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq5p5\" (UniqueName: \"kubernetes.io/projected/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-kube-api-access-bq5p5\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:20.832172 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.832145    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf6m4\" (UniqueName: \"kubernetes.io/projected/96379f9e-6612-46cf-b8fd-6ee36e540b57-kube-api-access-xf6m4\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:20.832172 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.832153    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6a979b5-b35b-4124-9689-e2b4cdda8a9c-plugins-config-volume\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:20.832172 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:20.832161    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8slk\" (UniqueName: \"kubernetes.io/projected/288a1882-4651-4070-a1be-c0e9b72039ff-kube-api-access-p8slk\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:21.019858 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:21.019830    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"]
Jul 30 11:47:21.025203 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:21.025180    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-060e9f-8fbd8947d-gnkmm"]
Jul 30 11:47:21.037404 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:21.037380    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"]
Jul 30 11:47:21.041570 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:21.041546    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-060e9f-54ff5b5bcb-8cn29"]
Jul 30 11:47:21.054454 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:21.054429    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"]
Jul 30 11:47:21.058079 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:21.058059    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-060e9f-846bcd9bb-jjscr"]
Jul 30 11:47:22.461554 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:22.461517    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="288a1882-4651-4070-a1be-c0e9b72039ff" path="/var/lib/kubelet/pods/288a1882-4651-4070-a1be-c0e9b72039ff/volumes"
Jul 30 11:47:22.461935 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:22.461881    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96379f9e-6612-46cf-b8fd-6ee36e540b57" path="/var/lib/kubelet/pods/96379f9e-6612-46cf-b8fd-6ee36e540b57/volumes"
Jul 30 11:47:22.462190 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:22.462177    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a979b5-b35b-4124-9689-e2b4cdda8a9c" path="/var/lib/kubelet/pods/e6a979b5-b35b-4124-9689-e2b4cdda8a9c/volumes"
Jul 30 11:47:35.091022 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.090988    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"]
Jul 30 11:47:35.091773 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.091736    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc" podUID="8ed8f09b-4695-43dd-a9ee-17b927c47009" containerName="maas-api" containerID="cri-o://04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa" gracePeriod=30
Jul 30 11:47:35.350278 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.350180    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:47:35.466731 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.466701    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhdb4\" (UniqueName: \"kubernetes.io/projected/8ed8f09b-4695-43dd-a9ee-17b927c47009-kube-api-access-jhdb4\") pod \"8ed8f09b-4695-43dd-a9ee-17b927c47009\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") "
Jul 30 11:47:35.466898 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.466783    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed8f09b-4695-43dd-a9ee-17b927c47009-openshift-service-ca\") pod \"8ed8f09b-4695-43dd-a9ee-17b927c47009\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") "
Jul 30 11:47:35.466898 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.466858    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed8f09b-4695-43dd-a9ee-17b927c47009-maas-api-tls\") pod \"8ed8f09b-4695-43dd-a9ee-17b927c47009\" (UID: \"8ed8f09b-4695-43dd-a9ee-17b927c47009\") "
Jul 30 11:47:35.467165 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.467135    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed8f09b-4695-43dd-a9ee-17b927c47009-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ed8f09b-4695-43dd-a9ee-17b927c47009" (UID: "8ed8f09b-4695-43dd-a9ee-17b927c47009"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:47:35.468901 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.468875    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed8f09b-4695-43dd-a9ee-17b927c47009-kube-api-access-jhdb4" (OuterVolumeSpecName: "kube-api-access-jhdb4") pod "8ed8f09b-4695-43dd-a9ee-17b927c47009" (UID: "8ed8f09b-4695-43dd-a9ee-17b927c47009"). InnerVolumeSpecName "kube-api-access-jhdb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:47:35.468901 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.468888    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed8f09b-4695-43dd-a9ee-17b927c47009-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ed8f09b-4695-43dd-a9ee-17b927c47009" (UID: "8ed8f09b-4695-43dd-a9ee-17b927c47009"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 11:47:35.568463 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.568426    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed8f09b-4695-43dd-a9ee-17b927c47009-openshift-service-ca\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:35.568463 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.568457    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ed8f09b-4695-43dd-a9ee-17b927c47009-maas-api-tls\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:35.568463 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.568467    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhdb4\" (UniqueName: \"kubernetes.io/projected/8ed8f09b-4695-43dd-a9ee-17b927c47009-kube-api-access-jhdb4\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:35.773941 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.773907    2583 generic.go:356] "Generic (PLEG): container finished" podID="8ed8f09b-4695-43dd-a9ee-17b927c47009" containerID="04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa" exitCode=0
Jul 30 11:47:35.774100 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.773970    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"
Jul 30 11:47:35.774100 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.773984    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc" event={"ID":"8ed8f09b-4695-43dd-a9ee-17b927c47009","Type":"ContainerDied","Data":"04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa"}
Jul 30 11:47:35.774100 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.774045    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc" event={"ID":"8ed8f09b-4695-43dd-a9ee-17b927c47009","Type":"ContainerDied","Data":"76bcd99a084be00af95886611ba5dbf62fdaffdde0668829d68b3cd3da132f9f"}
Jul 30 11:47:35.774100 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.774075    2583 scope.go:117] "RemoveContainer" containerID="04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa"
Jul 30 11:47:35.782928 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.782910    2583 scope.go:117] "RemoveContainer" containerID="04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa"
Jul 30 11:47:35.783183 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:47:35.783163    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa\": container with ID starting with 04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa not found: ID does not exist" containerID="04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa"
Jul 30 11:47:35.783279 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.783191    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa"} err="failed to get container status \"04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa\": rpc error: code = NotFound desc = could not find container \"04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa\": container with ID starting with 04cfe0c8fb1a6c047cdba48db39d5b4df17f8f63a174f2790b212308a8c745fa not found: ID does not exist"
Jul 30 11:47:35.796430 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.796405    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"]
Jul 30 11:47:35.802693 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:35.802673    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-945db9-7d44dc9b66-5rqgc"]
Jul 30 11:47:36.461272 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:36.461238    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ed8f09b-4695-43dd-a9ee-17b927c47009" path="/var/lib/kubelet/pods/8ed8f09b-4695-43dd-a9ee-17b927c47009/volumes"
Jul 30 11:47:42.267909 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:42.267873    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"]
Jul 30 11:47:42.268492 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:42.268106    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy" containerID="cri-o://ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526" gracePeriod=30
Jul 30 11:47:42.741887 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:42.741845    2583 patch_prober.go:28] interesting pod/e2e-shared-b-945db9-openshift-default-6648499d88-574td container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 11:47:42.742058 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:42.741916    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 11:47:47.527221 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.527194    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:47:47.585019 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.584929    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-certs\") pod \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") "
Jul 30 11:47:47.585019 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.584965    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-token\") pod \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") "
Jul 30 11:47:47.585019 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.584987    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-credential-socket\") pod \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") "
Jul 30 11:47:47.585019 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.585009    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-data\") pod \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") "
Jul 30 11:47:47.585358 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.585038    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7zkw\" (UniqueName: \"kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-kube-api-access-d7zkw\") pod \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") "
Jul 30 11:47:47.585358 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.585282    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-envoy\") pod \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") "
Jul 30 11:47:47.585358 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.585321    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae7a15e4-4daa-4641-ac6c-7445d8f78046" (UID: "ae7a15e4-4daa-4641-ac6c-7445d8f78046"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:47:47.585507 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.585362    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae7a15e4-4daa-4641-ac6c-7445d8f78046" (UID: "ae7a15e4-4daa-4641-ac6c-7445d8f78046"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:47:47.585507 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.585413    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae7a15e4-4daa-4641-ac6c-7445d8f78046" (UID: "ae7a15e4-4daa-4641-ac6c-7445d8f78046"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:47:47.585507 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.585416    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-podinfo\") pod \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") "
Jul 30 11:47:47.585507 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.585468    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istiod-ca-cert\") pod \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") "
Jul 30 11:47:47.585700 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.585511    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-socket\") pod \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\" (UID: \"ae7a15e4-4daa-4641-ac6c-7445d8f78046\") "
Jul 30 11:47:47.585871 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.585814    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae7a15e4-4daa-4641-ac6c-7445d8f78046" (UID: "ae7a15e4-4daa-4641-ac6c-7445d8f78046"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:47:47.585871 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.585850    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae7a15e4-4daa-4641-ac6c-7445d8f78046" (UID: "ae7a15e4-4daa-4641-ac6c-7445d8f78046"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 11:47:47.586097 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.586012    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-certs\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:47.586097 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.586035    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-credential-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:47.586097 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.586048    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-data\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:47.586097 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.586063    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istiod-ca-cert\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:47.586097 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.586076    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-workload-socket\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:47.587577 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.587528    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae7a15e4-4daa-4641-ac6c-7445d8f78046" (UID: "ae7a15e4-4daa-4641-ac6c-7445d8f78046"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 11:47:47.587577 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.587532    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae7a15e4-4daa-4641-ac6c-7445d8f78046" (UID: "ae7a15e4-4daa-4641-ac6c-7445d8f78046"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 11:47:47.587738 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.587614    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-kube-api-access-d7zkw" (OuterVolumeSpecName: "kube-api-access-d7zkw") pod "ae7a15e4-4daa-4641-ac6c-7445d8f78046" (UID: "ae7a15e4-4daa-4641-ac6c-7445d8f78046"). InnerVolumeSpecName "kube-api-access-d7zkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:47:47.588015 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.587998    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae7a15e4-4daa-4641-ac6c-7445d8f78046" (UID: "ae7a15e4-4daa-4641-ac6c-7445d8f78046"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 11:47:47.687520 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.687473    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-token\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:47.687520 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.687516    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7zkw\" (UniqueName: \"kubernetes.io/projected/ae7a15e4-4daa-4641-ac6c-7445d8f78046-kube-api-access-d7zkw\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:47.687520 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.687525    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-envoy\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:47.687520 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.687534    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae7a15e4-4daa-4641-ac6c-7445d8f78046-istio-podinfo\") on node \"ip-10-0-134-172.ec2.internal\" DevicePath \"\""
Jul 30 11:47:47.837247 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.837140    2583 generic.go:356] "Generic (PLEG): container finished" podID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerID="ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526" exitCode=0
Jul 30 11:47:47.837247 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.837183    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"
Jul 30 11:47:47.837247 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.837220    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" event={"ID":"ae7a15e4-4daa-4641-ac6c-7445d8f78046","Type":"ContainerDied","Data":"ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526"}
Jul 30 11:47:47.837510 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.837286    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td" event={"ID":"ae7a15e4-4daa-4641-ac6c-7445d8f78046","Type":"ContainerDied","Data":"eee2cf37ccf94241cd813ea2aca66031662b4758e2fdfc5baa86771f5bf01434"}
Jul 30 11:47:47.837510 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.837309    2583 scope.go:117] "RemoveContainer" containerID="ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526"
Jul 30 11:47:47.853301 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.853279    2583 scope.go:117] "RemoveContainer" containerID="e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014"
Jul 30 11:47:47.862128 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.861669    2583 scope.go:117] "RemoveContainer" containerID="ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526"
Jul 30 11:47:47.862263 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:47:47.862133    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526\": container with ID starting with ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526 not found: ID does not exist" containerID="ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526"
Jul 30 11:47:47.862263 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.862167    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526"} err="failed to get container status \"ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526\": rpc error: code = NotFound desc = could not find container \"ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526\": container with ID starting with ed6db28083f08229aad1fed0a34cb85a50c0dd56972003b6d37fefc359059526 not found: ID does not exist"
Jul 30 11:47:47.862263 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.862190    2583 scope.go:117] "RemoveContainer" containerID="e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014"
Jul 30 11:47:47.862486 ip-10-0-134-172 kubenswrapper[2583]: E0730 11:47:47.862462    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014\": container with ID starting with e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014 not found: ID does not exist" containerID="e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014"
Jul 30 11:47:47.862539 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.862492    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014"} err="failed to get container status \"e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014\": rpc error: code = NotFound desc = could not find container \"e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014\": container with ID starting with e26624031f3d4b253048f5350796d11a9631000b9e02aebcf366172210256014 not found: ID does not exist"
Jul 30 11:47:47.864324 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.864303    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"]
Jul 30 11:47:47.868466 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:47.868447    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-945db9-openshift-default-6648499d88-574td"]
Jul 30 11:47:48.461497 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:48.461463    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" path="/var/lib/kubelet/pods/ae7a15e4-4daa-4641-ac6c-7445d8f78046/volumes"
Jul 30 11:47:48.493789 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:48.493756    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6vmv6_340d6680-41a0-4273-aba8-73539fac9844/manager/0.log"
Jul 30 11:47:48.624213 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:48.624187    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-x72cz_5c0fca6d-62b0-4089-9374-e65ad1ea13c6/manager/0.log"
Jul 30 11:47:48.879377 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:48.879299    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9l5nx_e764c1f5-8158-4533-8705-cd386ae6810c/server/0.log"
Jul 30 11:47:49.272867 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:49.272838    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d97895fdd-657cw_612b3b8d-fafa-4c90-a1c5-aa6eff903ab3/copy-manifests/0.log"
Jul 30 11:47:49.289067 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:49.289045    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d97895fdd-657cw_612b3b8d-fafa-4c90-a1c5-aa6eff903ab3/manager/0.log"
Jul 30 11:47:51.139887 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:51.139858    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-jlgws_806e53c8-ed09-4ba9-9c45-9f1caff7fa50/manager/0.log"
Jul 30 11:47:52.083790 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:52.083765    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29_f7e77547-70b2-4c29-aca2-fe14eab247c6/istio-proxy/0.log"
Jul 30 11:47:52.572915 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:52.572886    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ldfs4_8a91e970-67b0-4e0d-bdb8-e6813048c9d2/istio-proxy/1.log"
Jul 30 11:47:53.339150 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:53.339104    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-njqxw_5af70a49-cdcf-46c9-a3de-741429b0a3aa/main/0.log"
Jul 30 11:47:53.581629 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:53.581598    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-g4xlf_d8653e17-dcdd-4a42-9584-15dc20578c49/main/0.log"
Jul 30 11:47:53.834888 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:47:53.834858    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-2lgbp_00bc8882-bcb7-4797-beb0-9c4e8c75b4e9/main/0.log"
Jul 30 11:48:02.485364 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:02.485330    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lhgvv_d7329a22-fb04-44b6-9746-fac8c5e02216/global-pull-secret-syncer/0.log"
Jul 30 11:48:02.618407 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:02.618370    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wqnvf_a647f52c-c1f7-42e3-aee3-9d0876f03ba2/konnectivity-agent/0.log"
Jul 30 11:48:02.661600 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:02.661569    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-172.ec2.internal_208b60a38e7d4f9f8a8c29e7bc8ed82e/haproxy/0.log"
Jul 30 11:48:07.743161 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:07.743134    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-jlgws_806e53c8-ed09-4ba9-9c45-9f1caff7fa50/manager/0.log"
Jul 30 11:48:09.614815 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:09.614724    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-bl6bf_7a810588-1c40-4e7b-a016-38816e4db2eb/kube-state-metrics/0.log"
Jul 30 11:48:09.661787 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:09.661761    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-bl6bf_7a810588-1c40-4e7b-a016-38816e4db2eb/kube-rbac-proxy-main/0.log"
Jul 30 11:48:09.690049 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:09.690027    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-bl6bf_7a810588-1c40-4e7b-a016-38816e4db2eb/kube-rbac-proxy-self/0.log"
Jul 30 11:48:09.720443 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:09.720421    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56786fb6b8-h24sz_c9527a5a-dbba-4a6c-95bb-743e894dd85b/metrics-server/0.log"
Jul 30 11:48:09.765065 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:09.765026    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-mpjcw_2e4d14ae-5a18-4bca-9aac-6995d8a7404b/monitoring-plugin/0.log"
Jul 30 11:48:09.803784 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:09.803750    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dk9w9_5c7a612e-1dc9-486e-842c-2322e74e4d9b/node-exporter/0.log"
Jul 30 11:48:09.824165 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:09.824149    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dk9w9_5c7a612e-1dc9-486e-842c-2322e74e4d9b/kube-rbac-proxy/0.log"
Jul 30 11:48:09.849127 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:09.849107    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dk9w9_5c7a612e-1dc9-486e-842c-2322e74e4d9b/init-textfile/0.log"
Jul 30 11:48:10.055169 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:10.055145    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-bmxj5_d119d959-6bc2-49fb-8bad-5d117709b07d/kube-rbac-proxy-main/0.log"
Jul 30 11:48:10.087829 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:10.087807    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-bmxj5_d119d959-6bc2-49fb-8bad-5d117709b07d/kube-rbac-proxy-self/0.log"
Jul 30 11:48:10.106992 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:10.106972    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-bmxj5_d119d959-6bc2-49fb-8bad-5d117709b07d/openshift-state-metrics/0.log"
Jul 30 11:48:10.145290 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:10.145201    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea431918-773b-4dc5-b680-eea011dc5f62/prometheus/0.log"
Jul 30 11:48:10.165465 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:10.165435    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea431918-773b-4dc5-b680-eea011dc5f62/config-reloader/0.log"
Jul 30 11:48:10.187512 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:10.187494    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea431918-773b-4dc5-b680-eea011dc5f62/thanos-sidecar/0.log"
Jul 30 11:48:10.208355 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:10.208307    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea431918-773b-4dc5-b680-eea011dc5f62/kube-rbac-proxy-web/0.log"
Jul 30 11:48:10.235566 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:10.235547    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea431918-773b-4dc5-b680-eea011dc5f62/kube-rbac-proxy/0.log"
Jul 30 11:48:10.255318 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:10.255301    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea431918-773b-4dc5-b680-eea011dc5f62/kube-rbac-proxy-thanos/0.log"
Jul 30 11:48:10.274749 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:10.274732    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea431918-773b-4dc5-b680-eea011dc5f62/init-config-reloader/0.log"
Jul 30 11:48:10.348790 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:10.348769    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-cvcht_fd88a5a8-8182-4e34-9092-8e016ce6988c/prometheus-operator-admission-webhook/0.log"
Jul 30 11:48:11.820933 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:11.820905    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-v7cph_6a79e56d-1272-47c9-a57a-59278aab3818/networking-console-plugin/0.log"
Jul 30 11:48:12.161353 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161319    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"]
Jul 30 11:48:12.161751 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161731    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec6d3ff4-7865-4333-8910-80071512679c" containerName="payload-processing"
Jul 30 11:48:12.161751 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161749    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec6d3ff4-7865-4333-8910-80071512679c" containerName="payload-processing"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161801    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161811    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161825    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="288a1882-4651-4070-a1be-c0e9b72039ff" containerName="maas-api"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161833    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="288a1882-4651-4070-a1be-c0e9b72039ff" containerName="maas-api"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161846    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96379f9e-6612-46cf-b8fd-6ee36e540b57" containerName="payload-processing"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161860    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="96379f9e-6612-46cf-b8fd-6ee36e540b57" containerName="payload-processing"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161870    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a979b5-b35b-4124-9689-e2b4cdda8a9c" containerName="payload-pre-processing"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161879    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a979b5-b35b-4124-9689-e2b4cdda8a9c" containerName="payload-pre-processing"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161902    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed8f09b-4695-43dd-a9ee-17b927c47009" containerName="maas-api"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161911    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed8f09b-4695-43dd-a9ee-17b927c47009" containerName="maas-api"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161934    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="550ca33c-645b-48b4-b2fb-30802435e841" containerName="maas-api"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161942    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="550ca33c-645b-48b4-b2fb-30802435e841" containerName="maas-api"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161953    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e6f0d35-9048-4f2b-821f-8087e4ad5e7f" containerName="payload-pre-processing"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161962    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e6f0d35-9048-4f2b-821f-8087e4ad5e7f" containerName="payload-pre-processing"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161977    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53404a20-d963-4118-8c80-082a982cffad" containerName="maas-api"
Jul 30 11:48:12.162020 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.161985    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="53404a20-d963-4118-8c80-082a982cffad" containerName="maas-api"
Jul 30 11:48:12.162802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.162091    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="550ca33c-645b-48b4-b2fb-30802435e841" containerName="maas-api"
Jul 30 11:48:12.162802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.162103    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="53404a20-d963-4118-8c80-082a982cffad" containerName="maas-api"
Jul 30 11:48:12.162802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.162116    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy"
Jul 30 11:48:12.162802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.162125    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed8f09b-4695-43dd-a9ee-17b927c47009" containerName="maas-api"
Jul 30 11:48:12.162802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.162135    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="288a1882-4651-4070-a1be-c0e9b72039ff" containerName="maas-api"
Jul 30 11:48:12.162802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.162142    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a979b5-b35b-4124-9689-e2b4cdda8a9c" containerName="payload-pre-processing"
Jul 30 11:48:12.162802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.162150    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e6f0d35-9048-4f2b-821f-8087e4ad5e7f" containerName="payload-pre-processing"
Jul 30 11:48:12.162802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.162161    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="96379f9e-6612-46cf-b8fd-6ee36e540b57" containerName="payload-processing"
Jul 30 11:48:12.162802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.162170    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae7a15e4-4daa-4641-ac6c-7445d8f78046" containerName="istio-proxy"
Jul 30 11:48:12.162802 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.162179    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec6d3ff4-7865-4333-8910-80071512679c" containerName="payload-processing"
Jul 30 11:48:12.165939 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.165922    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.169001 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.168981    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ms7b\"/\"kube-root-ca.crt\""
Jul 30 11:48:12.169117 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.169032    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6ms7b\"/\"openshift-service-ca.crt\""
Jul 30 11:48:12.169976 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.169957    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6ms7b\"/\"default-dockercfg-4xx59\""
Jul 30 11:48:12.178488 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.178468    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"]
Jul 30 11:48:12.216776 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.216751    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-sys\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.216899 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.216794    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-lib-modules\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.216899 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.216824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-podres\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.217016 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.216929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdhxx\" (UniqueName: \"kubernetes.io/projected/0bbb90df-5b82-425c-ab4f-b132de04912f-kube-api-access-vdhxx\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.217016 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.216979    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-proc\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.318438 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.318404    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdhxx\" (UniqueName: \"kubernetes.io/projected/0bbb90df-5b82-425c-ab4f-b132de04912f-kube-api-access-vdhxx\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.318604 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.318446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-proc\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.318604 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.318497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-sys\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.318604 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.318549    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-lib-modules\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.318604 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.318582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-podres\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.318604 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.318597    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-proc\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.318767 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.318604    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-sys\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.318767 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.318684    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-lib-modules\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.318767 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.318704    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0bbb90df-5b82-425c-ab4f-b132de04912f-podres\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.332541 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.332522    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdhxx\" (UniqueName: \"kubernetes.io/projected/0bbb90df-5b82-425c-ab4f-b132de04912f-kube-api-access-vdhxx\") pod \"perf-node-gather-daemonset-rvtmn\" (UID: \"0bbb90df-5b82-425c-ab4f-b132de04912f\") " pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.475906 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.475823    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.609209 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.609176    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"]
Jul 30 11:48:12.612566 ip-10-0-134-172 kubenswrapper[2583]: W0730 11:48:12.612539    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0bbb90df_5b82_425c_ab4f_b132de04912f.slice/crio-b788092b29da5d060ea00eebd23acf65e926e61e58815d1ca217f0fce9a8ba78 WatchSource:0}: Error finding container b788092b29da5d060ea00eebd23acf65e926e61e58815d1ca217f0fce9a8ba78: Status 404 returned error can't find the container with id b788092b29da5d060ea00eebd23acf65e926e61e58815d1ca217f0fce9a8ba78
Jul 30 11:48:12.966477 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.966439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn" event={"ID":"0bbb90df-5b82-425c-ab4f-b132de04912f","Type":"ContainerStarted","Data":"35ef469dc3f04311ef7731151d4e9333b3729f057e11ceaca00e2c66068f3a82"}
Jul 30 11:48:12.966967 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.966501    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn" event={"ID":"0bbb90df-5b82-425c-ab4f-b132de04912f","Type":"ContainerStarted","Data":"b788092b29da5d060ea00eebd23acf65e926e61e58815d1ca217f0fce9a8ba78"}
Jul 30 11:48:12.966967 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.966529    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:12.985121 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:12.984962    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn" podStartSLOduration=0.984944025 podStartE2EDuration="984.944025ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 11:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 11:48:12.984519771 +0000 UTC m=+3597.093161262" watchObservedRunningTime="2026-07-30 11:48:12.984944025 +0000 UTC m=+3597.093585517"
Jul 30 11:48:13.074936 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:13.074902    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-659c679879-w8d2q_68240aee-d0a7-4d31-838f-0344a350d086/console/0.log"
Jul 30 11:48:13.109091 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:13.109061    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-gqrgs_9df88ad9-d211-4e41-8b67-d05c9e9510e8/download-server/0.log"
Jul 30 11:48:14.845720 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:14.845691    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whxpf_6914ae44-a8e1-41f1-9e58-b50c7f8d1543/dns/0.log"
Jul 30 11:48:14.862249 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:14.862187    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whxpf_6914ae44-a8e1-41f1-9e58-b50c7f8d1543/kube-rbac-proxy/0.log"
Jul 30 11:48:14.943332 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:14.943299    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sjhld_1d9343d5-be95-4cc3-a06e-fed71ab42557/dns-node-resolver/0.log"
Jul 30 11:48:15.485831 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:15.485802    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55f47d7f4d-gkzb6_5aabefd5-8f82-4873-a4fb-80604f949f4d/registry/0.log"
Jul 30 11:48:15.506047 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:15.506019    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4dhsb_77082cc8-9009-41dd-94b1-7e056b4ef169/node-ca/0.log"
Jul 30 11:48:16.465816 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:16.465789    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29_f7e77547-70b2-4c29-aca2-fe14eab247c6/istio-proxy/0.log"
Jul 30 11:48:16.709997 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:16.709966    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ldfs4_8a91e970-67b0-4e0d-bdb8-e6813048c9d2/istio-proxy/0.log"
Jul 30 11:48:16.716506 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:16.716440    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ldfs4_8a91e970-67b0-4e0d-bdb8-e6813048c9d2/istio-proxy/1.log"
Jul 30 11:48:17.651587 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:17.651554    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cphfs_17e6ec27-1efb-4385-81ea-4d92e5fc21d5/serve-healthcheck-canary/0.log"
Jul 30 11:48:18.334462 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:18.334421    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjn6k_611358e3-65fa-451a-b33b-fa0096360f05/kube-rbac-proxy/0.log"
Jul 30 11:48:18.351399 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:18.351368    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjn6k_611358e3-65fa-451a-b33b-fa0096360f05/exporter/0.log"
Jul 30 11:48:18.369585 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:18.369566    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vjn6k_611358e3-65fa-451a-b33b-fa0096360f05/extractor/0.log"
Jul 30 11:48:18.982109 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:18.982081    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6ms7b/perf-node-gather-daemonset-rvtmn"
Jul 30 11:48:20.695534 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:20.695500    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6vmv6_340d6680-41a0-4273-aba8-73539fac9844/manager/0.log"
Jul 30 11:48:20.937337 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:20.937308    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-x72cz_5c0fca6d-62b0-4089-9374-e65ad1ea13c6/manager/0.log"
Jul 30 11:48:21.128056 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:21.128023    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9l5nx_e764c1f5-8158-4533-8705-cd386ae6810c/server/0.log"
Jul 30 11:48:21.363623 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:21.363547    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d97895fdd-657cw_612b3b8d-fafa-4c90-a1c5-aa6eff903ab3/manager/0.log"
Jul 30 11:48:21.379101 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:21.379075    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d97895fdd-657cw_612b3b8d-fafa-4c90-a1c5-aa6eff903ab3/copy-manifests/0.log"
Jul 30 11:48:22.678688 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:22.678655    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29_f7e77547-70b2-4c29-aca2-fe14eab247c6/istio-proxy/0.log"
Jul 30 11:48:22.708067 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:22.708039    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-866774c595-bkslj_b0280762-6d1a-46f4-a865-50124f4c1dc0/manager/0.log"
Jul 30 11:48:22.754813 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:22.754784    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-h4rdp_939eccda-b562-4b04-a343-d1dd381cec0a/openshift-lws-operator/0.log"
Jul 30 11:48:22.885905 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:22.885813    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ldfs4_8a91e970-67b0-4e0d-bdb8-e6813048c9d2/istio-proxy/0.log"
Jul 30 11:48:22.893894 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:22.893852    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ldfs4_8a91e970-67b0-4e0d-bdb8-e6813048c9d2/istio-proxy/1.log"
Jul 30 11:48:24.223958 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:24.223928    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-6gt29_f7e77547-70b2-4c29-aca2-fe14eab247c6/istio-proxy/0.log"
Jul 30 11:48:24.463785 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:24.463748    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ldfs4_8a91e970-67b0-4e0d-bdb8-e6813048c9d2/istio-proxy/0.log"
Jul 30 11:48:24.469769 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:24.469749    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ldfs4_8a91e970-67b0-4e0d-bdb8-e6813048c9d2/istio-proxy/1.log"
Jul 30 11:48:27.516643 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:27.516611    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-7przc_d819f1a4-1c57-4c38-beef-8521eb6e5fdf/migrator/0.log"
Jul 30 11:48:27.535024 ip-10-0-134-172 kubenswrapper[2583]: I0730 11:48:27.534988    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-7przc_d819f1a4-1c57-4c38-beef-8521eb6e5fdf/graceful-termination/0.log"