Jul 22 15:10:57.920540 ip-10-0-133-167 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 15:10:57.920550 ip-10-0-133-167 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 15:10:57.920556 ip-10-0-133-167 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 15:10:57.920832 ip-10-0-133-167 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 15:11:07.572022 ip-10-0-133-167 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 22 15:11:07.572037 ip-10-0-133-167 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f9e21fb57faf42e49cf3e746e6bb246a --
Jul 22 15:12:54.596159 ip-10-0-133-167 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.925369    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929861    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929887    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929892    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929895    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929900    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929904    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929907    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 15:12:55.095892 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929910    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 15:12:54.996330 ip-10-0-133-167 systemd[1]: Started Kubernetes Kubelet.
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929913    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929916    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929919    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929923    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929931    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929935    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929938    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929941    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929943    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929946    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929949    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929951    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929954    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929959    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929963    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929966    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929969    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929972    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 15:12:55.113713 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929975    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929978    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929980    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929983    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929985    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929988    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929991    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929993    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929996    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.929998    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930001    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930003    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930007    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930010    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930013    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930015    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930018    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930021    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930023    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930026    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 15:12:55.125346 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930028    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930031    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930033    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930036    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930038    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930041    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930043    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930045    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930049    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930051    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930054    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930056    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930060    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930062    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930065    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930067    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930070    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930072    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930076    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930080    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 15:12:55.126178 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930083    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930085    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930088    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930090    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930093    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930097    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930099    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930102    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930104    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930107    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930110    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930112    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930115    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930117    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930120    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930122    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930125    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930127    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930131    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930133    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 15:12:55.126772 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930136    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930139    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930143    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930146    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930149    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930151    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930154    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930157    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930159    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930162    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930165    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930167    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930170    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930925    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930933    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930936    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930940    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930943    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930946    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930949    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 15:12:55.127592 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930952    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930955    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930957    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930960    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930963    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930966    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930969    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930972    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930974    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930977    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930980    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930982    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930985    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930988    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930990    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930993    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930996    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.930998    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931001    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931003    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 15:12:55.128219 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931006    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931009    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931011    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931014    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931017    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931019    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931022    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931026    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931029    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931033    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931035    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931039    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931042    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931045    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931047    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931050    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931054    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931057    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931059    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 15:12:55.128891 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931062    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931064    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931067    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931070    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931073    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931075    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931078    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931081    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931083    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931086    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931088    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931091    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931093    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931096    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931099    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931101    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931105    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931109    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931112    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931114    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 15:12:55.129446 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931117    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931120    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931123    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931126    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931129    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931132    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931134    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931139    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931142    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931144    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931146    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931149    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931153    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931156    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931158    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931161    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931163    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931166    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931168    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 15:12:55.130097 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931171    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931174    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931176    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931179    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931182    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931185    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931187    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931190    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931192    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931195    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931198    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931201    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931204    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931207    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931594    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931600    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931603    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931606    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931610    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931613    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 15:12:55.130652 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931617    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931620    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931622    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931625    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931628    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931630    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931633    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931635    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931638    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931640    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931644    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931648    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931651    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931653    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931656    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931658    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931661    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931664    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931666    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 15:12:55.131277 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931669    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931671    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931674    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931677    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931679    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931682    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931685    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931687    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931691    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931693    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931695    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931698    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931701    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931705    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931708    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931710    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931713    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931716    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931718    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931721    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 15:12:55.131851 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931723    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931725    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931728    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931730    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931733    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931736    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931738    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931741    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931743    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931746    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931749    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931752    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931754    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931757    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931763    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931765    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931768    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931770    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931773    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 15:12:55.132503 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931776    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931778    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931781    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931783    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931785    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931788    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931793    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931795    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931798    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931800    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931803    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931805    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931808    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931810    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931813    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931815    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931818    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931820    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931823    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 15:12:55.133036 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931827    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931830    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931833    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931836    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931839    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931842    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931845    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931849    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931853    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931855    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931858    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931861    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931863    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931866    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931869    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.931871    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.931961    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.931969    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.931982    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.931988    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.931993    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 15:12:55.133739 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.931996    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932000    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932005    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932008    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932011    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932014    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932017    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932021    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932024    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932027    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932030    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932032    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932035    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932040    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932043    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932046    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932049    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932052    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932056    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932060    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932063    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932066    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932069    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932072    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 15:12:55.134312 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932075    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932078    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932081    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932085    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932088    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932091    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932095    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932098    2580 flags.go:64] FLAG: --enable-server="true"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932101    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932106    2580 flags.go:64] FLAG: --event-burst="100"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932109    2580 flags.go:64] FLAG: --event-qps="50"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932111    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932114    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932117    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932125    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932128    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932131    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932134    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932137    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932140    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932143    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932146    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932149    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932152    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932155    2580 flags.go:64] FLAG: --feature-gates=""
Jul 22 15:12:55.135061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932159    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932161    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932166    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932169    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932172    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932175    2580 flags.go:64] FLAG: --help="false"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932177    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932180    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932183    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932186    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932189    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932193    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932196    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932200    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932203    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932206    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932209    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932212    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932215    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932218    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932221    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932224    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932227    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932229    2580 flags.go:64] FLAG: --lock-file=""
Jul 22 15:12:55.135792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932232    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932235    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932238    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932243    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932246    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932249    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932251    2580 flags.go:64] FLAG: --logging-format="text"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932254    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932257    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932260    2580 flags.go:64] FLAG: --manifest-url=""
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932265    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932269    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932272    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932276    2580 flags.go:64] FLAG: --max-pods="110"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932279    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932282    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932285    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932288    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932291    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932294    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932297    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932305    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932308    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932311    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 15:12:55.136629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932314    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932317    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932322    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932326    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932329    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932332    2580 flags.go:64] FLAG: --port="10250"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932335    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932337    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06fda6ffe09fabbb8"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932340    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932343    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932346    2580 flags.go:64] FLAG: --register-node="true"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932349    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932353    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932356    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932359    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932361    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932365    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932368    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932372    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932375    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932378    2580 flags.go:64] FLAG: --runonce="false"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932381    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932384    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932387    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932390    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 15:12:55.137484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932392    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932396    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932399    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932402    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932404    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932409    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932412    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932415    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932418    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932421    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932424    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932429    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932432    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932435    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932439    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932442    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932445    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932448    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932450    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932453    2580 flags.go:64] FLAG: --v="2"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932457    2580 flags.go:64] FLAG: --version="false"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932461    2580 flags.go:64] FLAG: --vmodule=""
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932464    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.932467    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932579    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 15:12:55.138267 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932584    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932587    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932590    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932593    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932597    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932601    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932604    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932607    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932610    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932613    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932616    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932618    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932622    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932625    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932627    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932630    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932632    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932635    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932638    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 15:12:55.242571 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932641    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932643    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932646    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932648    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932651    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932653    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932656    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932658    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932662    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932666    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932669    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932672    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932675    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932679    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932683    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932687    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932690    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932692    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932695    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 15:12:55.243205 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932698    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932700    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932703    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932705    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932708    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932710    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932714    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932717    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932719    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932722    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932725    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932728    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932734    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932736    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932739    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932742    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932745    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932747    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932749    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932752    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 15:12:55.245096 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932755    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932757    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932760    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932762    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932765    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932767    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932771    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932774    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932776    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932779    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932782    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932785    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932787    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932790    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932792    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932795    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932797    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932800    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932804    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932807    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 15:12:55.245698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932809    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932812    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932814    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932817    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932819    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932822    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932825    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932827    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932830    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932832    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932835    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932837    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932840    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932842    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932845    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932847    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932850    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932852    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932856    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 15:12:55.246302 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.932859    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.933435    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.940469    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.940486    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.940505    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.940511    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940580    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940586    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940589    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940592    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940595    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940598    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940602    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940607    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 15:12:55.247054 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940610    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940613    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940615    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940618    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940621    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940624    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940626    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940629    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940631    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940634    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940637    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940640    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940642    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940645    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940648    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940651    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940654    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940657    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940659    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940662    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 15:12:55.247448 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940665    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940678    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940681    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940683    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940686    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940688    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940691    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940694    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940696    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940699    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940701    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940704    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940707    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940710    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940713    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940716    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940718    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940721    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940723    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940726    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 15:12:55.357358 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940729    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940731    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940734    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940737    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940739    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940742    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940744    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940747    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940749    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940752    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940754    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940757    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940760    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940764    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940772    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940775    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940777    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940780    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940782    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940785    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 15:12:55.358112 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940788    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940790    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940794    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940798    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940801    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940805    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940808    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940811    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940814    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940817    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940820    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940822    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940825    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940829    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940831    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940834    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940837    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940840    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940842    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940845    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 15:12:55.358749 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940847    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940850    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940852    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940857    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940860    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940864    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940867    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940891    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940897    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940900    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.940902    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.940908    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941063    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941068    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 15:12:55.359407 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941071    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941074    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941077    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941081    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941084    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941087    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941090    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941093    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941096    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941098    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941101    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941105    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941108    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941110    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941113    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941116    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941118    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941121    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941123    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941126    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 15:12:55.359834 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941129    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941131    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941134    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941136    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941140    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941142    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941151    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941153    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941156    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941159    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941161    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941164    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941166    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941169    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941172    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941176    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941178    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941181    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941183    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 15:12:55.360461 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941186    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941190    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941193    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941196    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941199    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941202    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941204    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941207    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941210    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941212    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941215    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941217    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941220    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941222    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941225    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941227    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941230    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941234    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941237    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 15:12:55.361081 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941239    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941249    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941253    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941256    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941259    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941261    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941264    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941267    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941269    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941274    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941277    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941280    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941283    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941285    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941288    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941291    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941294    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941296    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941298    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941301    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 15:12:55.361707 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941304    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941306    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941309    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941311    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941314    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941317    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941319    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941322    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941324    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941327    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941330    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941333    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941336    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941338    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941347    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941350    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941353    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941355    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 15:12:55.362322 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:54.941358    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.941363    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.943415    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.946257    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.947665    2580 server.go:1019] "Starting client certificate rotation"
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.947764    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.947802    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.949798    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.952650    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.961696    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.963738    2580 log.go:25] "Validated CRI v1 image API"
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.964642    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 15:12:55.363135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.968313    2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9f823dd0-7268-4c6d-8abe-8c6a7e138cfa:/dev/nvme0n1p4 f0a77124-e38e-419c-836a-26d651c7b4f8:/dev/nvme0n1p3]
Jul 22 15:12:55.363542 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.968327    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 15:12:55.363748 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.973982    2580 manager.go:216] Machine: {Timestamp:2026-07-22 15:12:54.972889532 +0000 UTC m=+0.274078098 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102735 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22173cb97e502660282ec6a21ba10d SystemUUID:ec22173c-b97e-5026-6028-2ec6a21ba10d BootID:f9e21fb5-7faf-42e4-9cf3-e746e6bb246a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bb:90:4e:8b:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bb:90:4e:8b:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:d0:ca:b6:6c:b7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 15:12:55.363748 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.974084    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 15:12:55.363748 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.974195    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 15:12:55.363748 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.976790    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 15:12:55.363748 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.976814    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-167.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 15:12:55.363748 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.977523    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 15:12:55.363748 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.977536    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 15:12:55.363748 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.977546    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.978219    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.980036    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.980034    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.983954    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.984104    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.984140    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.984152    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.984170    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.984187    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.984199    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.984602    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.984649    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.988264    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.990272    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.990312    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991238    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991250    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991257    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991262    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991270    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991276    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991284    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991289    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991298    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991303    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991312    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991317    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991912    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.991919    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.995529    2580 server.go:1268] "Started kubelet"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.995641    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.995635    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.995832    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.996469    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-167.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:54.996564    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:54.996692    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.997623    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:54.998167    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 15:12:55.364146 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.003105    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.004315    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.004332    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.004402    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.004893    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.004898    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.004917    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.005059    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.005068    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.004540    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-167.ec2.internal.18c4a55de27643ed  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-167.ec2.internal,UID:ip-10-0-133-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-167.ec2.internal,},FirstTimestamp:2026-07-22 15:12:54.995502061 +0000 UTC m=+0.296690628,LastTimestamp:2026-07-22 15:12:54.995502061 +0000 UTC m=+0.296690628,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-167.ec2.internal,}"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.005505    2580 factory.go:55] Registering systemd factory
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.005525    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.005734    2580 factory.go:153] Registering CRI-O factory
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.005751    2580 factory.go:223] Registration of the crio container factory successfully
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.005801    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.005826    2580 factory.go:103] Registering Raw factory
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.005839    2580 manager.go:1196] Started watching for new ooms in manager
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.006351    2580 manager.go:349] Starting recovery of all containers
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.006539    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.006900    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.008086    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7jm77"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.016913    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7jm77"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.017368    2580 manager.go:354] Recovery completed
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.021220    2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.024089    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.025839    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.025865    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.025899    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.026455    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.026465    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.026479    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.026485    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 15:12:55.365194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.027148    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.027172    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.027185    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.028492    2580 policy_none.go:49] "None policy: Start"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.028504    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.028514    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.030448    2580 policy_none.go:47] "Start"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.067504    2580 manager.go:337] "Starting Device Plugin manager"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.067538    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.067552    2580 server.go:87] "Starting device plugin registration server"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.067864    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.067893    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.068009    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.068093    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.068101    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.068614    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.068667    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-167.ec2.internal\" not found"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.134778    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.136248    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.136291    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.136318    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.136360    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.145084    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.168899    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.169657    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.169678    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.169688    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.169709    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.183362    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.183380    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-167.ec2.internal\": node \"ip-10-0-133-167.ec2.internal\" not found"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.213411    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.236405    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal"]
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.236492    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.237362    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.237386    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.237396    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.239683    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.239782    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.366093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.239808    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.244557    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.244583    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.244594    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.244561    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.244639    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.244650    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.246836    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.246858    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.247723    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.247750    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.247760    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeHasSufficientPID"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.267410    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-167.ec2.internal\" not found" node="ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.270900    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-167.ec2.internal\" not found" node="ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.307164    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2873a952de0b0fdc994d04d343e7780-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"f2873a952de0b0fdc994d04d343e7780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.307192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2873a952de0b0fdc994d04d343e7780-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"f2873a952de0b0fdc994d04d343e7780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.307216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b304257d6d5f2082aa669ba1dc8a104b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-167.ec2.internal\" (UID: \"b304257d6d5f2082aa669ba1dc8a104b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.367466 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.314076    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found"
Jul 22 15:12:55.472871 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.407473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2873a952de0b0fdc994d04d343e7780-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"f2873a952de0b0fdc994d04d343e7780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.472871 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.407500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2873a952de0b0fdc994d04d343e7780-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"f2873a952de0b0fdc994d04d343e7780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.472871 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.407517    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b304257d6d5f2082aa669ba1dc8a104b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-167.ec2.internal\" (UID: \"b304257d6d5f2082aa669ba1dc8a104b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.472871 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.407551    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2873a952de0b0fdc994d04d343e7780-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"f2873a952de0b0fdc994d04d343e7780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.472871 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.407554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b304257d6d5f2082aa669ba1dc8a104b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-167.ec2.internal\" (UID: \"b304257d6d5f2082aa669ba1dc8a104b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.472871 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:55.407584    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2873a952de0b0fdc994d04d343e7780-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal\" (UID: \"f2873a952de0b0fdc994d04d343e7780\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:55.472871 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:55.414543    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found"
Jul 22 15:12:57.190042 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:57.153355    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found"
Jul 22 15:12:57.258419 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.208522    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:57.258419 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.211678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:57.267087 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:57.266808    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found"
Jul 22 15:12:57.428901 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:57.367597    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found"
Jul 22 15:12:57.550549 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:57.474889    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found"
Jul 22 15:12:57.657567 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:57.575184    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-167.ec2.internal\" not found"
Jul 22 15:12:57.657567 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.585329    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 15:12:57.657567 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.585479    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 15:12:57.657567 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.634172    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 15:12:57.657567 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.643345    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:57.657567 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.643368    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 15:12:57.657567 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.649252    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 15:12:57.657567 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.654509    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 15:12:57.657567 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.655946    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal"
Jul 22 15:12:57.657567 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.657044    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 15:12:57.663488 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.662884    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 15:12:57.745528 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.675404    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6nqpc"
Jul 22 15:12:57.745528 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.678424    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 15:07:56 +0000 UTC" deadline="2027-12-27 20:23:07.991530593 +0000 UTC"
Jul 22 15:12:57.745528 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.678460    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12557h10m10.313073824s"
Jul 22 15:12:57.745528 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.683187    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6nqpc"
Jul 22 15:12:57.948702 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:57.939424    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2873a952de0b0fdc994d04d343e7780.slice/crio-c3fddafe5ee25e48fb6ed12189866794e67ba2a690bb95893b1ae772939eb73e WatchSource:0}: Error finding container c3fddafe5ee25e48fb6ed12189866794e67ba2a690bb95893b1ae772939eb73e: Status 404 returned error can't find the container with id c3fddafe5ee25e48fb6ed12189866794e67ba2a690bb95893b1ae772939eb73e
Jul 22 15:12:57.948702 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:57.944495    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 15:12:58.063389 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:58.008867    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb304257d6d5f2082aa669ba1dc8a104b.slice/crio-69910fca50a6b65851391df0def55aa446570905ce6c9dbe56d700085d93e257 WatchSource:0}: Error finding container 69910fca50a6b65851391df0def55aa446570905ce6c9dbe56d700085d93e257: Status 404 returned error can't find the container with id 69910fca50a6b65851391df0def55aa446570905ce6c9dbe56d700085d93e257
Jul 22 15:12:58.078533 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.076823    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 15:12:58.623884 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.623808    2580 apiserver.go:52] "Watching apiserver"
Jul 22 15:12:58.634801 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.634773    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 15:12:58.636060 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.635996    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jcnvm","kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz","openshift-cluster-node-tuning-operator/tuned-lqkv4","openshift-image-registry/node-ca-zjwvp","openshift-multus/multus-nh5pg","openshift-network-diagnostics/network-check-target-87jvc","openshift-network-operator/iptables-alerter-8b677","kube-system/konnectivity-agent-rmxwh","openshift-dns/node-resolver-6qnvg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal","openshift-multus/multus-additional-cni-plugins-v2wrr","openshift-multus/network-metrics-daemon-c6jqt","openshift-ovn-kubernetes/ovnkube-node-m9jb2"]
Jul 22 15:12:58.638584 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.638562    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:12:58.638671 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:58.638642    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:12:58.640886 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.640855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:12:58.640992 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:58.640940    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:12:58.643063 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.643038    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.645328 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.645308    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.645689 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.645567    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 15:12:58.646023 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.646003    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 15:12:58.646102 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.646071    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 15:12:58.646199 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.646183    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pc9v4\""
Jul 22 15:12:58.647661 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.647642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zjwvp"
Jul 22 15:12:58.648982 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.648964    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 15:12:58.649066 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.649049    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 15:12:58.649148 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.648964    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bgm58\""
Jul 22 15:12:58.650016 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.649998    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.650174 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.650151    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 15:12:58.650986 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.650590    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2db9b\""
Jul 22 15:12:58.650986 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.650698    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 15:12:58.650986 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.650795    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 15:12:58.652741 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.652282    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:12:58.652741 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.652543    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 15:12:58.652976 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.652958    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 15:12:58.653042 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.652997    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 15:12:58.653103 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.653072    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 15:12:58.653103 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.653003    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kkwkg\""
Jul 22 15:12:58.654736 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.654542    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 15:12:58.654736 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.654598    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:12:58.654736 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:58.654667    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:12:58.655257 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.655207    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 15:12:58.655460 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.655442    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-27c8b\""
Jul 22 15:12:58.657189 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.657092    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.659970 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.659420    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 15:12:58.659970 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.659765    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 15:12:58.659970 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.659884    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s6tnt\""
Jul 22 15:12:58.660159 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.660037    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 15:12:58.660245 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.660224    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6qnvg"
Jul 22 15:12:58.661276 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.660991    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 15:12:58.661276 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.661024    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 15:12:58.661426 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.661331    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 15:12:58.662262 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.662009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8b677"
Jul 22 15:12:58.662827 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.662686    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 15:12:58.662827 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.662746    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z9fpd\""
Jul 22 15:12:58.663070 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.663040    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 15:12:58.664318 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.664303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.666267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.664304    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 15:12:58.666267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.665357    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 15:12:58.666267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.665565    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 15:12:58.666267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.666057    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kgdm9\""
Jul 22 15:12:58.668098 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.667689    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vzwgv\""
Jul 22 15:12:58.668098 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.667794    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 15:12:58.668098 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.667939    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683415    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49bkp\" (UniqueName: \"kubernetes.io/projected/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-kube-api-access-49bkp\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-sysconfig\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-sysctl-conf\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktnv6\" (UniqueName: \"kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6\") pod \"network-check-target-87jvc\" (UID: \"c218b219-ef71-4b65-90c4-16d592c6c6f6\") " pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683567    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsp9p\" (UniqueName: \"kubernetes.io/projected/45498614-15bc-4688-95a2-2065211c0c5c-kube-api-access-hsp9p\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683668    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-kubernetes\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683694    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-sysctl-d\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-registration-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-sys-fs\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.684404 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-systemd\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.685106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-lib-modules\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.685106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-var-lib-kubelet\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.685106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-host\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.685106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683864    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-tmp\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.685106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch2jf\" (UniqueName: \"kubernetes.io/projected/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-kube-api-access-ch2jf\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.685106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683938    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-modprobe-d\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.685106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-run\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.685106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.683997    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-sys\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.685106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.684021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-tuned\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.685106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.684047    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-socket-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.685106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.684076    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-device-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.686233 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.686111    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 15:07:57 +0000 UTC" deadline="2028-05-05 21:12:44.56009785 +0000 UTC"
Jul 22 15:12:58.686233 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.686159    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15677h59m45.87394333s"
Jul 22 15:12:58.744202 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.744177    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 15:12:58.781352 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.781273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" event={"ID":"b304257d6d5f2082aa669ba1dc8a104b","Type":"ContainerStarted","Data":"69910fca50a6b65851391df0def55aa446570905ce6c9dbe56d700085d93e257"}
Jul 22 15:12:58.783059 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.783033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" event={"ID":"f2873a952de0b0fdc994d04d343e7780","Type":"ContainerStarted","Data":"c3fddafe5ee25e48fb6ed12189866794e67ba2a690bb95893b1ae772939eb73e"}
Jul 22 15:12:58.784498 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.784606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-run-multus-certs\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.784606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea97f9bb-b985-43d2-be47-1db69d770a0a-host-slash\") pod \"iptables-alerter-8b677\" (UID: \"ea97f9bb-b985-43d2-be47-1db69d770a0a\") " pod="openshift-network-operator/iptables-alerter-8b677"
Jul 22 15:12:58.784606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784565    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8b7h\" (UniqueName: \"kubernetes.io/projected/ea97f9bb-b985-43d2-be47-1db69d770a0a-kube-api-access-n8b7h\") pod \"iptables-alerter-8b677\" (UID: \"ea97f9bb-b985-43d2-be47-1db69d770a0a\") " pod="openshift-network-operator/iptables-alerter-8b677"
Jul 22 15:12:58.784606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a83b72f6-296e-4568-8e74-afa5fe7ee139-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsp9p\" (UniqueName: \"kubernetes.io/projected/45498614-15bc-4688-95a2-2065211c0c5c-kube-api-access-hsp9p\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-kubernetes\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-run-netns\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-os-release\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a83b72f6-296e-4568-8e74-afa5fe7ee139-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d12912d-1418-477a-ba02-3c04124de36b-ovnkube-config\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea97f9bb-b985-43d2-be47-1db69d770a0a-iptables-alerter-script\") pod \"iptables-alerter-8b677\" (UID: \"ea97f9bb-b985-43d2-be47-1db69d770a0a\") " pod="openshift-network-operator/iptables-alerter-8b677"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784813    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-modprobe-d\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-run-ovn-kubernetes\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.784904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-system-cni-dir\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-run-k8s-cni-cncf-io\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w86jz\" (UniqueName: \"kubernetes.io/projected/95ac3303-ad70-4a41-87f4-212a41827221-kube-api-access-w86jz\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.784983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-cnibin\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-host\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-tmp\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-systemd-units\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d12912d-1418-477a-ba02-3c04124de36b-ovn-node-metrics-cert\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d12912d-1418-477a-ba02-3c04124de36b-ovnkube-script-lib\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-cnibin\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95ac3303-ad70-4a41-87f4-212a41827221-cni-binary-copy\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-systemd\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-run-systemd\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.785518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-run-ovn\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-cni-bin\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-var-lib-cni-multus\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95ac3303-ad70-4a41-87f4-212a41827221-multus-daemon-config\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785378    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfac16a9-fa38-4567-b6bd-b897037d8562-konnectivity-ca\") pod \"konnectivity-agent-rmxwh\" (UID: \"bfac16a9-fa38-4567-b6bd-b897037d8562\") " pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-slash\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785424    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-var-lib-openvswitch\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785448    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-multus-cni-dir\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.785557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-host\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:58.785682    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:58.785796    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs podName:45498614-15bc-4688-95a2-2065211c0c5c nodeName:}" failed. No retries permitted until 2026-07-22 15:12:59.285763185 +0000 UTC m=+2.948912604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs") pod "network-metrics-daemon-c6jqt" (UID: "45498614-15bc-4688-95a2-2065211c0c5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786000    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.786197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-etc-kubernetes\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-kubernetes\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786250    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-socket-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-systemd\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-device-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-modprobe-d\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-sysctl-conf\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/245ec562-e06c-408f-a8bf-b129ec5e006a-host\") pod \"node-ca-zjwvp\" (UID: \"245ec562-e06c-408f-a8bf-b129ec5e006a\") " pod="openshift-image-registry/node-ca-zjwvp"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786378    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-socket-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/245ec562-e06c-408f-a8bf-b129ec5e006a-serviceca\") pod \"node-ca-zjwvp\" (UID: \"245ec562-e06c-408f-a8bf-b129ec5e006a\") " pod="openshift-image-registry/node-ca-zjwvp"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-device-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h8sb\" (UniqueName: \"kubernetes.io/projected/245ec562-e06c-408f-a8bf-b129ec5e006a-kube-api-access-2h8sb\") pod \"node-ca-zjwvp\" (UID: \"245ec562-e06c-408f-a8bf-b129ec5e006a\") " pod="openshift-image-registry/node-ca-zjwvp"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786463    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-sysctl-conf\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-var-lib-kubelet\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.786824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-multus-conf-dir\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p67d7\" (UniqueName: \"kubernetes.io/projected/1d12912d-1418-477a-ba02-3c04124de36b-kube-api-access-p67d7\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550273c2-01c3-49ae-b33e-5d045e936d4a-tmp-dir\") pod \"node-resolver-6qnvg\" (UID: \"550273c2-01c3-49ae-b33e-5d045e936d4a\") " pod="openshift-dns/node-resolver-6qnvg"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786592    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktnv6\" (UniqueName: \"kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6\") pod \"network-check-target-87jvc\" (UID: \"c218b219-ef71-4b65-90c4-16d592c6c6f6\") " pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-sysctl-d\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786664    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a41a8d0a-1214-44b7-9032-97d7eb4905c9-kubelet-config\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-registration-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-var-lib-kubelet\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch2jf\" (UniqueName: \"kubernetes.io/projected/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-kube-api-access-ch2jf\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-node-log\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786789    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-os-release\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-hostroot\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-sys\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.787602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a41a8d0a-1214-44b7-9032-97d7eb4905c9-dbus\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-run-netns\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786933    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfac16a9-fa38-4567-b6bd-b897037d8562-agent-certs\") pod \"konnectivity-agent-rmxwh\" (UID: \"bfac16a9-fa38-4567-b6bd-b897037d8562\") " pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.786972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49bkp\" (UniqueName: \"kubernetes.io/projected/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-kube-api-access-49bkp\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787010    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-sysconfig\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-sysctl-d\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-kubelet\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-sysconfig\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787108    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq5jk\" (UniqueName: \"kubernetes.io/projected/550273c2-01c3-49ae-b33e-5d045e936d4a-kube-api-access-fq5jk\") pod \"node-resolver-6qnvg\" (UID: \"550273c2-01c3-49ae-b33e-5d045e936d4a\") " pod="openshift-dns/node-resolver-6qnvg"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-var-lib-kubelet\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-var-lib-cni-bin\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787161    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-sys\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-registration-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.788321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787202    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-lib-modules\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a83b72f6-296e-4568-8e74-afa5fe7ee139-cni-binary-copy\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787300    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9xfd\" (UniqueName: \"kubernetes.io/projected/a83b72f6-296e-4568-8e74-afa5fe7ee139-kube-api-access-p9xfd\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787387    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-sys-fs\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-etc-openvswitch\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-sys-fs\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787450    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-run-openvswitch\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-lib-modules\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787481    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-log-socket\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787508    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-cni-netd\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-multus-socket-dir-parent\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787585    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-run\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.788975 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787617    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-tuned\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.789684 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d12912d-1418-477a-ba02-3c04124de36b-env-overrides\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.789684 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787706    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-run\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.789684 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/550273c2-01c3-49ae-b33e-5d045e936d4a-hosts-file\") pod \"node-resolver-6qnvg\" (UID: \"550273c2-01c3-49ae-b33e-5d045e936d4a\") " pod="openshift-dns/node-resolver-6qnvg"
Jul 22 15:12:58.789684 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.787796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-system-cni-dir\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.791893 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.791868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-tmp\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.792059 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.792046    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-etc-tuned\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.796298 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:58.795979    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 15:12:58.796298 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:58.796002    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 15:12:58.796298 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:58.796015    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ktnv6 for pod openshift-network-diagnostics/network-check-target-87jvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:12:58.796298 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:58.796107    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6 podName:c218b219-ef71-4b65-90c4-16d592c6c6f6 nodeName:}" failed. No retries permitted until 2026-07-22 15:12:59.29608793 +0000 UTC m=+2.959237346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ktnv6" (UniqueName: "kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6") pod "network-check-target-87jvc" (UID: "c218b219-ef71-4b65-90c4-16d592c6c6f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:12:58.799202 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.799138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsp9p\" (UniqueName: \"kubernetes.io/projected/45498614-15bc-4688-95a2-2065211c0c5c-kube-api-access-hsp9p\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:12:58.801622 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.801599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49bkp\" (UniqueName: \"kubernetes.io/projected/3c1862b2-ea48-4d50-9dc7-dff06cefffd4-kube-api-access-49bkp\") pod \"aws-ebs-csi-driver-node-7nkbz\" (UID: \"3c1862b2-ea48-4d50-9dc7-dff06cefffd4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.802067 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.802027    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch2jf\" (UniqueName: \"kubernetes.io/projected/cc349fb9-37b9-4bce-abb6-41d9711e0f5a-kube-api-access-ch2jf\") pod \"tuned-lqkv4\" (UID: \"cc349fb9-37b9-4bce-abb6-41d9711e0f5a\") " pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.888752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d12912d-1418-477a-ba02-3c04124de36b-env-overrides\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.888752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888717    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/550273c2-01c3-49ae-b33e-5d045e936d4a-hosts-file\") pod \"node-resolver-6qnvg\" (UID: \"550273c2-01c3-49ae-b33e-5d045e936d4a\") " pod="openshift-dns/node-resolver-6qnvg"
Jul 22 15:12:58.888752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-system-cni-dir\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888790    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-run-multus-certs\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888807    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/550273c2-01c3-49ae-b33e-5d045e936d4a-hosts-file\") pod \"node-resolver-6qnvg\" (UID: \"550273c2-01c3-49ae-b33e-5d045e936d4a\") " pod="openshift-dns/node-resolver-6qnvg"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea97f9bb-b985-43d2-be47-1db69d770a0a-host-slash\") pod \"iptables-alerter-8b677\" (UID: \"ea97f9bb-b985-43d2-be47-1db69d770a0a\") " pod="openshift-network-operator/iptables-alerter-8b677"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888847    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-run-multus-certs\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8b7h\" (UniqueName: \"kubernetes.io/projected/ea97f9bb-b985-43d2-be47-1db69d770a0a-kube-api-access-n8b7h\") pod \"iptables-alerter-8b677\" (UID: \"ea97f9bb-b985-43d2-be47-1db69d770a0a\") " pod="openshift-network-operator/iptables-alerter-8b677"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888880    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888892    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-system-cni-dir\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a83b72f6-296e-4568-8e74-afa5fe7ee139-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea97f9bb-b985-43d2-be47-1db69d770a0a-host-slash\") pod \"iptables-alerter-8b677\" (UID: \"ea97f9bb-b985-43d2-be47-1db69d770a0a\") " pod="openshift-network-operator/iptables-alerter-8b677"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.888979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-run-netns\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-os-release\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.889024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-run-netns\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a83b72f6-296e-4568-8e74-afa5fe7ee139-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d12912d-1418-477a-ba02-3c04124de36b-ovnkube-config\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-os-release\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889082    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea97f9bb-b985-43d2-be47-1db69d770a0a-iptables-alerter-script\") pod \"iptables-alerter-8b677\" (UID: \"ea97f9bb-b985-43d2-be47-1db69d770a0a\") " pod="openshift-network-operator/iptables-alerter-8b677"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-run-ovn-kubernetes\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889159    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-system-cni-dir\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-run-k8s-cni-cncf-io\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w86jz\" (UniqueName: \"kubernetes.io/projected/95ac3303-ad70-4a41-87f4-212a41827221-kube-api-access-w86jz\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-cnibin\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1d12912d-1418-477a-ba02-3c04124de36b-env-overrides\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-systemd-units\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d12912d-1418-477a-ba02-3c04124de36b-ovn-node-metrics-cert\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.889687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d12912d-1418-477a-ba02-3c04124de36b-ovnkube-script-lib\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-cnibin\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95ac3303-ad70-4a41-87f4-212a41827221-cni-binary-copy\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889384    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-run-k8s-cni-cncf-io\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a83b72f6-296e-4568-8e74-afa5fe7ee139-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889575    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a83b72f6-296e-4568-8e74-afa5fe7ee139-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889591    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1d12912d-1418-477a-ba02-3c04124de36b-ovnkube-config\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889611    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-system-cni-dir\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a83b72f6-296e-4568-8e74-afa5fe7ee139-cnibin\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-run-systemd\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-run-ovn-kubernetes\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889657    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-run-ovn\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889678    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-cnibin\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-cni-bin\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.890353 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-cni-bin\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-var-lib-cni-multus\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889745    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-var-lib-cni-multus\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-run-ovn\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889834    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-run-systemd\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95ac3303-ad70-4a41-87f4-212a41827221-multus-daemon-config\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfac16a9-fa38-4567-b6bd-b897037d8562-konnectivity-ca\") pod \"konnectivity-agent-rmxwh\" (UID: \"bfac16a9-fa38-4567-b6bd-b897037d8562\") " pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-slash\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889905    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-var-lib-openvswitch\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889934    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea97f9bb-b985-43d2-be47-1db69d770a0a-iptables-alerter-script\") pod \"iptables-alerter-8b677\" (UID: \"ea97f9bb-b985-43d2-be47-1db69d770a0a\") " pod="openshift-network-operator/iptables-alerter-8b677"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-multus-cni-dir\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-etc-kubernetes\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/245ec562-e06c-408f-a8bf-b129ec5e006a-host\") pod \"node-ca-zjwvp\" (UID: \"245ec562-e06c-408f-a8bf-b129ec5e006a\") " pod="openshift-image-registry/node-ca-zjwvp"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889987    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-slash\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.889997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/245ec562-e06c-408f-a8bf-b129ec5e006a-serviceca\") pod \"node-ca-zjwvp\" (UID: \"245ec562-e06c-408f-a8bf-b129ec5e006a\") " pod="openshift-image-registry/node-ca-zjwvp"
Jul 22 15:12:58.891115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h8sb\" (UniqueName: \"kubernetes.io/projected/245ec562-e06c-408f-a8bf-b129ec5e006a-kube-api-access-2h8sb\") pod \"node-ca-zjwvp\" (UID: \"245ec562-e06c-408f-a8bf-b129ec5e006a\") " pod="openshift-image-registry/node-ca-zjwvp"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-var-lib-kubelet\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-multus-conf-dir\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p67d7\" (UniqueName: \"kubernetes.io/projected/1d12912d-1418-477a-ba02-3c04124de36b-kube-api-access-p67d7\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550273c2-01c3-49ae-b33e-5d045e936d4a-tmp-dir\") pod \"node-resolver-6qnvg\" (UID: \"550273c2-01c3-49ae-b33e-5d045e936d4a\") " pod="openshift-dns/node-resolver-6qnvg"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890086    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1d12912d-1418-477a-ba02-3c04124de36b-ovnkube-script-lib\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a41a8d0a-1214-44b7-9032-97d7eb4905c9-kubelet-config\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890158    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95ac3303-ad70-4a41-87f4-212a41827221-cni-binary-copy\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-node-log\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-os-release\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-hostroot\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890225    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95ac3303-ad70-4a41-87f4-212a41827221-multus-daemon-config\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890238    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a41a8d0a-1214-44b7-9032-97d7eb4905c9-dbus\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-run-netns\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890300    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfac16a9-fa38-4567-b6bd-b897037d8562-agent-certs\") pod \"konnectivity-agent-rmxwh\" (UID: \"bfac16a9-fa38-4567-b6bd-b897037d8562\") " pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:12:58.891822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890356    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-kubelet\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a41a8d0a-1214-44b7-9032-97d7eb4905c9-dbus\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5jk\" (UniqueName: \"kubernetes.io/projected/550273c2-01c3-49ae-b33e-5d045e936d4a-kube-api-access-fq5jk\") pod \"node-resolver-6qnvg\" (UID: \"550273c2-01c3-49ae-b33e-5d045e936d4a\") " pod="openshift-dns/node-resolver-6qnvg"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550273c2-01c3-49ae-b33e-5d045e936d4a-tmp-dir\") pod \"node-resolver-6qnvg\" (UID: \"550273c2-01c3-49ae-b33e-5d045e936d4a\") " pod="openshift-dns/node-resolver-6qnvg"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890407    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-systemd-units\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890408    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-var-lib-cni-bin\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a83b72f6-296e-4568-8e74-afa5fe7ee139-cni-binary-copy\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-var-lib-cni-bin\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9xfd\" (UniqueName: \"kubernetes.io/projected/a83b72f6-296e-4568-8e74-afa5fe7ee139-kube-api-access-p9xfd\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890488    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfac16a9-fa38-4567-b6bd-b897037d8562-konnectivity-ca\") pod \"konnectivity-agent-rmxwh\" (UID: \"bfac16a9-fa38-4567-b6bd-b897037d8562\") " pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-etc-openvswitch\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-run-netns\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890516    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/245ec562-e06c-408f-a8bf-b129ec5e006a-serviceca\") pod \"node-ca-zjwvp\" (UID: \"245ec562-e06c-408f-a8bf-b129ec5e006a\") " pod="openshift-image-registry/node-ca-zjwvp"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-run-openvswitch\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.892560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-kubelet\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-log-socket\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-etc-kubernetes\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890591    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-log-socket\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-cni-netd\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890611    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-var-lib-openvswitch\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/245ec562-e06c-408f-a8bf-b129ec5e006a-host\") pod \"node-ca-zjwvp\" (UID: \"245ec562-e06c-408f-a8bf-b129ec5e006a\") " pod="openshift-image-registry/node-ca-zjwvp"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-multus-conf-dir\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-os-release\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-multus-cni-dir\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890863    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-hostroot\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a41a8d0a-1214-44b7-9032-97d7eb4905c9-kubelet-config\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-multus-socket-dir-parent\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.890954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-host-cni-netd\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.891001    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-multus-socket-dir-parent\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.893289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.891013    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-node-log\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.893777 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.891038    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-etc-openvswitch\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.893777 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.891054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95ac3303-ad70-4a41-87f4-212a41827221-host-var-lib-kubelet\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.893777 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.891057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a83b72f6-296e-4568-8e74-afa5fe7ee139-cni-binary-copy\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.893777 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:58.891092    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 15:12:58.893777 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.891096    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1d12912d-1418-477a-ba02-3c04124de36b-run-openvswitch\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.893777 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:58.891145    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret podName:a41a8d0a-1214-44b7-9032-97d7eb4905c9 nodeName:}" failed. No retries permitted until 2026-07-22 15:12:59.391128715 +0000 UTC m=+3.054278119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret") pod "global-pull-secret-syncer-jcnvm" (UID: "a41a8d0a-1214-44b7-9032-97d7eb4905c9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 15:12:58.893777 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.893174    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d12912d-1418-477a-ba02-3c04124de36b-ovn-node-metrics-cert\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.893777 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.893257    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfac16a9-fa38-4567-b6bd-b897037d8562-agent-certs\") pod \"konnectivity-agent-rmxwh\" (UID: \"bfac16a9-fa38-4567-b6bd-b897037d8562\") " pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:12:58.898034 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.897999    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8b7h\" (UniqueName: \"kubernetes.io/projected/ea97f9bb-b985-43d2-be47-1db69d770a0a-kube-api-access-n8b7h\") pod \"iptables-alerter-8b677\" (UID: \"ea97f9bb-b985-43d2-be47-1db69d770a0a\") " pod="openshift-network-operator/iptables-alerter-8b677"
Jul 22 15:12:58.898302 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.898278    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w86jz\" (UniqueName: \"kubernetes.io/projected/95ac3303-ad70-4a41-87f4-212a41827221-kube-api-access-w86jz\") pod \"multus-nh5pg\" (UID: \"95ac3303-ad70-4a41-87f4-212a41827221\") " pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.900073 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.900025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p67d7\" (UniqueName: \"kubernetes.io/projected/1d12912d-1418-477a-ba02-3c04124de36b-kube-api-access-p67d7\") pod \"ovnkube-node-m9jb2\" (UID: \"1d12912d-1418-477a-ba02-3c04124de36b\") " pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:58.900221 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.900180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h8sb\" (UniqueName: \"kubernetes.io/projected/245ec562-e06c-408f-a8bf-b129ec5e006a-kube-api-access-2h8sb\") pod \"node-ca-zjwvp\" (UID: \"245ec562-e06c-408f-a8bf-b129ec5e006a\") " pod="openshift-image-registry/node-ca-zjwvp"
Jul 22 15:12:58.901023 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.900895    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9xfd\" (UniqueName: \"kubernetes.io/projected/a83b72f6-296e-4568-8e74-afa5fe7ee139-kube-api-access-p9xfd\") pod \"multus-additional-cni-plugins-v2wrr\" (UID: \"a83b72f6-296e-4568-8e74-afa5fe7ee139\") " pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:58.901263 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.901245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq5jk\" (UniqueName: \"kubernetes.io/projected/550273c2-01c3-49ae-b33e-5d045e936d4a-kube-api-access-fq5jk\") pod \"node-resolver-6qnvg\" (UID: \"550273c2-01c3-49ae-b33e-5d045e936d4a\") " pod="openshift-dns/node-resolver-6qnvg"
Jul 22 15:12:58.957192 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.957163    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz"
Jul 22 15:12:58.959708 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.959682    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 15:12:58.966845 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.966820    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lqkv4"
Jul 22 15:12:58.980527 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.980507    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zjwvp"
Jul 22 15:12:58.986217 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.986192    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nh5pg"
Jul 22 15:12:58.993998 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:58.993977    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:12:59.003690 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:59.003660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:12:59.011266 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:59.011244    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6qnvg"
Jul 22 15:12:59.026839 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:59.026820    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8b677"
Jul 22 15:12:59.034602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:59.034582    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v2wrr"
Jul 22 15:12:59.293972 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:59.293878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:12:59.294136 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:59.294041    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:12:59.294136 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:59.294107    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs podName:45498614-15bc-4688-95a2-2065211c0c5c nodeName:}" failed. No retries permitted until 2026-07-22 15:13:00.294093082 +0000 UTC m=+3.957242485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs") pod "network-metrics-daemon-c6jqt" (UID: "45498614-15bc-4688-95a2-2065211c0c5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:12:59.394981 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:59.394944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktnv6\" (UniqueName: \"kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6\") pod \"network-check-target-87jvc\" (UID: \"c218b219-ef71-4b65-90c4-16d592c6c6f6\") " pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:12:59.395154 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:59.394997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:12:59.395154 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:59.395120    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 15:12:59.395154 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:59.395144    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 15:12:59.395310 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:59.395159    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ktnv6 for pod openshift-network-diagnostics/network-check-target-87jvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:12:59.395310 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:59.395165    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 15:12:59.395310 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:59.395235    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6 podName:c218b219-ef71-4b65-90c4-16d592c6c6f6 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:00.395215559 +0000 UTC m=+4.058364968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktnv6" (UniqueName: "kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6") pod "network-check-target-87jvc" (UID: "c218b219-ef71-4b65-90c4-16d592c6c6f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:12:59.395310 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:59.395259    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret podName:a41a8d0a-1214-44b7-9032-97d7eb4905c9 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:00.395247548 +0000 UTC m=+4.058396948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret") pod "global-pull-secret-syncer-jcnvm" (UID: "a41a8d0a-1214-44b7-9032-97d7eb4905c9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 15:12:59.686687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:59.686576    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 15:07:57 +0000 UTC" deadline="2028-04-18 18:02:42.509970896 +0000 UTC"
Jul 22 15:12:59.686687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:59.686631    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15266h49m42.823342734s"
Jul 22 15:12:59.775568 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:12:59.775526    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:12:59.775738 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:12:59.775657    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:12:59.820511 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:59.820440    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea97f9bb_b985_43d2_be47_1db69d770a0a.slice/crio-207188e72893b9b6354a6b423e63ec6c88643044b157706e0cdaa5d065cc0b1a WatchSource:0}: Error finding container 207188e72893b9b6354a6b423e63ec6c88643044b157706e0cdaa5d065cc0b1a: Status 404 returned error can't find the container with id 207188e72893b9b6354a6b423e63ec6c88643044b157706e0cdaa5d065cc0b1a
Jul 22 15:12:59.823729 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:59.823707    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1862b2_ea48_4d50_9dc7_dff06cefffd4.slice/crio-4d87db7e58208a28edc03a2e973046562a234a595622d4ee17a24135d979ebfc WatchSource:0}: Error finding container 4d87db7e58208a28edc03a2e973046562a234a595622d4ee17a24135d979ebfc: Status 404 returned error can't find the container with id 4d87db7e58208a28edc03a2e973046562a234a595622d4ee17a24135d979ebfc
Jul 22 15:12:59.844847 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:59.844820    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ac3303_ad70_4a41_87f4_212a41827221.slice/crio-ad5b1f1de2cd082298a4c26e1759485eb7e99be66e8b7a509a875b7b36bf0975 WatchSource:0}: Error finding container ad5b1f1de2cd082298a4c26e1759485eb7e99be66e8b7a509a875b7b36bf0975: Status 404 returned error can't find the container with id ad5b1f1de2cd082298a4c26e1759485eb7e99be66e8b7a509a875b7b36bf0975
Jul 22 15:12:59.845508 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:59.845486    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550273c2_01c3_49ae_b33e_5d045e936d4a.slice/crio-cb8c4453b02023ff1a07612e5898ed36549f19c592427b3fe75f4716f76670ee WatchSource:0}: Error finding container cb8c4453b02023ff1a07612e5898ed36549f19c592427b3fe75f4716f76670ee: Status 404 returned error can't find the container with id cb8c4453b02023ff1a07612e5898ed36549f19c592427b3fe75f4716f76670ee
Jul 22 15:12:59.846332 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:59.846308    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245ec562_e06c_408f_a8bf_b129ec5e006a.slice/crio-2a5023c48993b21378c7c484a59aa21245c697c51e66f0f7eee5d4395a215708 WatchSource:0}: Error finding container 2a5023c48993b21378c7c484a59aa21245c697c51e66f0f7eee5d4395a215708: Status 404 returned error can't find the container with id 2a5023c48993b21378c7c484a59aa21245c697c51e66f0f7eee5d4395a215708
Jul 22 15:12:59.847595 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:59.847571    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d12912d_1418_477a_ba02_3c04124de36b.slice/crio-73478fa881bc5896ae8cb2622a99f013626a4d0fe711e4f15ea12e8d371689f3 WatchSource:0}: Error finding container 73478fa881bc5896ae8cb2622a99f013626a4d0fe711e4f15ea12e8d371689f3: Status 404 returned error can't find the container with id 73478fa881bc5896ae8cb2622a99f013626a4d0fe711e4f15ea12e8d371689f3
Jul 22 15:12:59.849071 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:59.849036    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc349fb9_37b9_4bce_abb6_41d9711e0f5a.slice/crio-567936fcad94fcb575dbf9306a5d701bdc506e70446f0a4f20d2c78662ff59c3 WatchSource:0}: Error finding container 567936fcad94fcb575dbf9306a5d701bdc506e70446f0a4f20d2c78662ff59c3: Status 404 returned error can't find the container with id 567936fcad94fcb575dbf9306a5d701bdc506e70446f0a4f20d2c78662ff59c3
Jul 22 15:12:59.849890 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:12:59.849615    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda83b72f6_296e_4568_8e74_afa5fe7ee139.slice/crio-855b487c9257d8dc229ec203fc5379b272c23e10a095cdad1326dcf8cae59ff9 WatchSource:0}: Error finding container 855b487c9257d8dc229ec203fc5379b272c23e10a095cdad1326dcf8cae59ff9: Status 404 returned error can't find the container with id 855b487c9257d8dc229ec203fc5379b272c23e10a095cdad1326dcf8cae59ff9
Jul 22 15:13:00.301745 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.301247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:00.301745 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:00.301530    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:13:00.301745 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:00.301667    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs podName:45498614-15bc-4688-95a2-2065211c0c5c nodeName:}" failed. No retries permitted until 2026-07-22 15:13:02.301642479 +0000 UTC m=+5.964791884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs") pod "network-metrics-daemon-c6jqt" (UID: "45498614-15bc-4688-95a2-2065211c0c5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:13:00.402980 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.402947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktnv6\" (UniqueName: \"kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6\") pod \"network-check-target-87jvc\" (UID: \"c218b219-ef71-4b65-90c4-16d592c6c6f6\") " pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:00.403152 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.403002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:00.403211 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:00.403161    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 15:13:00.403260 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:00.403229    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret podName:a41a8d0a-1214-44b7-9032-97d7eb4905c9 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:02.403208698 +0000 UTC m=+6.066358115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret") pod "global-pull-secret-syncer-jcnvm" (UID: "a41a8d0a-1214-44b7-9032-97d7eb4905c9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 15:13:00.403839 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:00.403817    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 15:13:00.403972 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:00.403847    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 15:13:00.403972 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:00.403861    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ktnv6 for pod openshift-network-diagnostics/network-check-target-87jvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:13:00.403972 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:00.403909    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6 podName:c218b219-ef71-4b65-90c4-16d592c6c6f6 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:02.403893752 +0000 UTC m=+6.067043151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktnv6" (UniqueName: "kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6") pod "network-check-target-87jvc" (UID: "c218b219-ef71-4b65-90c4-16d592c6c6f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:13:00.775969 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.775346    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:00.775969 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:00.775538    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:00.775969 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.775569    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:00.775969 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:00.775696    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:00.807786 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.807751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" event={"ID":"b304257d6d5f2082aa669ba1dc8a104b","Type":"ContainerStarted","Data":"638b9bff5ebd591007b3d07de519cd00144cd140d40577351260939e997edbae"}
Jul 22 15:13:00.827532 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.827457    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2" event={"ID":"1d12912d-1418-477a-ba02-3c04124de36b","Type":"ContainerStarted","Data":"73478fa881bc5896ae8cb2622a99f013626a4d0fe711e4f15ea12e8d371689f3"}
Jul 22 15:13:00.842334 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.842299    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nh5pg" event={"ID":"95ac3303-ad70-4a41-87f4-212a41827221","Type":"ContainerStarted","Data":"ad5b1f1de2cd082298a4c26e1759485eb7e99be66e8b7a509a875b7b36bf0975"}
Jul 22 15:13:00.851911 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.851839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz" event={"ID":"3c1862b2-ea48-4d50-9dc7-dff06cefffd4","Type":"ContainerStarted","Data":"4d87db7e58208a28edc03a2e973046562a234a595622d4ee17a24135d979ebfc"}
Jul 22 15:13:00.865589 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.865562    2580 generic.go:356] "Generic (PLEG): container finished" podID="f2873a952de0b0fdc994d04d343e7780" containerID="aa6ce2ef76de6f80af8e18c9fe5a08f364c9707e625503afd2f580201867bf22" exitCode=0
Jul 22 15:13:00.865697 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.865646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" event={"ID":"f2873a952de0b0fdc994d04d343e7780","Type":"ContainerDied","Data":"aa6ce2ef76de6f80af8e18c9fe5a08f364c9707e625503afd2f580201867bf22"}
Jul 22 15:13:00.879938 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.878952    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2wrr" event={"ID":"a83b72f6-296e-4568-8e74-afa5fe7ee139","Type":"ContainerStarted","Data":"855b487c9257d8dc229ec203fc5379b272c23e10a095cdad1326dcf8cae59ff9"}
Jul 22 15:13:00.884215 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.884139    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-167.ec2.internal" podStartSLOduration=3.884122307 podStartE2EDuration="3.884122307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:00.824375537 +0000 UTC m=+4.487524961" watchObservedRunningTime="2026-07-22 15:13:00.884122307 +0000 UTC m=+4.547271729"
Jul 22 15:13:00.894387 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.894336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lqkv4" event={"ID":"cc349fb9-37b9-4bce-abb6-41d9711e0f5a","Type":"ContainerStarted","Data":"567936fcad94fcb575dbf9306a5d701bdc506e70446f0a4f20d2c78662ff59c3"}
Jul 22 15:13:00.916180 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.915993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zjwvp" event={"ID":"245ec562-e06c-408f-a8bf-b129ec5e006a","Type":"ContainerStarted","Data":"2a5023c48993b21378c7c484a59aa21245c697c51e66f0f7eee5d4395a215708"}
Jul 22 15:13:00.925286 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.925260    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6qnvg" event={"ID":"550273c2-01c3-49ae-b33e-5d045e936d4a","Type":"ContainerStarted","Data":"cb8c4453b02023ff1a07612e5898ed36549f19c592427b3fe75f4716f76670ee"}
Jul 22 15:13:00.929354 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.929272    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8b677" event={"ID":"ea97f9bb-b985-43d2-be47-1db69d770a0a","Type":"ContainerStarted","Data":"207188e72893b9b6354a6b423e63ec6c88643044b157706e0cdaa5d065cc0b1a"}
Jul 22 15:13:00.932961 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:00.932939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rmxwh" event={"ID":"bfac16a9-fa38-4567-b6bd-b897037d8562","Type":"ContainerStarted","Data":"c1ae0be73d1c1e06f3461cc60caa4f33c620beaae88d0505eeabd1d96ee38e12"}
Jul 22 15:13:01.775384 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:01.775302    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:01.775555 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:01.775444    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:01.946274 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:01.946207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" event={"ID":"f2873a952de0b0fdc994d04d343e7780","Type":"ContainerStarted","Data":"3617a6cc5018d91acdd9ec6d37ef0f7213da3e7378c9cf39bb0d81dd0c580f38"}
Jul 22 15:13:01.980536 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:01.980233    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-167.ec2.internal" podStartSLOduration=4.980212123 podStartE2EDuration="4.980212123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:01.979863459 +0000 UTC m=+5.643012881" watchObservedRunningTime="2026-07-22 15:13:01.980212123 +0000 UTC m=+5.643361550"
Jul 22 15:13:02.319788 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:02.319229    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:02.319788 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:02.319374    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:13:02.319788 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:02.319436    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs podName:45498614-15bc-4688-95a2-2065211c0c5c nodeName:}" failed. No retries permitted until 2026-07-22 15:13:06.319419644 +0000 UTC m=+9.982569044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs") pod "network-metrics-daemon-c6jqt" (UID: "45498614-15bc-4688-95a2-2065211c0c5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:13:02.421000 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:02.420206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktnv6\" (UniqueName: \"kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6\") pod \"network-check-target-87jvc\" (UID: \"c218b219-ef71-4b65-90c4-16d592c6c6f6\") " pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:02.421000 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:02.420260    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:02.421000 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:02.420417    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 15:13:02.421000 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:02.420476    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret podName:a41a8d0a-1214-44b7-9032-97d7eb4905c9 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:06.42045965 +0000 UTC m=+10.083609054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret") pod "global-pull-secret-syncer-jcnvm" (UID: "a41a8d0a-1214-44b7-9032-97d7eb4905c9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 15:13:02.421000 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:02.420869    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 15:13:02.421000 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:02.420891    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 15:13:02.421000 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:02.420903    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ktnv6 for pod openshift-network-diagnostics/network-check-target-87jvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:13:02.421000 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:02.420963    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6 podName:c218b219-ef71-4b65-90c4-16d592c6c6f6 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:06.420947971 +0000 UTC m=+10.084097376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktnv6" (UniqueName: "kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6") pod "network-check-target-87jvc" (UID: "c218b219-ef71-4b65-90c4-16d592c6c6f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:13:02.777771 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:02.777027    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:02.777771 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:02.777170    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:02.777771 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:02.777551    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:02.777771 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:02.777653    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:03.774842 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:03.774812    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:03.775311 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:03.774937    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:04.775119 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:04.775083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:04.775590 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:04.775234    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:04.775590 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:04.775081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:04.775590 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:04.775343    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:05.774609 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:05.774580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:05.774844 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:05.774726    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:06.351859 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:06.351821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:06.352305 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:06.352005    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:13:06.352305 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:06.352102    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs podName:45498614-15bc-4688-95a2-2065211c0c5c nodeName:}" failed. No retries permitted until 2026-07-22 15:13:14.352081239 +0000 UTC m=+18.015230656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs") pod "network-metrics-daemon-c6jqt" (UID: "45498614-15bc-4688-95a2-2065211c0c5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:13:06.452595 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:06.452553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktnv6\" (UniqueName: \"kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6\") pod \"network-check-target-87jvc\" (UID: \"c218b219-ef71-4b65-90c4-16d592c6c6f6\") " pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:06.452778 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:06.452616    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:06.452778 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:06.452737    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 15:13:06.452778 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:06.452764    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 15:13:06.452778 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:06.452773    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 15:13:06.453003 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:06.452838    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret podName:a41a8d0a-1214-44b7-9032-97d7eb4905c9 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:14.452819672 +0000 UTC m=+18.115969095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret") pod "global-pull-secret-syncer-jcnvm" (UID: "a41a8d0a-1214-44b7-9032-97d7eb4905c9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 15:13:06.453003 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:06.452776    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ktnv6 for pod openshift-network-diagnostics/network-check-target-87jvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:13:06.453003 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:06.452952    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6 podName:c218b219-ef71-4b65-90c4-16d592c6c6f6 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:14.452932903 +0000 UTC m=+18.116082308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktnv6" (UniqueName: "kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6") pod "network-check-target-87jvc" (UID: "c218b219-ef71-4b65-90c4-16d592c6c6f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:13:06.776051 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:06.775967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:06.776209 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:06.776097    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:06.776483 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:06.776461    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:06.776586 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:06.776563    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:07.774992 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:07.774958    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:07.775450 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:07.775081    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:08.775808 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:08.775770    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:08.776293 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:08.775931    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:08.776460 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:08.776438    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:08.776601 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:08.776564    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:09.774892 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:09.774839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:09.775092 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:09.774981    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:10.775628 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:10.775595    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:10.776161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:10.775600    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:10.776161 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:10.775718    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:10.776161 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:10.775776    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:11.775378 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:11.775347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:11.775540 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:11.775468    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:12.775158 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:12.775121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:12.775655 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:12.775252    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:12.775655 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:12.775298    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:12.775655 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:12.775423    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:13.775585 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:13.775542    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:13.775994 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:13.775681    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:14.413064 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:14.413026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:14.413229 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:14.413188    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:13:14.413309 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:14.413270    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs podName:45498614-15bc-4688-95a2-2065211c0c5c nodeName:}" failed. No retries permitted until 2026-07-22 15:13:30.413252943 +0000 UTC m=+34.076402342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs") pod "network-metrics-daemon-c6jqt" (UID: "45498614-15bc-4688-95a2-2065211c0c5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:13:14.513372 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:14.513336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktnv6\" (UniqueName: \"kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6\") pod \"network-check-target-87jvc\" (UID: \"c218b219-ef71-4b65-90c4-16d592c6c6f6\") " pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:14.513372 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:14.513380    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:14.513592 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:14.513505    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 15:13:14.513592 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:14.513538    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 15:13:14.513592 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:14.513563    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret podName:a41a8d0a-1214-44b7-9032-97d7eb4905c9 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:30.513549885 +0000 UTC m=+34.176699284 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret") pod "global-pull-secret-syncer-jcnvm" (UID: "a41a8d0a-1214-44b7-9032-97d7eb4905c9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 15:13:14.513592 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:14.513567    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 15:13:14.513592 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:14.513581    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ktnv6 for pod openshift-network-diagnostics/network-check-target-87jvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:13:14.513773 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:14.513633    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6 podName:c218b219-ef71-4b65-90c4-16d592c6c6f6 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:30.513615816 +0000 UTC m=+34.176765232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktnv6" (UniqueName: "kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6") pod "network-check-target-87jvc" (UID: "c218b219-ef71-4b65-90c4-16d592c6c6f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:13:14.775017 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:14.774983    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:14.775017 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:14.775030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:14.775263 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:14.775117    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:14.775309 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:14.775262    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:15.775035 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:15.774992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:15.775506 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:15.775122    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:16.775933 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:16.775892    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:16.776377 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:16.776019    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:16.776377 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:16.776078    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:16.776377 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:16.776216    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:17.775467 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:17.775434    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:17.775657 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:17.775559    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:18.775195 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:18.774967    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:18.775596 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:18.775311    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:18.775767 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:18.775746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:18.775885 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:18.775864    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:18.979408 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:18.979371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rmxwh" event={"ID":"bfac16a9-fa38-4567-b6bd-b897037d8562","Type":"ContainerStarted","Data":"4fb739c4776aa869f0f3206f98e0e289c79a6910fd899cc20cebe6079bb8fb53"}
Jul 22 15:13:18.980867 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:18.980840    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nh5pg" event={"ID":"95ac3303-ad70-4a41-87f4-212a41827221","Type":"ContainerStarted","Data":"7aac8f0ba5412fc1b2865e5efd0886929bd60c7764461fc358afc08655924fdb"}
Jul 22 15:13:18.982407 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:18.982376    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz" event={"ID":"3c1862b2-ea48-4d50-9dc7-dff06cefffd4","Type":"ContainerStarted","Data":"90dfdc428cf4b9054a22e2ac53588ccc2eedc84c9937b1658d158a9627cc1842"}
Jul 22 15:13:18.983935 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:18.983886    2580 generic.go:356] "Generic (PLEG): container finished" podID="a83b72f6-296e-4568-8e74-afa5fe7ee139" containerID="f19fa6230b258ad69cf81f154696f1cdabe79a29d16d2818652b2ea1bae9bf1f" exitCode=0
Jul 22 15:13:18.984034 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:18.984014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2wrr" event={"ID":"a83b72f6-296e-4568-8e74-afa5fe7ee139","Type":"ContainerDied","Data":"f19fa6230b258ad69cf81f154696f1cdabe79a29d16d2818652b2ea1bae9bf1f"}
Jul 22 15:13:18.985690 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:18.985661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lqkv4" event={"ID":"cc349fb9-37b9-4bce-abb6-41d9711e0f5a","Type":"ContainerStarted","Data":"688fbaaf65932c900785c45eaded34000794d7984e525cc5627152c83f918523"}
Jul 22 15:13:18.987247 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:18.987222    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zjwvp" event={"ID":"245ec562-e06c-408f-a8bf-b129ec5e006a","Type":"ContainerStarted","Data":"d7a1f8bfb620bee3c9898e2580c7b3819ac366707807dd7c875005c84e296182"}
Jul 22 15:13:18.988674 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:18.988645    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6qnvg" event={"ID":"550273c2-01c3-49ae-b33e-5d045e936d4a","Type":"ContainerStarted","Data":"3ff5c75cfcf1dc7c65dfc9e7b807144078ef8cc023261024de64a569e7513509"}
Jul 22 15:13:18.996739 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:18.996699    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rmxwh" podStartSLOduration=4.309811048 podStartE2EDuration="22.996686997s" totalImagesPullingTime="18.686875949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:18.994875405 +0000 UTC m=+22.658024839" watchObservedRunningTime="2026-07-22 15:13:18.996686997 +0000 UTC m=+22.659836445"
Jul 22 15:13:19.015341 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.013624    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nh5pg" podStartSLOduration=4.114954697 podStartE2EDuration="23.013605871s" totalImagesPullingTime="18.898651174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:19.012868017 +0000 UTC m=+22.676017441" watchObservedRunningTime="2026-07-22 15:13:19.013605871 +0000 UTC m=+22.676755293"
Jul 22 15:13:19.030940 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.030889    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6qnvg" podStartSLOduration=8.613135883 podStartE2EDuration="23.030875082s" totalImagesPullingTime="14.417739199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:19.030865802 +0000 UTC m=+22.694015223" watchObservedRunningTime="2026-07-22 15:13:19.030875082 +0000 UTC m=+22.694024502"
Jul 22 15:13:19.051733 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.051692    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lqkv4" podStartSLOduration=4.394899412 podStartE2EDuration="23.051679899s" totalImagesPullingTime="18.656780487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:19.051198801 +0000 UTC m=+22.714348223" watchObservedRunningTime="2026-07-22 15:13:19.051679899 +0000 UTC m=+22.714829319"
Jul 22 15:13:19.091755 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.091715    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zjwvp" podStartSLOduration=8.674879661 podStartE2EDuration="23.091703042s" totalImagesPullingTime="14.416823381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:19.091334466 +0000 UTC m=+22.754483888" watchObservedRunningTime="2026-07-22 15:13:19.091703042 +0000 UTC m=+22.754852493"
Jul 22 15:13:19.730485 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.730459    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:13:19.730992 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.730975    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:13:19.775267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.775248    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:19.775865 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:19.775350    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:19.952078 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.951841    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 15:13:19.993315 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.993295    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:13:19.993678 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.993648    2580 generic.go:356] "Generic (PLEG): container finished" podID="1d12912d-1418-477a-ba02-3c04124de36b" containerID="db8e564b41248807eaa41a3a0fd9cb709729226dbc4ce9a2962a857c728c8cbb" exitCode=1
Jul 22 15:13:19.993764 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.993721    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2" event={"ID":"1d12912d-1418-477a-ba02-3c04124de36b","Type":"ContainerStarted","Data":"df3ebfdc6285a10f34898815539451e857238cbfbda583d89a6b1b4267cd96ae"}
Jul 22 15:13:19.993848 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.993793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2" event={"ID":"1d12912d-1418-477a-ba02-3c04124de36b","Type":"ContainerStarted","Data":"496834028fabc9c3f37689f8a270ef3744d7b172d7b87dabd42cf5c2922b5854"}
Jul 22 15:13:19.993910 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.993844    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2" event={"ID":"1d12912d-1418-477a-ba02-3c04124de36b","Type":"ContainerDied","Data":"db8e564b41248807eaa41a3a0fd9cb709729226dbc4ce9a2962a857c728c8cbb"}
Jul 22 15:13:19.993910 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.993898    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2" event={"ID":"1d12912d-1418-477a-ba02-3c04124de36b","Type":"ContainerStarted","Data":"0ae3ec7f15bbc94ada38e48d4e91a183e4e1bb66beb9fe52fa8b55df584131e3"}
Jul 22 15:13:19.995786 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.995763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz" event={"ID":"3c1862b2-ea48-4d50-9dc7-dff06cefffd4","Type":"ContainerStarted","Data":"ff866c096abdeda72db6a2b064450303afd9bf140df6bd3341f8a25c13d0d045"}
Jul 22 15:13:19.997321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.997298    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8b677" event={"ID":"ea97f9bb-b985-43d2-be47-1db69d770a0a","Type":"ContainerStarted","Data":"7d1665bb73fecd039020295f555c195c51b8a26c65f2c92b98bce17e26e202bb"}
Jul 22 15:13:19.998430 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.998409    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:13:19.998512 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:19.998475    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rmxwh"
Jul 22 15:13:20.025122 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:20.025084    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8b677" podStartSLOduration=5.33908749 podStartE2EDuration="24.025068311s" totalImagesPullingTime="18.685980821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:20.010980125 +0000 UTC m=+23.674129548" watchObservedRunningTime="2026-07-22 15:13:20.025068311 +0000 UTC m=+23.688217731"
Jul 22 15:13:20.718799 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:20.718680    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T15:13:19.952061825Z","UUID":"28878f16-2cf4-4faa-8747-2241047ea5b0","Handler":null,"Name":"","Endpoint":""}
Jul 22 15:13:20.720554 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:20.720516    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 15:13:20.720677 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:20.720565    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 15:13:20.775033 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:20.774999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:20.775213 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:20.774999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:20.775213 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:20.775153    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:20.775213 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:20.775190    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:21.003428 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:21.003400    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:13:21.003876 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:21.003848    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2" event={"ID":"1d12912d-1418-477a-ba02-3c04124de36b","Type":"ContainerStarted","Data":"f43fbb018cd58d713d4b9e74afafa50da37ee7fdb463679be710e0c1d8eb0e11"}
Jul 22 15:13:21.004025 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:21.003962    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2" event={"ID":"1d12912d-1418-477a-ba02-3c04124de36b","Type":"ContainerStarted","Data":"d3e1747537e25b0350d857dcd637e259b1b44d279c3acf8a90e19603b228ca76"}
Jul 22 15:13:21.775181 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:21.775001    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:21.775354 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:21.775259    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:22.008261 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:22.008222    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz" event={"ID":"3c1862b2-ea48-4d50-9dc7-dff06cefffd4","Type":"ContainerStarted","Data":"1bca934ec1bbe9e977319aa2c14142ce66f225801ba82f780ed076c770b5eccb"}
Jul 22 15:13:22.025394 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:22.025284    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nkbz" podStartSLOduration=4.950829697 podStartE2EDuration="26.025266517s" totalImagesPullingTime="21.07443682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:22.024508804 +0000 UTC m=+25.687658226" watchObservedRunningTime="2026-07-22 15:13:22.025266517 +0000 UTC m=+25.688415937"
Jul 22 15:13:22.775327 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:22.775295    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:22.775534 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:22.775434    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:22.775534 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:22.775487    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:22.776049 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:22.775629    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:23.774905 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:23.774871    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:23.775057 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:23.774979    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:24.014169 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:24.014135    2580 generic.go:356] "Generic (PLEG): container finished" podID="a83b72f6-296e-4568-8e74-afa5fe7ee139" containerID="5af30e0e2ecddff350cfdb1069831cb131b8191aeb40610391cc010a9db52de4" exitCode=0
Jul 22 15:13:24.014760 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:24.014222    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2wrr" event={"ID":"a83b72f6-296e-4568-8e74-afa5fe7ee139","Type":"ContainerDied","Data":"5af30e0e2ecddff350cfdb1069831cb131b8191aeb40610391cc010a9db52de4"}
Jul 22 15:13:24.017290 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:24.017269    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:13:24.017632 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:24.017613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2" event={"ID":"1d12912d-1418-477a-ba02-3c04124de36b","Type":"ContainerStarted","Data":"76be4dfb15f5252b9b662cbe047d145ddceef855c7a72ccff0cff88b252da92e"}
Jul 22 15:13:24.775218 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:24.775189    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:24.775218 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:24.775205    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:24.775436 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:24.775323    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:24.775436 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:24.775395    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:25.775497 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:25.775276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:25.775880 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:25.775531    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:26.024114 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:26.024081    2580 generic.go:356] "Generic (PLEG): container finished" podID="a83b72f6-296e-4568-8e74-afa5fe7ee139" containerID="605d9f7e0316f79d34741ea557739d105aaf10eba1f78913dfba473de63b17bb" exitCode=0
Jul 22 15:13:26.024292 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:26.024175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2wrr" event={"ID":"a83b72f6-296e-4568-8e74-afa5fe7ee139","Type":"ContainerDied","Data":"605d9f7e0316f79d34741ea557739d105aaf10eba1f78913dfba473de63b17bb"}
Jul 22 15:13:26.027787 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:26.027771    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:13:26.028118 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:26.028098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2" event={"ID":"1d12912d-1418-477a-ba02-3c04124de36b","Type":"ContainerStarted","Data":"cabd6c2db714646e2ca89f2faa1f3e398db4a02421a32ac44c9b1504b2d35359"}
Jul 22 15:13:26.028311 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:26.028296    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:13:26.028368 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:26.028360    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:13:26.028518 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:26.028506    2580 scope.go:117] "RemoveContainer" containerID="db8e564b41248807eaa41a3a0fd9cb709729226dbc4ce9a2962a857c728c8cbb"
Jul 22 15:13:26.045303 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:26.045275    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:13:26.777221 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:26.776339    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:26.777221 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:26.776476    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:26.777221 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:26.776869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:26.777221 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:26.776983    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:27.034493 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:27.034416    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:13:27.034809 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:27.034786    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2" event={"ID":"1d12912d-1418-477a-ba02-3c04124de36b","Type":"ContainerStarted","Data":"b05bec4394438e4a32047c56da5177529460bd7bb5ae1b9e6b1e86ae123df76e"}
Jul 22 15:13:27.035129 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:27.035103    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:13:27.049563 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:27.049534    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:13:27.063998 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:27.063340    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2" podStartSLOduration=11.352576023 podStartE2EDuration="31.063321543s" totalImagesPullingTime="19.71074552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:27.06242744 +0000 UTC m=+30.725576867" watchObservedRunningTime="2026-07-22 15:13:27.063321543 +0000 UTC m=+30.726470964"
Jul 22 15:13:27.775257 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:27.775073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:27.775380 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:27.775327    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:27.822365 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:27.822327    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jcnvm"]
Jul 22 15:13:27.822829 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:27.822484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:27.822829 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:27.822601    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:27.825870 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:27.825843    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87jvc"]
Jul 22 15:13:27.826575 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:27.826552    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c6jqt"]
Jul 22 15:13:27.826686 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:27.826668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:27.826807 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:27.826761    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:28.038872 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:28.038839    2580 generic.go:356] "Generic (PLEG): container finished" podID="a83b72f6-296e-4568-8e74-afa5fe7ee139" containerID="3ca0124d11e27a5ecf77328a203be855faa4c5470398684bef99022099c925ce" exitCode=0
Jul 22 15:13:28.039049 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:28.038900    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:28.039049 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:28.038942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2wrr" event={"ID":"a83b72f6-296e-4568-8e74-afa5fe7ee139","Type":"ContainerDied","Data":"3ca0124d11e27a5ecf77328a203be855faa4c5470398684bef99022099c925ce"}
Jul 22 15:13:28.039049 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:28.038996    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:29.775083 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:29.775046    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:29.775083 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:29.775073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:29.775728 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:29.775071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:29.775728 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:29.775188    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6jqt" podUID="45498614-15bc-4688-95a2-2065211c0c5c"
Jul 22 15:13:29.775728 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:29.775337    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcnvm" podUID="a41a8d0a-1214-44b7-9032-97d7eb4905c9"
Jul 22 15:13:29.775728 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:29.775423    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-87jvc" podUID="c218b219-ef71-4b65-90c4-16d592c6c6f6"
Jul 22 15:13:30.430053 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:30.430019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:30.430225 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:30.430153    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:13:30.430225 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:30.430225    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs podName:45498614-15bc-4688-95a2-2065211c0c5c nodeName:}" failed. No retries permitted until 2026-07-22 15:14:02.430205314 +0000 UTC m=+66.093354716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs") pod "network-metrics-daemon-c6jqt" (UID: "45498614-15bc-4688-95a2-2065211c0c5c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 15:13:30.531156 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:30.531127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktnv6\" (UniqueName: \"kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6\") pod \"network-check-target-87jvc\" (UID: \"c218b219-ef71-4b65-90c4-16d592c6c6f6\") " pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:30.531304 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:30.531167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:30.531304 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:30.531282    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 15:13:30.531366 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:30.531315    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 15:13:30.531366 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:30.531338    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret podName:a41a8d0a-1214-44b7-9032-97d7eb4905c9 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:02.531320782 +0000 UTC m=+66.194470188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret") pod "global-pull-secret-syncer-jcnvm" (UID: "a41a8d0a-1214-44b7-9032-97d7eb4905c9") : object "kube-system"/"original-pull-secret" not registered
Jul 22 15:13:30.531366 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:30.531341    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 15:13:30.531366 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:30.531356    2580 projected.go:196] Error preparing data for projected volume kube-api-access-ktnv6 for pod openshift-network-diagnostics/network-check-target-87jvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:13:30.531503 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:30.531408    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6 podName:c218b219-ef71-4b65-90c4-16d592c6c6f6 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:02.531389457 +0000 UTC m=+66.194538877 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ktnv6" (UniqueName: "kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6") pod "network-check-target-87jvc" (UID: "c218b219-ef71-4b65-90c4-16d592c6c6f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 15:13:31.681417 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.681385    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-167.ec2.internal" event="NodeReady"
Jul 22 15:13:31.681963 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.681555    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 15:13:31.737704 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.737563    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g8268"]
Jul 22 15:13:31.759335 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.759304    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s62lx"]
Jul 22 15:13:31.759490 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.759428    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:31.762131 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.762108    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 15:13:31.762264 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.762107    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 15:13:31.762491 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.762474    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j8ghg\""
Jul 22 15:13:31.771379 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.771358    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g8268"]
Jul 22 15:13:31.771494 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.771398    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s62lx"]
Jul 22 15:13:31.771494 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.771479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s62lx"
Jul 22 15:13:31.774694 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.774624    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:13:31.774694 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.774645    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:13:31.774852 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.774754    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:13:31.774852 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.774768    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 15:13:31.775949 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.775902    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 15:13:31.779606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.776540    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 15:13:31.779606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.777114    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zx2fs\""
Jul 22 15:13:31.779606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.778234    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 15:13:31.779812 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.779697    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 15:13:31.779861 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.779808    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-97vtz\""
Jul 22 15:13:31.780222 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.780084    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 15:13:31.780222 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.780094    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-glqml\""
Jul 22 15:13:31.781070 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.781052    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 15:13:31.944113 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.944021    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2392c191-3855-4341-ae6f-419a932d2858-tmp-dir\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:31.944113 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.944076    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxd47\" (UniqueName: \"kubernetes.io/projected/2392c191-3855-4341-ae6f-419a932d2858-kube-api-access-cxd47\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:31.944362 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.944141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj6fh\" (UniqueName: \"kubernetes.io/projected/791de7a1-68b3-407a-a121-e9bdabd68202-kube-api-access-wj6fh\") pod \"ingress-canary-s62lx\" (UID: \"791de7a1-68b3-407a-a121-e9bdabd68202\") " pod="openshift-ingress-canary/ingress-canary-s62lx"
Jul 22 15:13:31.944362 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.944194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/791de7a1-68b3-407a-a121-e9bdabd68202-cert\") pod \"ingress-canary-s62lx\" (UID: \"791de7a1-68b3-407a-a121-e9bdabd68202\") " pod="openshift-ingress-canary/ingress-canary-s62lx"
Jul 22 15:13:31.944362 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.944223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2392c191-3855-4341-ae6f-419a932d2858-config-volume\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:31.944362 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:31.944244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:32.045370 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.045340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2392c191-3855-4341-ae6f-419a932d2858-tmp-dir\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:32.045370 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.045373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxd47\" (UniqueName: \"kubernetes.io/projected/2392c191-3855-4341-ae6f-419a932d2858-kube-api-access-cxd47\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:32.045581 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.045436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj6fh\" (UniqueName: \"kubernetes.io/projected/791de7a1-68b3-407a-a121-e9bdabd68202-kube-api-access-wj6fh\") pod \"ingress-canary-s62lx\" (UID: \"791de7a1-68b3-407a-a121-e9bdabd68202\") " pod="openshift-ingress-canary/ingress-canary-s62lx"
Jul 22 15:13:32.045581 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.045472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/791de7a1-68b3-407a-a121-e9bdabd68202-cert\") pod \"ingress-canary-s62lx\" (UID: \"791de7a1-68b3-407a-a121-e9bdabd68202\") " pod="openshift-ingress-canary/ingress-canary-s62lx"
Jul 22 15:13:32.045581 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.045493    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2392c191-3855-4341-ae6f-419a932d2858-config-volume\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:32.045581 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.045507    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:32.045784 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:32.045614    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 15:13:32.045784 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:32.045681    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls podName:2392c191-3855-4341-ae6f-419a932d2858 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:32.545662913 +0000 UTC m=+36.208812314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls") pod "dns-default-g8268" (UID: "2392c191-3855-4341-ae6f-419a932d2858") : secret "dns-default-metrics-tls" not found
Jul 22 15:13:32.045784 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.045687    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2392c191-3855-4341-ae6f-419a932d2858-tmp-dir\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:32.046093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.046072    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2392c191-3855-4341-ae6f-419a932d2858-config-volume\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:32.049893 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.049870    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/791de7a1-68b3-407a-a121-e9bdabd68202-cert\") pod \"ingress-canary-s62lx\" (UID: \"791de7a1-68b3-407a-a121-e9bdabd68202\") " pod="openshift-ingress-canary/ingress-canary-s62lx"
Jul 22 15:13:32.053822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.053798    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxd47\" (UniqueName: \"kubernetes.io/projected/2392c191-3855-4341-ae6f-419a932d2858-kube-api-access-cxd47\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:32.054417 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.054395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj6fh\" (UniqueName: \"kubernetes.io/projected/791de7a1-68b3-407a-a121-e9bdabd68202-kube-api-access-wj6fh\") pod \"ingress-canary-s62lx\" (UID: \"791de7a1-68b3-407a-a121-e9bdabd68202\") " pod="openshift-ingress-canary/ingress-canary-s62lx"
Jul 22 15:13:32.086161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.086142    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s62lx"
Jul 22 15:13:32.262988 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.262789    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s62lx"]
Jul 22 15:13:32.325719 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:13:32.325680    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791de7a1_68b3_407a_a121_e9bdabd68202.slice/crio-7e4073caedd544bb89350bbb284ad97794645b58ad5b85bfe877372583e0ec4c WatchSource:0}: Error finding container 7e4073caedd544bb89350bbb284ad97794645b58ad5b85bfe877372583e0ec4c: Status 404 returned error can't find the container with id 7e4073caedd544bb89350bbb284ad97794645b58ad5b85bfe877372583e0ec4c
Jul 22 15:13:32.549364 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:32.549336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:32.549501 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:32.549482    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 15:13:32.549569 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:32.549559    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls podName:2392c191-3855-4341-ae6f-419a932d2858 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:33.549542349 +0000 UTC m=+37.212691751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls") pod "dns-default-g8268" (UID: "2392c191-3855-4341-ae6f-419a932d2858") : secret "dns-default-metrics-tls" not found
Jul 22 15:13:33.054860 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:33.054824    2580 generic.go:356] "Generic (PLEG): container finished" podID="a83b72f6-296e-4568-8e74-afa5fe7ee139" containerID="bb3066b627a89d8a7449771426e3eabe2f70051895518c9a05470d542d22767f" exitCode=0
Jul 22 15:13:33.055394 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:33.054899    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2wrr" event={"ID":"a83b72f6-296e-4568-8e74-afa5fe7ee139","Type":"ContainerDied","Data":"bb3066b627a89d8a7449771426e3eabe2f70051895518c9a05470d542d22767f"}
Jul 22 15:13:33.056310 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:33.056284    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s62lx" event={"ID":"791de7a1-68b3-407a-a121-e9bdabd68202","Type":"ContainerStarted","Data":"7e4073caedd544bb89350bbb284ad97794645b58ad5b85bfe877372583e0ec4c"}
Jul 22 15:13:33.557152 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:33.557117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:33.557327 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:33.557277    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 15:13:33.557386 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:33.557360    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls podName:2392c191-3855-4341-ae6f-419a932d2858 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:35.557340589 +0000 UTC m=+39.220489990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls") pod "dns-default-g8268" (UID: "2392c191-3855-4341-ae6f-419a932d2858") : secret "dns-default-metrics-tls" not found
Jul 22 15:13:34.062434 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.062396    2580 generic.go:356] "Generic (PLEG): container finished" podID="a83b72f6-296e-4568-8e74-afa5fe7ee139" containerID="d7b34b50fdddb305904a07003c27aa890e5b321d9a9197df698f654e337e4985" exitCode=0
Jul 22 15:13:34.062866 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.062448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2wrr" event={"ID":"a83b72f6-296e-4568-8e74-afa5fe7ee139","Type":"ContainerDied","Data":"d7b34b50fdddb305904a07003c27aa890e5b321d9a9197df698f654e337e4985"}
Jul 22 15:13:34.092831 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.092804    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9"]
Jul 22 15:13:34.096370 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.096348    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9"
Jul 22 15:13:34.100700 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.099931    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 22 15:13:34.100700 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.099959    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 22 15:13:34.100700 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.100321    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jws9j\""
Jul 22 15:13:34.107888 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.107863    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9"]
Jul 22 15:13:34.261854 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.261819    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsrjs\" (UniqueName: \"kubernetes.io/projected/1fabc61c-9239-4881-ac75-87cba270c5ab-kube-api-access-dsrjs\") pod \"migrator-7cc9c7ffd7-94vb9\" (UID: \"1fabc61c-9239-4881-ac75-87cba270c5ab\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9"
Jul 22 15:13:34.363079 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.362991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsrjs\" (UniqueName: \"kubernetes.io/projected/1fabc61c-9239-4881-ac75-87cba270c5ab-kube-api-access-dsrjs\") pod \"migrator-7cc9c7ffd7-94vb9\" (UID: \"1fabc61c-9239-4881-ac75-87cba270c5ab\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9"
Jul 22 15:13:34.373076 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.373047    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsrjs\" (UniqueName: \"kubernetes.io/projected/1fabc61c-9239-4881-ac75-87cba270c5ab-kube-api-access-dsrjs\") pod \"migrator-7cc9c7ffd7-94vb9\" (UID: \"1fabc61c-9239-4881-ac75-87cba270c5ab\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9"
Jul 22 15:13:34.409773 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.409740    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9"
Jul 22 15:13:34.638181 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:34.638013    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9"]
Jul 22 15:13:34.643085 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:13:34.643058    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fabc61c_9239_4881_ac75_87cba270c5ab.slice/crio-a868754dc137fba1dff95d0918f73f33e4dad4e0cb17a6b0f27fbd0e0a89ba6e WatchSource:0}: Error finding container a868754dc137fba1dff95d0918f73f33e4dad4e0cb17a6b0f27fbd0e0a89ba6e: Status 404 returned error can't find the container with id a868754dc137fba1dff95d0918f73f33e4dad4e0cb17a6b0f27fbd0e0a89ba6e
Jul 22 15:13:35.066548 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.066516    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s62lx" event={"ID":"791de7a1-68b3-407a-a121-e9bdabd68202","Type":"ContainerStarted","Data":"bfa17b24e6861ded9977e8f6edfcbc3ef566949f30f169ad7a0e4c9c2270f581"}
Jul 22 15:13:35.067693 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.067659    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9" event={"ID":"1fabc61c-9239-4881-ac75-87cba270c5ab","Type":"ContainerStarted","Data":"a868754dc137fba1dff95d0918f73f33e4dad4e0cb17a6b0f27fbd0e0a89ba6e"}
Jul 22 15:13:35.070728 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.070706    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v2wrr" event={"ID":"a83b72f6-296e-4568-8e74-afa5fe7ee139","Type":"ContainerStarted","Data":"49e11a04481a1209e9365ddeb1300851382a048cce7e2d6d3ee44c72466ec9b5"}
Jul 22 15:13:35.084856 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.084814    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s62lx" podStartSLOduration=1.8530502800000002 podStartE2EDuration="4.084801161s" totalImagesPullingTime="2.231750881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:35.083767222 +0000 UTC m=+38.746916640" watchObservedRunningTime="2026-07-22 15:13:35.084801161 +0000 UTC m=+38.747950582"
Jul 22 15:13:35.105755 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.105717    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v2wrr" podStartSLOduration=9.219071755 podStartE2EDuration="39.105703999s" totalImagesPullingTime="29.886632244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:35.105322123 +0000 UTC m=+38.768471545" watchObservedRunningTime="2026-07-22 15:13:35.105703999 +0000 UTC m=+38.768853418"
Jul 22 15:13:35.570090 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.570056    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:35.570259 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:35.570197    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 15:13:35.570302 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:35.570259    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls podName:2392c191-3855-4341-ae6f-419a932d2858 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:39.570244715 +0000 UTC m=+43.233394114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls") pod "dns-default-g8268" (UID: "2392c191-3855-4341-ae6f-419a932d2858") : secret "dns-default-metrics-tls" not found
Jul 22 15:13:35.870054 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.869973    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-z764v"]
Jul 22 15:13:35.872925 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.872899    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-z764v"
Jul 22 15:13:35.875949 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.875930    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 22 15:13:35.877066 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.877041    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 22 15:13:35.877162 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.877093    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 22 15:13:35.877162 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.877099    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rxh6k\""
Jul 22 15:13:35.877162 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.877147    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 22 15:13:35.882867 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.882849    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-z764v"]
Jul 22 15:13:35.973106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.973073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8e8e6660-ce33-4057-b295-89953024b819-signing-key\") pod \"service-ca-58598695f7-z764v\" (UID: \"8e8e6660-ce33-4057-b295-89953024b819\") " pod="openshift-service-ca/service-ca-58598695f7-z764v"
Jul 22 15:13:35.973292 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.973132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4qp4\" (UniqueName: \"kubernetes.io/projected/8e8e6660-ce33-4057-b295-89953024b819-kube-api-access-p4qp4\") pod \"service-ca-58598695f7-z764v\" (UID: \"8e8e6660-ce33-4057-b295-89953024b819\") " pod="openshift-service-ca/service-ca-58598695f7-z764v"
Jul 22 15:13:35.973292 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:35.973213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8e8e6660-ce33-4057-b295-89953024b819-signing-cabundle\") pod \"service-ca-58598695f7-z764v\" (UID: \"8e8e6660-ce33-4057-b295-89953024b819\") " pod="openshift-service-ca/service-ca-58598695f7-z764v"
Jul 22 15:13:36.073997 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:36.073967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8e8e6660-ce33-4057-b295-89953024b819-signing-key\") pod \"service-ca-58598695f7-z764v\" (UID: \"8e8e6660-ce33-4057-b295-89953024b819\") " pod="openshift-service-ca/service-ca-58598695f7-z764v"
Jul 22 15:13:36.074568 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:36.074021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4qp4\" (UniqueName: \"kubernetes.io/projected/8e8e6660-ce33-4057-b295-89953024b819-kube-api-access-p4qp4\") pod \"service-ca-58598695f7-z764v\" (UID: \"8e8e6660-ce33-4057-b295-89953024b819\") " pod="openshift-service-ca/service-ca-58598695f7-z764v"
Jul 22 15:13:36.074568 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:36.074091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8e8e6660-ce33-4057-b295-89953024b819-signing-cabundle\") pod \"service-ca-58598695f7-z764v\" (UID: \"8e8e6660-ce33-4057-b295-89953024b819\") " pod="openshift-service-ca/service-ca-58598695f7-z764v"
Jul 22 15:13:36.074851 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:36.074831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8e8e6660-ce33-4057-b295-89953024b819-signing-cabundle\") pod \"service-ca-58598695f7-z764v\" (UID: \"8e8e6660-ce33-4057-b295-89953024b819\") " pod="openshift-service-ca/service-ca-58598695f7-z764v"
Jul 22 15:13:36.077721 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:36.077699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8e8e6660-ce33-4057-b295-89953024b819-signing-key\") pod \"service-ca-58598695f7-z764v\" (UID: \"8e8e6660-ce33-4057-b295-89953024b819\") " pod="openshift-service-ca/service-ca-58598695f7-z764v"
Jul 22 15:13:36.083284 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:36.083266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4qp4\" (UniqueName: \"kubernetes.io/projected/8e8e6660-ce33-4057-b295-89953024b819-kube-api-access-p4qp4\") pod \"service-ca-58598695f7-z764v\" (UID: \"8e8e6660-ce33-4057-b295-89953024b819\") " pod="openshift-service-ca/service-ca-58598695f7-z764v"
Jul 22 15:13:36.182462 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:36.182402    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-z764v"
Jul 22 15:13:36.313780 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:36.313753    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-z764v"]
Jul 22 15:13:36.317013 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:13:36.316990    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e8e6660_ce33_4057_b295_89953024b819.slice/crio-c7a9a35b33347433d328c85e9fb0e66c4d49000b91281a228ee7983cf397c86b WatchSource:0}: Error finding container c7a9a35b33347433d328c85e9fb0e66c4d49000b91281a228ee7983cf397c86b: Status 404 returned error can't find the container with id c7a9a35b33347433d328c85e9fb0e66c4d49000b91281a228ee7983cf397c86b
Jul 22 15:13:37.078606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:37.078529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9" event={"ID":"1fabc61c-9239-4881-ac75-87cba270c5ab","Type":"ContainerStarted","Data":"c01bc676190bf073866b1a5d7d004965d9e0fcf7f6c279992f4d22d92a58d1b5"}
Jul 22 15:13:37.078606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:37.078598    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9" event={"ID":"1fabc61c-9239-4881-ac75-87cba270c5ab","Type":"ContainerStarted","Data":"1f13231853916b0e7ae1506d167b765bd174106789aa543a6aee70286f149ae7"}
Jul 22 15:13:37.079685 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:37.079661    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-z764v" event={"ID":"8e8e6660-ce33-4057-b295-89953024b819","Type":"ContainerStarted","Data":"c7a9a35b33347433d328c85e9fb0e66c4d49000b91281a228ee7983cf397c86b"}
Jul 22 15:13:39.085489 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:39.085452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-z764v" event={"ID":"8e8e6660-ce33-4057-b295-89953024b819","Type":"ContainerStarted","Data":"78b52508f721f9c9e7573d8ab1879a5070d07e5bfbafbbfa92ac09739602c735"}
Jul 22 15:13:39.102837 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:39.102789    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-z764v" podStartSLOduration=2.309406675 podStartE2EDuration="4.102775472s" totalImagesPullingTime="1.793368797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:39.102517378 +0000 UTC m=+42.765666800" watchObservedRunningTime="2026-07-22 15:13:39.102775472 +0000 UTC m=+42.765924892"
Jul 22 15:13:39.103038 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:39.102982    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-94vb9" podStartSLOduration=3.563504493 podStartE2EDuration="5.10297246s" totalImagesPullingTime="1.539467967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:37.099836878 +0000 UTC m=+40.762986300" watchObservedRunningTime="2026-07-22 15:13:39.10297246 +0000 UTC m=+42.766121883"
Jul 22 15:13:39.593773 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:39.593730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:39.593967 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:39.593909    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 15:13:39.594025 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:39.594000    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls podName:2392c191-3855-4341-ae6f-419a932d2858 nodeName:}" failed. No retries permitted until 2026-07-22 15:13:47.593979247 +0000 UTC m=+51.257128654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls") pod "dns-default-g8268" (UID: "2392c191-3855-4341-ae6f-419a932d2858") : secret "dns-default-metrics-tls" not found
Jul 22 15:13:47.653316 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:47.653128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:47.657054 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:47.657029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2392c191-3855-4341-ae6f-419a932d2858-metrics-tls\") pod \"dns-default-g8268\" (UID: \"2392c191-3855-4341-ae6f-419a932d2858\") " pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:47.669889 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:47.669863    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:47.804625 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:47.804596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g8268"]
Jul 22 15:13:47.808783 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:13:47.808751    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2392c191_3855_4341_ae6f_419a932d2858.slice/crio-d6709339412980e297b9b27d6955f94c625792fd9c9d4884d527b35dae5c69a6 WatchSource:0}: Error finding container d6709339412980e297b9b27d6955f94c625792fd9c9d4884d527b35dae5c69a6: Status 404 returned error can't find the container with id d6709339412980e297b9b27d6955f94c625792fd9c9d4884d527b35dae5c69a6
Jul 22 15:13:48.108534 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:48.108493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g8268" event={"ID":"2392c191-3855-4341-ae6f-419a932d2858","Type":"ContainerStarted","Data":"d6709339412980e297b9b27d6955f94c625792fd9c9d4884d527b35dae5c69a6"}
Jul 22 15:13:51.119350 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:51.119163    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g8268" event={"ID":"2392c191-3855-4341-ae6f-419a932d2858","Type":"ContainerStarted","Data":"b5e18bf9bac0abde196114855b773ec9007af5b8da4c562978bb92729e8e5c2e"}
Jul 22 15:13:51.120021 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:51.119369    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g8268" event={"ID":"2392c191-3855-4341-ae6f-419a932d2858","Type":"ContainerStarted","Data":"b0c4f76c5645e848f895fa665be9dc3bf5d68301f8a60d790ca4508c79963496"}
Jul 22 15:13:51.120021 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:51.119390    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g8268"
Jul 22 15:13:56.304674 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.304605    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g8268" podStartSLOduration=22.771932918 podStartE2EDuration="25.304585836s" totalImagesPullingTime="2.532652918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:51.136843337 +0000 UTC m=+54.799992759" watchObservedRunningTime="2026-07-22 15:13:56.304585836 +0000 UTC m=+59.967735259"
Jul 22 15:13:56.305455 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.305437    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qhfnq"]
Jul 22 15:13:56.307829 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.307815    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qhfnq"
Jul 22 15:13:56.311328 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.311302    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mfqss\""
Jul 22 15:13:56.311472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.311412    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 22 15:13:56.311640 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.311588    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"]
Jul 22 15:13:56.311720 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.311651    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 22 15:13:56.313578 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.313560    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-sd5px"]
Jul 22 15:13:56.313718 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.313697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:13:56.315439 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.315422    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.316277 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.316262    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 15:13:56.317035 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.316563    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 15:13:56.317035 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.316855    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 15:13:56.320622 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.320605    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 22 15:13:56.320970 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.320956    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 22 15:13:56.321532 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.321514    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 22 15:13:56.323156 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.323138    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-splsn\""
Jul 22 15:13:56.324892 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.324872    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 22 15:13:56.326276 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.326254    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 22 15:13:56.328910 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.328756    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 22 15:13:56.330954 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.330934    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"]
Jul 22 15:13:56.333699 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.333679    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c6fc77bb5-q9gdk"]
Jul 22 15:13:56.335734 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.335720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.338595 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.338578    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 15:13:56.338812 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.338794    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 15:13:56.339081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.339068    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 15:13:56.339343 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.339331    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jjvqb\""
Jul 22 15:13:56.346658 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.346640    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 15:13:56.355293 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.354062    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qhfnq"]
Jul 22 15:13:56.355293 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.354145    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-sd5px"]
Jul 22 15:13:56.367085 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.367062    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"]
Jul 22 15:13:56.369160 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.369145    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.373013 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.372992    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 15:13:56.374331 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.374141    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 15:13:56.375249 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.375229    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 15:13:56.375249 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.375243    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 15:13:56.375807 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.375788    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c6fc77bb5-q9gdk"]
Jul 22 15:13:56.391390 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.391368    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"]
Jul 22 15:13:56.413103 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-hub\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.413236 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-image-registry-private-configuration\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.413236 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4v8m\" (UniqueName: \"kubernetes.io/projected/2cbf222f-af68-4c51-a633-3ccf181e8e9c-kube-api-access-n4v8m\") pod \"klusterlet-addon-workmgr-78c7d4f687-v5nff\" (UID: \"2cbf222f-af68-4c51-a633-3ccf181e8e9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:13:56.413236 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-trusted-ca\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.413236 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cbf222f-af68-4c51-a633-3ccf181e8e9c-tmp\") pod \"klusterlet-addon-workmgr-78c7d4f687-v5nff\" (UID: \"2cbf222f-af68-4c51-a633-3ccf181e8e9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:13:56.413236 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwst\" (UniqueName: \"kubernetes.io/projected/12be4ae9-0c50-4133-90eb-fab987f6e69f-kube-api-access-lgwst\") pod \"volume-data-source-validator-78cf4c6f6-qhfnq\" (UID: \"12be4ae9-0c50-4133-90eb-fab987f6e69f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qhfnq"
Jul 22 15:13:56.413236 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-tls\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.413472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d6aacb-9530-4c55-9708-8444f961db83-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.413472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413294    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11089543-48bb-49e3-aa7d-868e981fcf95-trusted-ca\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.413472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-ca-trust-extracted\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.413472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-ca\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.413472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2cbf222f-af68-4c51-a633-3ccf181e8e9c-klusterlet-config\") pod \"klusterlet-addon-workmgr-78c7d4f687-v5nff\" (UID: \"2cbf222f-af68-4c51-a633-3ccf181e8e9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:13:56.413472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413385    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbg5b\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-kube-api-access-gbg5b\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.413472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svjwg\" (UniqueName: \"kubernetes.io/projected/11089543-48bb-49e3-aa7d-868e981fcf95-kube-api-access-svjwg\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.413472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11089543-48bb-49e3-aa7d-868e981fcf95-config\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.413472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrcwq\" (UniqueName: \"kubernetes.io/projected/76d6aacb-9530-4c55-9708-8444f961db83-kube-api-access-qrcwq\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.413741 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.413741 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.413741 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11089543-48bb-49e3-aa7d-868e981fcf95-serving-cert\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.413741 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-installation-pull-secrets\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.413741 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-bound-sa-token\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.413741 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.413701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-certificates\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.496926 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.496881    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c6fc77bb5-q9gdk"]
Jul 22 15:13:56.497137 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:13:56.497111    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-gbg5b registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk" podUID="fa47814f-f1b4-4f1a-9ff5-7884f8f05715"
Jul 22 15:13:56.514254 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-hub\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.514334 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-image-registry-private-configuration\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.514334 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4v8m\" (UniqueName: \"kubernetes.io/projected/2cbf222f-af68-4c51-a633-3ccf181e8e9c-kube-api-access-n4v8m\") pod \"klusterlet-addon-workmgr-78c7d4f687-v5nff\" (UID: \"2cbf222f-af68-4c51-a633-3ccf181e8e9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:13:56.514334 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-trusted-ca\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.514334 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cbf222f-af68-4c51-a633-3ccf181e8e9c-tmp\") pod \"klusterlet-addon-workmgr-78c7d4f687-v5nff\" (UID: \"2cbf222f-af68-4c51-a633-3ccf181e8e9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:13:56.514334 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514324    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwst\" (UniqueName: \"kubernetes.io/projected/12be4ae9-0c50-4133-90eb-fab987f6e69f-kube-api-access-lgwst\") pod \"volume-data-source-validator-78cf4c6f6-qhfnq\" (UID: \"12be4ae9-0c50-4133-90eb-fab987f6e69f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qhfnq"
Jul 22 15:13:56.514577 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-tls\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.514577 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d6aacb-9530-4c55-9708-8444f961db83-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.514577 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11089543-48bb-49e3-aa7d-868e981fcf95-trusted-ca\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.514711 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-ca-trust-extracted\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.514711 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-ca\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.514711 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2cbf222f-af68-4c51-a633-3ccf181e8e9c-klusterlet-config\") pod \"klusterlet-addon-workmgr-78c7d4f687-v5nff\" (UID: \"2cbf222f-af68-4c51-a633-3ccf181e8e9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:13:56.514852 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514733    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbg5b\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-kube-api-access-gbg5b\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.514852 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svjwg\" (UniqueName: \"kubernetes.io/projected/11089543-48bb-49e3-aa7d-868e981fcf95-kube-api-access-svjwg\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.514852 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11089543-48bb-49e3-aa7d-868e981fcf95-config\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.514852 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514827    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrcwq\" (UniqueName: \"kubernetes.io/projected/76d6aacb-9530-4c55-9708-8444f961db83-kube-api-access-qrcwq\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.515089 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.515089 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514937    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.515089 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11089543-48bb-49e3-aa7d-868e981fcf95-serving-cert\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.515089 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.514997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-installation-pull-secrets\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.515089 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.515021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-bound-sa-token\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.515089 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.515070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-certificates\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.515344 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.515117    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-ca-trust-extracted\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.515447 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.515421    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cbf222f-af68-4c51-a633-3ccf181e8e9c-tmp\") pod \"klusterlet-addon-workmgr-78c7d4f687-v5nff\" (UID: \"2cbf222f-af68-4c51-a633-3ccf181e8e9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:13:56.515731 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.515700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11089543-48bb-49e3-aa7d-868e981fcf95-trusted-ca\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.515844 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.515821    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-certificates\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.515948 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.515872    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-trusted-ca\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.516519 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.516494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11089543-48bb-49e3-aa7d-868e981fcf95-config\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.517076 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.517054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/76d6aacb-9530-4c55-9708-8444f961db83-additional-service-ca\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.519062 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.519021    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-installation-pull-secrets\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.519062 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.519030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-tls\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.519184 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.519129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-ca\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.519184 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.519137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-image-registry-private-configuration\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.519275 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.519212    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.519275 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.519249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11089543-48bb-49e3-aa7d-868e981fcf95-serving-cert\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.519844 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.519824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.519897 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.519876    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/76d6aacb-9530-4c55-9708-8444f961db83-hub\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.520441 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.520423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2cbf222f-af68-4c51-a633-3ccf181e8e9c-klusterlet-config\") pod \"klusterlet-addon-workmgr-78c7d4f687-v5nff\" (UID: \"2cbf222f-af68-4c51-a633-3ccf181e8e9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:13:56.550911 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.550886    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbg5b\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-kube-api-access-gbg5b\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.552437 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.552417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwst\" (UniqueName: \"kubernetes.io/projected/12be4ae9-0c50-4133-90eb-fab987f6e69f-kube-api-access-lgwst\") pod \"volume-data-source-validator-78cf4c6f6-qhfnq\" (UID: \"12be4ae9-0c50-4133-90eb-fab987f6e69f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qhfnq"
Jul 22 15:13:56.552626 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.552609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-bound-sa-token\") pod \"image-registry-c6fc77bb5-q9gdk\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") " pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:56.563080 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.563030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4v8m\" (UniqueName: \"kubernetes.io/projected/2cbf222f-af68-4c51-a633-3ccf181e8e9c-kube-api-access-n4v8m\") pod \"klusterlet-addon-workmgr-78c7d4f687-v5nff\" (UID: \"2cbf222f-af68-4c51-a633-3ccf181e8e9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:13:56.563162 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.563116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrcwq\" (UniqueName: \"kubernetes.io/projected/76d6aacb-9530-4c55-9708-8444f961db83-kube-api-access-qrcwq\") pod \"cluster-proxy-proxy-agent-79f97d475d-w74nb\" (UID: \"76d6aacb-9530-4c55-9708-8444f961db83\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.563162 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.563125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svjwg\" (UniqueName: \"kubernetes.io/projected/11089543-48bb-49e3-aa7d-868e981fcf95-kube-api-access-svjwg\") pod \"console-operator-565b7b569d-sd5px\" (UID: \"11089543-48bb-49e3-aa7d-868e981fcf95\") " pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.577450 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.577425    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bbd7754f9-8vjn4"]
Jul 22 15:13:56.580750 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.580735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.609775 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.609753    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bbd7754f9-8vjn4"]
Jul 22 15:13:56.616039 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.616018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-image-registry-private-configuration\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.616130 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.616048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-bound-sa-token\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.616130 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.616079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-registry-tls\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.616130 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.616124    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-trusted-ca\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.616270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.616154    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-ca-trust-extracted\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.616270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.616183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-installation-pull-secrets\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.616270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.616216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qftz\" (UniqueName: \"kubernetes.io/projected/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-kube-api-access-6qftz\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.616270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.616240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-registry-certificates\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.619970 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.619954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qhfnq"
Jul 22 15:13:56.628305 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.628289    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 15:13:56.636455 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.636441    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:13:56.637342 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.637321    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-splsn\""
Jul 22 15:13:56.642545 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.642520    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:13:56.686898 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.686763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"
Jul 22 15:13:56.718289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.718154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-image-registry-private-configuration\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.718289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.718210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-bound-sa-token\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.718289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.718261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-registry-tls\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.718289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.718288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-trusted-ca\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.718573 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.718319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-ca-trust-extracted\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.718573 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.718347    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-installation-pull-secrets\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.718573 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.718386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qftz\" (UniqueName: \"kubernetes.io/projected/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-kube-api-access-6qftz\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.718573 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.718419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-registry-certificates\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.719390 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.719364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-registry-certificates\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.719668 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.719643    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-trusted-ca\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.719760 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.719733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-ca-trust-extracted\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.722061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.722015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-image-registry-private-configuration\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.722331 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.722222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-registry-tls\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.722898 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.722856    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-installation-pull-secrets\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.729577 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.728690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-bound-sa-token\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.733981 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.731931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qftz\" (UniqueName: \"kubernetes.io/projected/ab538f0a-bd4a-4bf3-925d-d4cad90d82d2-kube-api-access-6qftz\") pod \"image-registry-5bbd7754f9-8vjn4\" (UID: \"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2\") " pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:56.785744 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.785657    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qhfnq"]
Jul 22 15:13:56.791117 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:13:56.791074    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12be4ae9_0c50_4133_90eb_fab987f6e69f.slice/crio-d01aa11c31cec94d53548f2675310fe3c7e4f17fb08b5719d1f095484094ce53 WatchSource:0}: Error finding container d01aa11c31cec94d53548f2675310fe3c7e4f17fb08b5719d1f095484094ce53: Status 404 returned error can't find the container with id d01aa11c31cec94d53548f2675310fe3c7e4f17fb08b5719d1f095484094ce53
Jul 22 15:13:56.807055 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.807022    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"]
Jul 22 15:13:56.811094 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:13:56.811066    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cbf222f_af68_4c51_a633_3ccf181e8e9c.slice/crio-12b358fadea5412c520f1d48c180c3b475a856e814a2326ee7e721f3fc5f9cfa WatchSource:0}: Error finding container 12b358fadea5412c520f1d48c180c3b475a856e814a2326ee7e721f3fc5f9cfa: Status 404 returned error can't find the container with id 12b358fadea5412c520f1d48c180c3b475a856e814a2326ee7e721f3fc5f9cfa
Jul 22 15:13:56.827005 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.826983    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-sd5px"]
Jul 22 15:13:56.829237 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:13:56.829213    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11089543_48bb_49e3_aa7d_868e981fcf95.slice/crio-9fe1d89b0fa3db0f3a383453c6b6db122bc99c962c1e05bcd6c572bced40174b WatchSource:0}: Error finding container 9fe1d89b0fa3db0f3a383453c6b6db122bc99c962c1e05bcd6c572bced40174b: Status 404 returned error can't find the container with id 9fe1d89b0fa3db0f3a383453c6b6db122bc99c962c1e05bcd6c572bced40174b
Jul 22 15:13:56.856841 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.856733    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb"]
Jul 22 15:13:56.859094 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:13:56.859069    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76d6aacb_9530_4c55_9708_8444f961db83.slice/crio-0c3b76128f8a9a355a4df164a877f2a5cfd3ea0206a34a1a07905f4d9ed80b26 WatchSource:0}: Error finding container 0c3b76128f8a9a355a4df164a877f2a5cfd3ea0206a34a1a07905f4d9ed80b26: Status 404 returned error can't find the container with id 0c3b76128f8a9a355a4df164a877f2a5cfd3ea0206a34a1a07905f4d9ed80b26
Jul 22 15:13:56.891858 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.891824    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jjvqb\""
Jul 22 15:13:56.899725 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:56.899698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:57.024316 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.024292    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bbd7754f9-8vjn4"]
Jul 22 15:13:57.026506 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:13:57.026476    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab538f0a_bd4a_4bf3_925d_d4cad90d82d2.slice/crio-cdf08228f259d641057aba270dc90780b27a994216236c6ecf6790797a3bfe9b WatchSource:0}: Error finding container cdf08228f259d641057aba270dc90780b27a994216236c6ecf6790797a3bfe9b: Status 404 returned error can't find the container with id cdf08228f259d641057aba270dc90780b27a994216236c6ecf6790797a3bfe9b
Jul 22 15:13:57.137433 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.137393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qhfnq" event={"ID":"12be4ae9-0c50-4133-90eb-fab987f6e69f","Type":"ContainerStarted","Data":"d01aa11c31cec94d53548f2675310fe3c7e4f17fb08b5719d1f095484094ce53"}
Jul 22 15:13:57.138947 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.138909    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4" event={"ID":"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2","Type":"ContainerStarted","Data":"579d33b04e4caa1aaeddd5e9e1cba0b83ff69d281ce1bd516b972245f516018e"}
Jul 22 15:13:57.139064 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.138965    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4" event={"ID":"ab538f0a-bd4a-4bf3-925d-d4cad90d82d2","Type":"ContainerStarted","Data":"cdf08228f259d641057aba270dc90780b27a994216236c6ecf6790797a3bfe9b"}
Jul 22 15:13:57.139064 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.139003    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:13:57.140103 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.140077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb" event={"ID":"76d6aacb-9530-4c55-9708-8444f961db83","Type":"ContainerStarted","Data":"0c3b76128f8a9a355a4df164a877f2a5cfd3ea0206a34a1a07905f4d9ed80b26"}
Jul 22 15:13:57.141159 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.141137    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-sd5px" event={"ID":"11089543-48bb-49e3-aa7d-868e981fcf95","Type":"ContainerStarted","Data":"9fe1d89b0fa3db0f3a383453c6b6db122bc99c962c1e05bcd6c572bced40174b"}
Jul 22 15:13:57.142333 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.142318    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:57.142431 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.142337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff" event={"ID":"2cbf222f-af68-4c51-a633-3ccf181e8e9c","Type":"ContainerStarted","Data":"12b358fadea5412c520f1d48c180c3b475a856e814a2326ee7e721f3fc5f9cfa"}
Jul 22 15:13:57.148285 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.148260    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:57.159581 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.159535    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4" podStartSLOduration=1.1595204 podStartE2EDuration="1.1595204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:57.158881386 +0000 UTC m=+60.822030819" watchObservedRunningTime="2026-07-22 15:13:57.1595204 +0000 UTC m=+60.822669819"
Jul 22 15:13:57.223740 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.223708    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-bound-sa-token\") pod \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") "
Jul 22 15:13:57.223740 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.223742    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-installation-pull-secrets\") pod \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") "
Jul 22 15:13:57.223989 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.223763    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-tls\") pod \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") "
Jul 22 15:13:57.223989 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.223797    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-trusted-ca\") pod \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") "
Jul 22 15:13:57.223989 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.223816    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-image-registry-private-configuration\") pod \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") "
Jul 22 15:13:57.223989 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.223861    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbg5b\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-kube-api-access-gbg5b\") pod \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") "
Jul 22 15:13:57.223989 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.223910    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-ca-trust-extracted\") pod \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") "
Jul 22 15:13:57.223989 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.223956    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-certificates\") pod \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\" (UID: \"fa47814f-f1b4-4f1a-9ff5-7884f8f05715\") "
Jul 22 15:13:57.225253 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.224423    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fa47814f-f1b4-4f1a-9ff5-7884f8f05715" (UID: "fa47814f-f1b4-4f1a-9ff5-7884f8f05715"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:13:57.225367 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.225297    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fa47814f-f1b4-4f1a-9ff5-7884f8f05715" (UID: "fa47814f-f1b4-4f1a-9ff5-7884f8f05715"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:13:57.225512 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.225487    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fa47814f-f1b4-4f1a-9ff5-7884f8f05715" (UID: "fa47814f-f1b4-4f1a-9ff5-7884f8f05715"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:13:57.226444 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.226416    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-kube-api-access-gbg5b" (OuterVolumeSpecName: "kube-api-access-gbg5b") pod "fa47814f-f1b4-4f1a-9ff5-7884f8f05715" (UID: "fa47814f-f1b4-4f1a-9ff5-7884f8f05715"). InnerVolumeSpecName "kube-api-access-gbg5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:13:57.226536 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.226418    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fa47814f-f1b4-4f1a-9ff5-7884f8f05715" (UID: "fa47814f-f1b4-4f1a-9ff5-7884f8f05715"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:13:57.226536 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.226471    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fa47814f-f1b4-4f1a-9ff5-7884f8f05715" (UID: "fa47814f-f1b4-4f1a-9ff5-7884f8f05715"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:13:57.226712 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.226689    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fa47814f-f1b4-4f1a-9ff5-7884f8f05715" (UID: "fa47814f-f1b4-4f1a-9ff5-7884f8f05715"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:13:57.227417 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.227397    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fa47814f-f1b4-4f1a-9ff5-7884f8f05715" (UID: "fa47814f-f1b4-4f1a-9ff5-7884f8f05715"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:13:57.325505 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.325419    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-trusted-ca\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:13:57.325505 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.325458    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-image-registry-private-configuration\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:13:57.325505 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.325478    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbg5b\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-kube-api-access-gbg5b\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:13:57.325505 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.325495    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-ca-trust-extracted\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:13:57.325505 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.325510    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-certificates\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:13:57.326011 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.325524    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-bound-sa-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:13:57.326011 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.325539    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-installation-pull-secrets\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:13:57.326011 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:57.325552    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fa47814f-f1b4-4f1a-9ff5-7884f8f05715-registry-tls\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:13:58.148621 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:58.148516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c6fc77bb5-q9gdk"
Jul 22 15:13:58.193757 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:58.193699    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c6fc77bb5-q9gdk"]
Jul 22 15:13:58.197127 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:58.197055    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c6fc77bb5-q9gdk"]
Jul 22 15:13:58.780698 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:58.780662    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa47814f-f1b4-4f1a-9ff5-7884f8f05715" path="/var/lib/kubelet/pods/fa47814f-f1b4-4f1a-9ff5-7884f8f05715/volumes"
Jul 22 15:13:59.056364 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:59.055738    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m9jb2"
Jul 22 15:13:59.156903 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:59.156394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qhfnq" event={"ID":"12be4ae9-0c50-4133-90eb-fab987f6e69f","Type":"ContainerStarted","Data":"3759360eb00b3f9a900a16b3400bd95234881854f631139256021d96ba6b3ca1"}
Jul 22 15:13:59.176758 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:13:59.176144    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-qhfnq" podStartSLOduration=1.7420816430000001 podStartE2EDuration="3.176122506s" totalImagesPullingTime="1.434040863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:13:59.174887876 +0000 UTC m=+62.838037298" watchObservedRunningTime="2026-07-22 15:13:59.176122506 +0000 UTC m=+62.839271928"
Jul 22 15:14:01.125304 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:01.125273    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g8268"
Jul 22 15:14:02.475911 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.473413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:14:02.478992 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.478973    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 15:14:02.486221 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.486197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45498614-15bc-4688-95a2-2065211c0c5c-metrics-certs\") pod \"network-metrics-daemon-c6jqt\" (UID: \"45498614-15bc-4688-95a2-2065211c0c5c\") " pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:14:02.573989 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.573967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktnv6\" (UniqueName: \"kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6\") pod \"network-check-target-87jvc\" (UID: \"c218b219-ef71-4b65-90c4-16d592c6c6f6\") " pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:14:02.574089 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.574002    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:14:02.578070 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.578050    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 15:14:02.578169 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.578080    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 15:14:02.586845 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.586810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a41a8d0a-1214-44b7-9032-97d7eb4905c9-original-pull-secret\") pod \"global-pull-secret-syncer-jcnvm\" (UID: \"a41a8d0a-1214-44b7-9032-97d7eb4905c9\") " pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:14:02.587260 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.587241    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 15:14:02.598173 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.597618    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktnv6\" (UniqueName: \"kubernetes.io/projected/c218b219-ef71-4b65-90c4-16d592c6c6f6-kube-api-access-ktnv6\") pod \"network-check-target-87jvc\" (UID: \"c218b219-ef71-4b65-90c4-16d592c6c6f6\") " pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:14:02.694497 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.694478    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-97vtz\""
Jul 22 15:14:02.702048 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.702028    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-glqml\""
Jul 22 15:14:02.702141 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.702085    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6jqt"
Jul 22 15:14:02.705820 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.705803    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcnvm"
Jul 22 15:14:02.710627 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.710605    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:14:02.854793 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:02.854745    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jcnvm"]
Jul 22 15:14:02.859437 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:14:02.859400    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41a8d0a_1214_44b7_9032_97d7eb4905c9.slice/crio-9a2007387aa56393fb8456b6265492c6224847bd02f76d2d66a502908a7847f5 WatchSource:0}: Error finding container 9a2007387aa56393fb8456b6265492c6224847bd02f76d2d66a502908a7847f5: Status 404 returned error can't find the container with id 9a2007387aa56393fb8456b6265492c6224847bd02f76d2d66a502908a7847f5
Jul 22 15:14:03.099515 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.099444    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-87jvc"]
Jul 22 15:14:03.102839 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.102818    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c6jqt"]
Jul 22 15:14:03.103176 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:14:03.103090    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc218b219_ef71_4b65_90c4_16d592c6c6f6.slice/crio-280e92d8be4db3bca253439ad63bba004af7ce9f3d6a3867bfab4f43c46cee52 WatchSource:0}: Error finding container 280e92d8be4db3bca253439ad63bba004af7ce9f3d6a3867bfab4f43c46cee52: Status 404 returned error can't find the container with id 280e92d8be4db3bca253439ad63bba004af7ce9f3d6a3867bfab4f43c46cee52
Jul 22 15:14:03.105607 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:14:03.105469    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45498614_15bc_4688_95a2_2065211c0c5c.slice/crio-1d44b016455782acbfd0e89c0669512f9dec175b32b69f4ba2d32bb75b51eef3 WatchSource:0}: Error finding container 1d44b016455782acbfd0e89c0669512f9dec175b32b69f4ba2d32bb75b51eef3: Status 404 returned error can't find the container with id 1d44b016455782acbfd0e89c0669512f9dec175b32b69f4ba2d32bb75b51eef3
Jul 22 15:14:03.172246 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.172207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jcnvm" event={"ID":"a41a8d0a-1214-44b7-9032-97d7eb4905c9","Type":"ContainerStarted","Data":"9a2007387aa56393fb8456b6265492c6224847bd02f76d2d66a502908a7847f5"}
Jul 22 15:14:03.173278 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.173251    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c6jqt" event={"ID":"45498614-15bc-4688-95a2-2065211c0c5c","Type":"ContainerStarted","Data":"1d44b016455782acbfd0e89c0669512f9dec175b32b69f4ba2d32bb75b51eef3"}
Jul 22 15:14:03.175134 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.175113    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb" event={"ID":"76d6aacb-9530-4c55-9708-8444f961db83","Type":"ContainerStarted","Data":"4b07e7f9788642a431c0394cc4cf5095790fd711f28dbf24003d74cd07f61242"}
Jul 22 15:14:03.175134 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.175143    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb" event={"ID":"76d6aacb-9530-4c55-9708-8444f961db83","Type":"ContainerStarted","Data":"210a4ae89d50993cbd4630fdbc853f9098e158fdc68258ce945ab6c4f6e921c3"}
Jul 22 15:14:03.175307 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.175159    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb" event={"ID":"76d6aacb-9530-4c55-9708-8444f961db83","Type":"ContainerStarted","Data":"ce29ca467a9c5b92a1498229fdc4d91cf6f43df3b3c49e5752bd74508f8fc954"}
Jul 22 15:14:03.176618 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.176591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-sd5px" event={"ID":"11089543-48bb-49e3-aa7d-868e981fcf95","Type":"ContainerStarted","Data":"57a6e48f30d51194382a332a21ae7c3703a589f9d888799c2b247e08beb2ceac"}
Jul 22 15:14:03.176767 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.176747    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:14:03.178343 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.178313    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff" event={"ID":"2cbf222f-af68-4c51-a633-3ccf181e8e9c","Type":"ContainerStarted","Data":"2d9b4f8f6b741e10764e4d30be8e2f023c8e0eaa6ade9fe5c3121475dbba275a"}
Jul 22 15:14:03.178475 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.178430    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:14:03.179648 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.179626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87jvc" event={"ID":"c218b219-ef71-4b65-90c4-16d592c6c6f6","Type":"ContainerStarted","Data":"280e92d8be4db3bca253439ad63bba004af7ce9f3d6a3867bfab4f43c46cee52"}
Jul 22 15:14:03.180194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.180169    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff"
Jul 22 15:14:03.182094 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.182068    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-sd5px"
Jul 22 15:14:03.194177 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.194121    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-79f97d475d-w74nb" podStartSLOduration=1.551609199 podStartE2EDuration="7.194102778s" totalImagesPullingTime="5.642493579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:03.192646185 +0000 UTC m=+66.855795607" watchObservedRunningTime="2026-07-22 15:14:03.194102778 +0000 UTC m=+66.857252200"
Jul 22 15:14:03.210784 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.210734    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-sd5px" podStartSLOduration=1.557374541 podStartE2EDuration="7.21071954s" totalImagesPullingTime="5.653344999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:03.209629497 +0000 UTC m=+66.872778920" watchObservedRunningTime="2026-07-22 15:14:03.21071954 +0000 UTC m=+66.873869019"
Jul 22 15:14:03.225859 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:03.225803    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-78c7d4f687-v5nff" podStartSLOduration=1.5338095859999998 podStartE2EDuration="7.225784774s" totalImagesPullingTime="5.691975188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:03.225770474 +0000 UTC m=+66.888919895" watchObservedRunningTime="2026-07-22 15:14:03.225784774 +0000 UTC m=+66.888934195"
Jul 22 15:14:05.193192 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:05.193084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c6jqt" event={"ID":"45498614-15bc-4688-95a2-2065211c0c5c","Type":"ContainerStarted","Data":"8cf7787bcf406c3d6919ada1221169ea702170e3762214bfff788dd15cf78354"}
Jul 22 15:14:05.193192 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:05.193154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c6jqt" event={"ID":"45498614-15bc-4688-95a2-2065211c0c5c","Type":"ContainerStarted","Data":"1352120c57b3cb28751022d7936cf52ae66de3993c1badb2ed6e8d2f06417d45"}
Jul 22 15:14:05.211531 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:05.211471    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c6jqt" podStartSLOduration=68.116780146 podStartE2EDuration="1m9.211453628s" totalImagesPullingTime="1.094673482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:05.210952767 +0000 UTC m=+68.874102188" watchObservedRunningTime="2026-07-22 15:14:05.211453628 +0000 UTC m=+68.874603048"
Jul 22 15:14:06.547367 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.547330    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4xqx6"]
Jul 22 15:14:06.564051 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.564019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4xqx6"]
Jul 22 15:14:06.564202 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.564156    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.566997 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.566970    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 15:14:06.567140 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.567020    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 15:14:06.568029 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.568007    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 15:14:06.568131 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.568010    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rppjt\""
Jul 22 15:14:06.568131 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.568040    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 15:14:06.610468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.610441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjjlb\" (UniqueName: \"kubernetes.io/projected/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-api-access-zjjlb\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.610468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.610470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/61d7923b-f01b-4510-b267-fd437a01c6e2-data-volume\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.610653 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.610490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.610653 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.610522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.610653 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.610610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/61d7923b-f01b-4510-b267-fd437a01c6e2-crio-socket\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.711255 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.711217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.711428 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.711278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/61d7923b-f01b-4510-b267-fd437a01c6e2-crio-socket\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.711428 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:06.711344    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 15:14:06.711428 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.711367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjjlb\" (UniqueName: \"kubernetes.io/projected/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-api-access-zjjlb\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.711428 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.711398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/61d7923b-f01b-4510-b267-fd437a01c6e2-data-volume\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.711428 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:06.711419    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm podName:61d7923b-f01b-4510-b267-fd437a01c6e2 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:07.211398951 +0000 UTC m=+70.874548363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4xqx6" (UID: "61d7923b-f01b-4510-b267-fd437a01c6e2") : configmap "kube-rbac-proxy" not found
Jul 22 15:14:06.711665 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.711460    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.711665 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.711470    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/61d7923b-f01b-4510-b267-fd437a01c6e2-crio-socket\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.711665 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:06.711567    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 15:14:06.711665 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:06.711616    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls podName:61d7923b-f01b-4510-b267-fd437a01c6e2 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:07.211601071 +0000 UTC m=+70.874750484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4xqx6" (UID: "61d7923b-f01b-4510-b267-fd437a01c6e2") : secret "insights-runtime-extractor-tls" not found
Jul 22 15:14:06.711843 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.711712    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/61d7923b-f01b-4510-b267-fd437a01c6e2-data-volume\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:06.722885 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:06.722861    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjjlb\" (UniqueName: \"kubernetes.io/projected/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-api-access-zjjlb\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:07.149894 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:07.149866    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g8268_2392c191-3855-4341-ae6f-419a932d2858/dns/0.log"
Jul 22 15:14:07.215987 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:07.215958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:07.216189 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:07.215999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:07.216189 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:07.216120    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 15:14:07.216189 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:07.216188    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm podName:61d7923b-f01b-4510-b267-fd437a01c6e2 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:08.216171814 +0000 UTC m=+71.879321216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4xqx6" (UID: "61d7923b-f01b-4510-b267-fd437a01c6e2") : configmap "kube-rbac-proxy" not found
Jul 22 15:14:07.216370 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:07.216122    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 15:14:07.216370 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:07.216271    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls podName:61d7923b-f01b-4510-b267-fd437a01c6e2 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:08.216251904 +0000 UTC m=+71.879401320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4xqx6" (UID: "61d7923b-f01b-4510-b267-fd437a01c6e2") : secret "insights-runtime-extractor-tls" not found
Jul 22 15:14:07.324743 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:07.324711    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g8268_2392c191-3855-4341-ae6f-419a932d2858/kube-rbac-proxy/0.log"
Jul 22 15:14:08.225675 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:08.225643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:08.226080 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:08.225684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:08.226080 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:08.225761    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 15:14:08.226080 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:08.225794    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 15:14:08.226080 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:08.225817    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm podName:61d7923b-f01b-4510-b267-fd437a01c6e2 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:10.225803661 +0000 UTC m=+73.888953060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4xqx6" (UID: "61d7923b-f01b-4510-b267-fd437a01c6e2") : configmap "kube-rbac-proxy" not found
Jul 22 15:14:08.226080 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:08.225852    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls podName:61d7923b-f01b-4510-b267-fd437a01c6e2 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:10.225839156 +0000 UTC m=+73.888988555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4xqx6" (UID: "61d7923b-f01b-4510-b267-fd437a01c6e2") : secret "insights-runtime-extractor-tls" not found
Jul 22 15:14:08.324340 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:08.324312    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6qnvg_550273c2-01c3-49ae-b33e-5d045e936d4a/dns-node-resolver/0.log"
Jul 22 15:14:08.924410 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:08.924378    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bbd7754f9-8vjn4_ab538f0a-bd4a-4bf3-925d-d4cad90d82d2/registry/0.log"
Jul 22 15:14:09.210383 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:09.210298    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-87jvc" event={"ID":"c218b219-ef71-4b65-90c4-16d592c6c6f6","Type":"ContainerStarted","Data":"1aac9c58ef7ec109fbec2e11aa7881ead874ad798cf3cd11c55996a3a457c851"}
Jul 22 15:14:09.210383 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:09.210372    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:14:09.211738 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:09.211714    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jcnvm" event={"ID":"a41a8d0a-1214-44b7-9032-97d7eb4905c9","Type":"ContainerStarted","Data":"f10a91ad046ddf5242a1344b62d2ead9a1b588160c5533973a74b9e9179dd8ad"}
Jul 22 15:14:09.228038 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:09.227993    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-87jvc" podStartSLOduration=67.943171915 podStartE2EDuration="1m13.227980149s" totalImagesPullingTime="5.284808234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:09.227176537 +0000 UTC m=+72.890325965" watchObservedRunningTime="2026-07-22 15:14:09.227980149 +0000 UTC m=+72.891129569"
Jul 22 15:14:09.241783 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:09.241743    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jcnvm" podStartSLOduration=67.700906092 podStartE2EDuration="1m13.241730079s" totalImagesPullingTime="5.540823987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:09.241435624 +0000 UTC m=+72.904585038" watchObservedRunningTime="2026-07-22 15:14:09.241730079 +0000 UTC m=+72.904879739"
Jul 22 15:14:09.723738 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:09.723707    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zjwvp_245ec562-e06c-408f-a8bf-b129ec5e006a/node-ca/0.log"
Jul 22 15:14:10.241777 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:10.241746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:10.242152 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:10.241784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:10.242152 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:10.241857    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 15:14:10.242152 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:10.241884    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 15:14:10.242152 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:10.241908    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm podName:61d7923b-f01b-4510-b267-fd437a01c6e2 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:14.241894826 +0000 UTC m=+77.905044224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4xqx6" (UID: "61d7923b-f01b-4510-b267-fd437a01c6e2") : configmap "kube-rbac-proxy" not found
Jul 22 15:14:10.242152 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:14:10.241948    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls podName:61d7923b-f01b-4510-b267-fd437a01c6e2 nodeName:}" failed. No retries permitted until 2026-07-22 15:14:14.241935973 +0000 UTC m=+77.905085371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4xqx6" (UID: "61d7923b-f01b-4510-b267-fd437a01c6e2") : secret "insights-runtime-extractor-tls" not found
Jul 22 15:14:10.524933 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:10.524843    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s62lx_791de7a1-68b3-407a-a121-e9bdabd68202/serve-healthcheck-canary/0.log"
Jul 22 15:14:14.273112 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:14.273076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:14.273476 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:14.273117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:14.273640 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:14.273606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61d7923b-f01b-4510-b267-fd437a01c6e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:14.275446 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:14.275425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61d7923b-f01b-4510-b267-fd437a01c6e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4xqx6\" (UID: \"61d7923b-f01b-4510-b267-fd437a01c6e2\") " pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:14.373605 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:14.373575    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4xqx6"
Jul 22 15:14:14.496862 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:14.496814    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4xqx6"]
Jul 22 15:14:14.503527 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:14:14.503501    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d7923b_f01b_4510_b267_fd437a01c6e2.slice/crio-c4ef88b6bf8e858b99e721b5587a6d4b8939b8e5987ad98d40130d431ea82bcc WatchSource:0}: Error finding container c4ef88b6bf8e858b99e721b5587a6d4b8939b8e5987ad98d40130d431ea82bcc: Status 404 returned error can't find the container with id c4ef88b6bf8e858b99e721b5587a6d4b8939b8e5987ad98d40130d431ea82bcc
Jul 22 15:14:15.235910 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.235817    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xqx6" event={"ID":"61d7923b-f01b-4510-b267-fd437a01c6e2","Type":"ContainerStarted","Data":"c4ef88b6bf8e858b99e721b5587a6d4b8939b8e5987ad98d40130d431ea82bcc"}
Jul 22 15:14:15.732680 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.731151    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mkx2m"]
Jul 22 15:14:15.734779 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.734748    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.737692 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.737663    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 15:14:15.737818 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.737663    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 15:14:15.737972 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.737904    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 15:14:15.739290 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.738792    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 15:14:15.739290 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.738839    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 15:14:15.739290 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.738801    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 15:14:15.739290 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.739097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m4x9h\""
Jul 22 15:14:15.887697 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.887662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a92ffbae-de73-4519-be6e-39fe01d0b88e-metrics-client-ca\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.887881 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.887712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-textfile\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.887881 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.887818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-tls\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.887881 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.887868    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a92ffbae-de73-4519-be6e-39fe01d0b88e-root\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.888070 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.887928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxz2q\" (UniqueName: \"kubernetes.io/projected/a92ffbae-de73-4519-be6e-39fe01d0b88e-kube-api-access-sxz2q\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.888070 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.887964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.888070 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.888005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-accelerators-collector-config\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.888070 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.888028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a92ffbae-de73-4519-be6e-39fe01d0b88e-sys\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.888275 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.888070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-wtmp\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.988758 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.988722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-tls\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.988766    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a92ffbae-de73-4519-be6e-39fe01d0b88e-root\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.988799    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxz2q\" (UniqueName: \"kubernetes.io/projected/a92ffbae-de73-4519-be6e-39fe01d0b88e-kube-api-access-sxz2q\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.988826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.988859    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-accelerators-collector-config\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.988886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a92ffbae-de73-4519-be6e-39fe01d0b88e-sys\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.988910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-wtmp\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.988932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a92ffbae-de73-4519-be6e-39fe01d0b88e-root\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.988982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a92ffbae-de73-4519-be6e-39fe01d0b88e-metrics-client-ca\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.989007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a92ffbae-de73-4519-be6e-39fe01d0b88e-sys\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989865 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.989029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-textfile\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989865 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.989245    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-wtmp\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.989865 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.989555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-accelerators-collector-config\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.990192 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.989993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a92ffbae-de73-4519-be6e-39fe01d0b88e-metrics-client-ca\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.990192 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.990104    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-textfile\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.992556 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.992509    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:15.994605 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:15.994580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a92ffbae-de73-4519-be6e-39fe01d0b88e-node-exporter-tls\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:16.004378 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:16.004352    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxz2q\" (UniqueName: \"kubernetes.io/projected/a92ffbae-de73-4519-be6e-39fe01d0b88e-kube-api-access-sxz2q\") pod \"node-exporter-mkx2m\" (UID: \"a92ffbae-de73-4519-be6e-39fe01d0b88e\") " pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:16.048783 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:16.048753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mkx2m"
Jul 22 15:14:16.061991 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:14:16.061962    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda92ffbae_de73_4519_be6e_39fe01d0b88e.slice/crio-42bdfe56aea0b6f43473b081a9c10974ad869750398f62e31313040548b708ac WatchSource:0}: Error finding container 42bdfe56aea0b6f43473b081a9c10974ad869750398f62e31313040548b708ac: Status 404 returned error can't find the container with id 42bdfe56aea0b6f43473b081a9c10974ad869750398f62e31313040548b708ac
Jul 22 15:14:16.242121 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:16.242028    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mkx2m" event={"ID":"a92ffbae-de73-4519-be6e-39fe01d0b88e","Type":"ContainerStarted","Data":"42bdfe56aea0b6f43473b081a9c10974ad869750398f62e31313040548b708ac"}
Jul 22 15:14:18.156879 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:18.156845    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bbd7754f9-8vjn4"
Jul 22 15:14:20.260346 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:20.260308    2580 generic.go:356] "Generic (PLEG): container finished" podID="a92ffbae-de73-4519-be6e-39fe01d0b88e" containerID="6bee21856e70f321c160c23f9fa622ab40d4a4dd24299e690a9a252568fc00e6" exitCode=0
Jul 22 15:14:20.260769 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:20.260395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mkx2m" event={"ID":"a92ffbae-de73-4519-be6e-39fe01d0b88e","Type":"ContainerDied","Data":"6bee21856e70f321c160c23f9fa622ab40d4a4dd24299e690a9a252568fc00e6"}
Jul 22 15:14:20.261960 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:20.261908    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xqx6" event={"ID":"61d7923b-f01b-4510-b267-fd437a01c6e2","Type":"ContainerStarted","Data":"1d130b56fa2c153a9803bdd9cc712764046c7e30850a54f22929e159914047b4"}
Jul 22 15:14:21.268989 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:21.268957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mkx2m" event={"ID":"a92ffbae-de73-4519-be6e-39fe01d0b88e","Type":"ContainerStarted","Data":"ab68ac8f5f90ab8b64e17dace2fdd88d2731f34c5eece8875509fa7a4375744e"}
Jul 22 15:14:21.269458 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:21.269019    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mkx2m" event={"ID":"a92ffbae-de73-4519-be6e-39fe01d0b88e","Type":"ContainerStarted","Data":"8099378050ff1f2c948af4e86e5cf3c911cb7448e76cce0a118fec0e8ddf6e0f"}
Jul 22 15:14:21.289987 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:21.289907    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mkx2m" podStartSLOduration=2.562706153 podStartE2EDuration="6.289884828s" totalImagesPullingTime="3.660653952s" totalInitContainerRuntime="66.524723ms" isStatefulPod=true podCreationTimestamp="2026-07-22 15:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:21.289845309 +0000 UTC m=+84.952994754" watchObservedRunningTime="2026-07-22 15:14:21.289884828 +0000 UTC m=+84.953034227"
Jul 22 15:14:24.283315 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:24.283273    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xqx6" event={"ID":"61d7923b-f01b-4510-b267-fd437a01c6e2","Type":"ContainerStarted","Data":"b3179408a8432c55bf11eb94c089385c5b751bb299cfc36238e04d95dcb26d5c"}
Jul 22 15:14:27.296386 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:27.296349    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4xqx6" event={"ID":"61d7923b-f01b-4510-b267-fd437a01c6e2","Type":"ContainerStarted","Data":"c9cad727ca743f14655757c3aa189f40700aa66f64db7c1935f6202103a7dfb7"}
Jul 22 15:14:27.314977 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:27.314903    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4xqx6" podStartSLOduration=8.808777713 podStartE2EDuration="21.31488636s" totalImagesPullingTime="12.506108647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 15:14:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:14:27.313700307 +0000 UTC m=+90.976849731" watchObservedRunningTime="2026-07-22 15:14:27.31488636 +0000 UTC m=+90.978035785"
Jul 22 15:14:40.217954 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:14:40.217904    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-87jvc"
Jul 22 15:17:56.657817 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:17:56.657791    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:17:56.659140 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:17:56.659119    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:17:56.662573 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:17:56.662551    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 15:19:10.879754 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.879719    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"]
Jul 22 15:19:10.882771 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.882754    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:10.885476 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.885451    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 15:19:10.885609 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.885474    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 15:19:10.885794 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.885758    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 15:19:10.885895 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.885839    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 15:19:10.885980 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.885946    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9pwxz\""
Jul 22 15:19:10.897325 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.897304    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"]
Jul 22 15:19:10.957370 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.957332    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:10.957564 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.957377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:10.957564 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.957440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zvtm\" (UniqueName: \"kubernetes.io/projected/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-kube-api-access-4zvtm\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:10.957564 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.957476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-tmp\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:10.957564 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:10.957531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-manifests\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.058668 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.058631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.058868 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.058677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvtm\" (UniqueName: \"kubernetes.io/projected/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-kube-api-access-4zvtm\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.058868 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.058704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-tmp\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.058868 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.058743    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-manifests\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.058868 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.058764    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.059263 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.059235    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-manifests\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.060999 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.060973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-tmp\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.061220 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.061205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.061262 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.061243    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.068693 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.068672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zvtm\" (UniqueName: \"kubernetes.io/projected/ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1-kube-api-access-4zvtm\") pod \"opendatahub-operator-controller-manager-6c6f74d59b-rctlm\" (UID: \"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.192761 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.192685    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:11.328437 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.328380    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"]
Jul 22 15:19:11.330850 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:19:11.330825    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7aa454_1ecd_4f39_b3b7_12c9780bdfa1.slice/crio-f2e1504385b26c2beab6e268547362ec88f3abba13b7d5221846fe30ccea46fd WatchSource:0}: Error finding container f2e1504385b26c2beab6e268547362ec88f3abba13b7d5221846fe30ccea46fd: Status 404 returned error can't find the container with id f2e1504385b26c2beab6e268547362ec88f3abba13b7d5221846fe30ccea46fd
Jul 22 15:19:11.332657 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:11.332642    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 15:19:12.260032 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:12.259983    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm" event={"ID":"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1","Type":"ContainerStarted","Data":"f2e1504385b26c2beab6e268547362ec88f3abba13b7d5221846fe30ccea46fd"}
Jul 22 15:19:15.274420 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:15.274382    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm" event={"ID":"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1","Type":"ContainerStarted","Data":"0acf69d6e8619a355c830e23bea81d1f2fde94f0691c6db93c0677375bfed74c"}
Jul 22 15:19:16.279978 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:16.279943    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1" containerID="0acf69d6e8619a355c830e23bea81d1f2fde94f0691c6db93c0677375bfed74c" exitCode=0
Jul 22 15:19:16.280372 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:16.280031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm" event={"ID":"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1","Type":"ContainerDied","Data":"0acf69d6e8619a355c830e23bea81d1f2fde94f0691c6db93c0677375bfed74c"}
Jul 22 15:19:17.284854 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:17.284811    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm" event={"ID":"ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1","Type":"ContainerStarted","Data":"66cf80fc326a3c3f536b33bb35b1b930e31b248f533bf837cff3a37af59fe0bf"}
Jul 22 15:19:17.285283 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:17.284986    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:17.308790 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:17.308745    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm" podStartSLOduration=2.702658261 podStartE2EDuration="7.308730776s" totalImagesPullingTime="3.585648106s" totalInitContainerRuntime="1.020424409s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:19:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:19:17.306534607 +0000 UTC m=+380.969684030" watchObservedRunningTime="2026-07-22 15:19:17.308730776 +0000 UTC m=+380.971880196"
Jul 22 15:19:28.290863 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:28.290834    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c6f74d59b-rctlm"
Jul 22 15:19:32.199697 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.199660    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"]
Jul 22 15:19:32.211101 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.211083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:32.213996 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.213973    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 15:19:32.214128 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.214000    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 15:19:32.215168 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.215149    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 15:19:32.215284 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.215172    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mzmp7\""
Jul 22 15:19:32.215284 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.215182    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 15:19:32.220909 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.220887    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"]
Jul 22 15:19:32.327071 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.327023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcrgz\" (UniqueName: \"kubernetes.io/projected/1ba07b96-f346-4210-8073-004ca3232972-kube-api-access-bcrgz\") pod \"kube-auth-proxy-6764d75874-v9qdg\" (UID: \"1ba07b96-f346-4210-8073-004ca3232972\") " pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:32.327071 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.327065    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ba07b96-f346-4210-8073-004ca3232972-tmp\") pod \"kube-auth-proxy-6764d75874-v9qdg\" (UID: \"1ba07b96-f346-4210-8073-004ca3232972\") " pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:32.327333 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.327146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ba07b96-f346-4210-8073-004ca3232972-tls-certs\") pod \"kube-auth-proxy-6764d75874-v9qdg\" (UID: \"1ba07b96-f346-4210-8073-004ca3232972\") " pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:32.421302 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.421272    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fbmrr"]
Jul 22 15:19:32.424411 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.424395    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr"
Jul 22 15:19:32.427243 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.427223    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 22 15:19:32.427388 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.427373    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-httnt\""
Jul 22 15:19:32.427494 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.427469    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ba07b96-f346-4210-8073-004ca3232972-tls-certs\") pod \"kube-auth-proxy-6764d75874-v9qdg\" (UID: \"1ba07b96-f346-4210-8073-004ca3232972\") " pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:32.427552 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.427517    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcrgz\" (UniqueName: \"kubernetes.io/projected/1ba07b96-f346-4210-8073-004ca3232972-kube-api-access-bcrgz\") pod \"kube-auth-proxy-6764d75874-v9qdg\" (UID: \"1ba07b96-f346-4210-8073-004ca3232972\") " pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:32.427612 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:19:32.427596    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 22 15:19:32.427661 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.427629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ba07b96-f346-4210-8073-004ca3232972-tmp\") pod \"kube-auth-proxy-6764d75874-v9qdg\" (UID: \"1ba07b96-f346-4210-8073-004ca3232972\") " pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:32.427661 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:19:32.427645    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ba07b96-f346-4210-8073-004ca3232972-tls-certs podName:1ba07b96-f346-4210-8073-004ca3232972 nodeName:}" failed. No retries permitted until 2026-07-22 15:19:32.927632428 +0000 UTC m=+396.590781832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1ba07b96-f346-4210-8073-004ca3232972-tls-certs") pod "kube-auth-proxy-6764d75874-v9qdg" (UID: "1ba07b96-f346-4210-8073-004ca3232972") : secret "kube-auth-proxy-tls" not found
Jul 22 15:19:32.430016 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.429995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ba07b96-f346-4210-8073-004ca3232972-tmp\") pod \"kube-auth-proxy-6764d75874-v9qdg\" (UID: \"1ba07b96-f346-4210-8073-004ca3232972\") " pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:32.434147 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.434126    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fbmrr"]
Jul 22 15:19:32.440130 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.440112    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcrgz\" (UniqueName: \"kubernetes.io/projected/1ba07b96-f346-4210-8073-004ca3232972-kube-api-access-bcrgz\") pod \"kube-auth-proxy-6764d75874-v9qdg\" (UID: \"1ba07b96-f346-4210-8073-004ca3232972\") " pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:32.528938 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.528895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73ac20fd-0264-4798-8ad7-e295dc8378be-cert\") pod \"odh-model-controller-7998c67dc4-fbmrr\" (UID: \"73ac20fd-0264-4798-8ad7-e295dc8378be\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr"
Jul 22 15:19:32.529099 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.528954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k67tb\" (UniqueName: \"kubernetes.io/projected/73ac20fd-0264-4798-8ad7-e295dc8378be-kube-api-access-k67tb\") pod \"odh-model-controller-7998c67dc4-fbmrr\" (UID: \"73ac20fd-0264-4798-8ad7-e295dc8378be\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr"
Jul 22 15:19:32.630056 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.630024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73ac20fd-0264-4798-8ad7-e295dc8378be-cert\") pod \"odh-model-controller-7998c67dc4-fbmrr\" (UID: \"73ac20fd-0264-4798-8ad7-e295dc8378be\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr"
Jul 22 15:19:32.630247 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.630066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k67tb\" (UniqueName: \"kubernetes.io/projected/73ac20fd-0264-4798-8ad7-e295dc8378be-kube-api-access-k67tb\") pod \"odh-model-controller-7998c67dc4-fbmrr\" (UID: \"73ac20fd-0264-4798-8ad7-e295dc8378be\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr"
Jul 22 15:19:32.630247 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:19:32.630189    2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 22 15:19:32.630365 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:19:32.630271    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73ac20fd-0264-4798-8ad7-e295dc8378be-cert podName:73ac20fd-0264-4798-8ad7-e295dc8378be nodeName:}" failed. No retries permitted until 2026-07-22 15:19:33.130253284 +0000 UTC m=+396.793402687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/73ac20fd-0264-4798-8ad7-e295dc8378be-cert") pod "odh-model-controller-7998c67dc4-fbmrr" (UID: "73ac20fd-0264-4798-8ad7-e295dc8378be") : secret "odh-model-controller-webhook-cert" not found
Jul 22 15:19:32.642005 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.641969    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k67tb\" (UniqueName: \"kubernetes.io/projected/73ac20fd-0264-4798-8ad7-e295dc8378be-kube-api-access-k67tb\") pod \"odh-model-controller-7998c67dc4-fbmrr\" (UID: \"73ac20fd-0264-4798-8ad7-e295dc8378be\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr"
Jul 22 15:19:32.933148 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.933063    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ba07b96-f346-4210-8073-004ca3232972-tls-certs\") pod \"kube-auth-proxy-6764d75874-v9qdg\" (UID: \"1ba07b96-f346-4210-8073-004ca3232972\") " pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:32.935414 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:32.935396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ba07b96-f346-4210-8073-004ca3232972-tls-certs\") pod \"kube-auth-proxy-6764d75874-v9qdg\" (UID: \"1ba07b96-f346-4210-8073-004ca3232972\") " pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:33.121021 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.120992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"
Jul 22 15:19:33.135372 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.135349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73ac20fd-0264-4798-8ad7-e295dc8378be-cert\") pod \"odh-model-controller-7998c67dc4-fbmrr\" (UID: \"73ac20fd-0264-4798-8ad7-e295dc8378be\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr"
Jul 22 15:19:33.137561 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.137537    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73ac20fd-0264-4798-8ad7-e295dc8378be-cert\") pod \"odh-model-controller-7998c67dc4-fbmrr\" (UID: \"73ac20fd-0264-4798-8ad7-e295dc8378be\") " pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr"
Jul 22 15:19:33.252427 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.252383    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6764d75874-v9qdg"]
Jul 22 15:19:33.254941 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:19:33.254883    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ba07b96_f346_4210_8073_004ca3232972.slice/crio-0c35501d847eacd2f86b74dc0d31e0a694445f6be4d8482cc02ea0d553aa0f4a WatchSource:0}: Error finding container 0c35501d847eacd2f86b74dc0d31e0a694445f6be4d8482cc02ea0d553aa0f4a: Status 404 returned error can't find the container with id 0c35501d847eacd2f86b74dc0d31e0a694445f6be4d8482cc02ea0d553aa0f4a
Jul 22 15:19:33.342272 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.342249    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr"
Jul 22 15:19:33.342530 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.342506    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg" event={"ID":"1ba07b96-f346-4210-8073-004ca3232972","Type":"ContainerStarted","Data":"0c35501d847eacd2f86b74dc0d31e0a694445f6be4d8482cc02ea0d553aa0f4a"}
Jul 22 15:19:33.357207 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.357184    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tz68s"]
Jul 22 15:19:33.360371 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.360350    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:33.363734 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.363711    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 22 15:19:33.364024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.364001    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5fljb\""
Jul 22 15:19:33.386484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.386459    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tz68s"]
Jul 22 15:19:33.437442 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.437410    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779a049c-0fcf-4a91-a1ed-fa00de2ee539-tls-certs\") pod \"model-serving-api-54d89bd5fc-tz68s\" (UID: \"779a049c-0fcf-4a91-a1ed-fa00de2ee539\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:33.437575 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.437490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw878\" (UniqueName: \"kubernetes.io/projected/779a049c-0fcf-4a91-a1ed-fa00de2ee539-kube-api-access-hw878\") pod \"model-serving-api-54d89bd5fc-tz68s\" (UID: \"779a049c-0fcf-4a91-a1ed-fa00de2ee539\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:33.477330 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.477307    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fbmrr"]
Jul 22 15:19:33.480735 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:19:33.480706    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ac20fd_0264_4798_8ad7_e295dc8378be.slice/crio-08207e991de6cbd2b79ae7fcadf82c070b9c233961135a42ae7c542c3666604f WatchSource:0}: Error finding container 08207e991de6cbd2b79ae7fcadf82c070b9c233961135a42ae7c542c3666604f: Status 404 returned error can't find the container with id 08207e991de6cbd2b79ae7fcadf82c070b9c233961135a42ae7c542c3666604f
Jul 22 15:19:33.538625 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.538599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779a049c-0fcf-4a91-a1ed-fa00de2ee539-tls-certs\") pod \"model-serving-api-54d89bd5fc-tz68s\" (UID: \"779a049c-0fcf-4a91-a1ed-fa00de2ee539\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:33.538769 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.538673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw878\" (UniqueName: \"kubernetes.io/projected/779a049c-0fcf-4a91-a1ed-fa00de2ee539-kube-api-access-hw878\") pod \"model-serving-api-54d89bd5fc-tz68s\" (UID: \"779a049c-0fcf-4a91-a1ed-fa00de2ee539\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:33.538769 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:19:33.538753    2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 22 15:19:33.538885 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:19:33.538818    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/779a049c-0fcf-4a91-a1ed-fa00de2ee539-tls-certs podName:779a049c-0fcf-4a91-a1ed-fa00de2ee539 nodeName:}" failed. No retries permitted until 2026-07-22 15:19:34.038801882 +0000 UTC m=+397.701951280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/779a049c-0fcf-4a91-a1ed-fa00de2ee539-tls-certs") pod "model-serving-api-54d89bd5fc-tz68s" (UID: "779a049c-0fcf-4a91-a1ed-fa00de2ee539") : secret "model-serving-api-tls" not found
Jul 22 15:19:33.552178 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.552155    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw878\" (UniqueName: \"kubernetes.io/projected/779a049c-0fcf-4a91-a1ed-fa00de2ee539-kube-api-access-hw878\") pod \"model-serving-api-54d89bd5fc-tz68s\" (UID: \"779a049c-0fcf-4a91-a1ed-fa00de2ee539\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:33.597285 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.597249    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"]
Jul 22 15:19:33.600595 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.600579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.603250 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.603221    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 15:19:33.603250 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.603232    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zdb2q\""
Jul 22 15:19:33.603438 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.603346    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 22 15:19:33.603516 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.603462    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 22 15:19:33.603667 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.603645    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 22 15:19:33.615428 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.615407    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"]
Jul 22 15:19:33.740302 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.740277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.740439 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.740320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.740439 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.740351    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hhxh\" (UniqueName: \"kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-kube-api-access-5hhxh\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.740439 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.740378    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-cacerts\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.740439 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.740409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73bf5947-b804-4841-b84e-611137e24d45-local-certs\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.740439 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.740429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.740638 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.740494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-istio-token\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.841276 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.841239    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73bf5947-b804-4841-b84e-611137e24d45-local-certs\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.841468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.841287    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.841468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.841343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-istio-token\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.841579 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.841477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.841579 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.841554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.841681 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.841599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hhxh\" (UniqueName: \"kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-kube-api-access-5hhxh\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.841681 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.841624    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-cacerts\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.842057 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.842030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.843965 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.843942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-cacerts\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.844087 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.843991    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.844087 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.844014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73bf5947-b804-4841-b84e-611137e24d45-local-certs\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.844199 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.844119    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.849776 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.849752    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hhxh\" (UniqueName: \"kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-kube-api-access-5hhxh\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.849900 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.849879    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-istio-token\") pod \"istiod-openshift-gateway-7574459656-9tnrs\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:33.914450 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:33.914417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:34.043483 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:34.043450    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779a049c-0fcf-4a91-a1ed-fa00de2ee539-tls-certs\") pod \"model-serving-api-54d89bd5fc-tz68s\" (UID: \"779a049c-0fcf-4a91-a1ed-fa00de2ee539\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:34.043661 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:19:34.043582    2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 22 15:19:34.043661 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:19:34.043645    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/779a049c-0fcf-4a91-a1ed-fa00de2ee539-tls-certs podName:779a049c-0fcf-4a91-a1ed-fa00de2ee539 nodeName:}" failed. No retries permitted until 2026-07-22 15:19:35.043629885 +0000 UTC m=+398.706779284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/779a049c-0fcf-4a91-a1ed-fa00de2ee539-tls-certs") pod "model-serving-api-54d89bd5fc-tz68s" (UID: "779a049c-0fcf-4a91-a1ed-fa00de2ee539") : secret "model-serving-api-tls" not found
Jul 22 15:19:34.053057 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:34.053031    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"]
Jul 22 15:19:34.055802 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:19:34.055771    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73bf5947_b804_4841_b84e_611137e24d45.slice/crio-4d2f8cfb2c14a8f884e15186af9567b2544e33a5c49f255da4b267be0777f147 WatchSource:0}: Error finding container 4d2f8cfb2c14a8f884e15186af9567b2544e33a5c49f255da4b267be0777f147: Status 404 returned error can't find the container with id 4d2f8cfb2c14a8f884e15186af9567b2544e33a5c49f255da4b267be0777f147
Jul 22 15:19:34.348228 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:34.348109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr" event={"ID":"73ac20fd-0264-4798-8ad7-e295dc8378be","Type":"ContainerStarted","Data":"08207e991de6cbd2b79ae7fcadf82c070b9c233961135a42ae7c542c3666604f"}
Jul 22 15:19:34.349774 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:34.349721    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs" event={"ID":"73bf5947-b804-4841-b84e-611137e24d45","Type":"ContainerStarted","Data":"4d2f8cfb2c14a8f884e15186af9567b2544e33a5c49f255da4b267be0777f147"}
Jul 22 15:19:35.053028 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:35.052951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779a049c-0fcf-4a91-a1ed-fa00de2ee539-tls-certs\") pod \"model-serving-api-54d89bd5fc-tz68s\" (UID: \"779a049c-0fcf-4a91-a1ed-fa00de2ee539\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:35.056200 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:35.056144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/779a049c-0fcf-4a91-a1ed-fa00de2ee539-tls-certs\") pod \"model-serving-api-54d89bd5fc-tz68s\" (UID: \"779a049c-0fcf-4a91-a1ed-fa00de2ee539\") " pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:35.174801 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:35.174763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:37.069612 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:37.069526    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tz68s"]
Jul 22 15:19:37.072905 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:19:37.072880    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod779a049c_0fcf_4a91_a1ed_fa00de2ee539.slice/crio-d5803d2b5dd184229cc17454e08832defd0522f6fc232270ee19e25cc65645bb WatchSource:0}: Error finding container d5803d2b5dd184229cc17454e08832defd0522f6fc232270ee19e25cc65645bb: Status 404 returned error can't find the container with id d5803d2b5dd184229cc17454e08832defd0522f6fc232270ee19e25cc65645bb
Jul 22 15:19:37.364055 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:37.364014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tz68s" event={"ID":"779a049c-0fcf-4a91-a1ed-fa00de2ee539","Type":"ContainerStarted","Data":"d5803d2b5dd184229cc17454e08832defd0522f6fc232270ee19e25cc65645bb"}
Jul 22 15:19:37.365814 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:37.365785    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg" event={"ID":"1ba07b96-f346-4210-8073-004ca3232972","Type":"ContainerStarted","Data":"4a0d18ce08fc7615cc02714721e647ada838f106c2835454cd9b80d4f9ead646"}
Jul 22 15:19:37.367378 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:37.367352    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr" event={"ID":"73ac20fd-0264-4798-8ad7-e295dc8378be","Type":"ContainerStarted","Data":"d575e84b6ce67132313ca09c23a036110cb6506a2d0622b6ea9f47a8aa5a467d"}
Jul 22 15:19:37.367509 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:37.367414    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr"
Jul 22 15:19:37.383550 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:37.383496    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6764d75874-v9qdg" podStartSLOduration=1.696956685 podStartE2EDuration="5.383473426s" totalImagesPullingTime="3.686516741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:19:37.381709588 +0000 UTC m=+401.044859009" watchObservedRunningTime="2026-07-22 15:19:37.383473426 +0000 UTC m=+401.046622846"
Jul 22 15:19:37.398193 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:37.398140    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr" podStartSLOduration=1.937404127 podStartE2EDuration="5.39812403s" totalImagesPullingTime="3.460719903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:19:37.39782046 +0000 UTC m=+401.060969885" watchObservedRunningTime="2026-07-22 15:19:37.39812403 +0000 UTC m=+401.061273452"
Jul 22 15:19:39.377053 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:39.377012    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tz68s" event={"ID":"779a049c-0fcf-4a91-a1ed-fa00de2ee539","Type":"ContainerStarted","Data":"79ae6a4dcdacb4a6c30924c4e9153c8d4c5fcc83746b8aeaf840c7f87c4b7fd8"}
Jul 22 15:19:39.377362 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:39.377199    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:39.396128 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:39.396086    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tz68s" podStartSLOduration=4.162569711 podStartE2EDuration="6.396072194s" totalImagesPullingTime="2.233502483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:19:39.394671058 +0000 UTC m=+403.057820478" watchObservedRunningTime="2026-07-22 15:19:39.396072194 +0000 UTC m=+403.059221614"
Jul 22 15:19:42.521502 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.521471    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"]
Jul 22 15:19:42.524212 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.524193    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"
Jul 22 15:19:42.528612 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.528590    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 22 15:19:42.528742 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.528659    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2dvzm\""
Jul 22 15:19:42.534694 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.534672    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"]
Jul 22 15:19:42.537739 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.537723    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"
Jul 22 15:19:42.540507 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.539798    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"]
Jul 22 15:19:42.541197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.541174    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 22 15:19:42.542712 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.542695    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-n9cgd\""
Jul 22 15:19:42.551058 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.551038    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"]
Jul 22 15:19:42.625576 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.625547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmb27\" (UniqueName: \"kubernetes.io/projected/39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee-kube-api-access-jmb27\") pod \"kserve-controller-manager-d6f4b65b8-thkz4\" (UID: \"39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"
Jul 22 15:19:42.625772 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.625589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee-cert\") pod \"kserve-controller-manager-d6f4b65b8-thkz4\" (UID: \"39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"
Jul 22 15:19:42.726551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.726514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfxd4\" (UniqueName: \"kubernetes.io/projected/0c8f3a91-005b-486c-9ff3-4bd72c02cd82-kube-api-access-lfxd4\") pod \"llmisvc-controller-manager-777c6bd7d5-dbsjk\" (UID: \"0c8f3a91-005b-486c-9ff3-4bd72c02cd82\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"
Jul 22 15:19:42.726740 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.726583    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmb27\" (UniqueName: \"kubernetes.io/projected/39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee-kube-api-access-jmb27\") pod \"kserve-controller-manager-d6f4b65b8-thkz4\" (UID: \"39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"
Jul 22 15:19:42.726740 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.726613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee-cert\") pod \"kserve-controller-manager-d6f4b65b8-thkz4\" (UID: \"39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"
Jul 22 15:19:42.726740 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.726631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c8f3a91-005b-486c-9ff3-4bd72c02cd82-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dbsjk\" (UID: \"0c8f3a91-005b-486c-9ff3-4bd72c02cd82\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"
Jul 22 15:19:42.729101 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.729078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee-cert\") pod \"kserve-controller-manager-d6f4b65b8-thkz4\" (UID: \"39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"
Jul 22 15:19:42.738119 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.738095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmb27\" (UniqueName: \"kubernetes.io/projected/39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee-kube-api-access-jmb27\") pod \"kserve-controller-manager-d6f4b65b8-thkz4\" (UID: \"39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"
Jul 22 15:19:42.827286 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.827190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfxd4\" (UniqueName: \"kubernetes.io/projected/0c8f3a91-005b-486c-9ff3-4bd72c02cd82-kube-api-access-lfxd4\") pod \"llmisvc-controller-manager-777c6bd7d5-dbsjk\" (UID: \"0c8f3a91-005b-486c-9ff3-4bd72c02cd82\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"
Jul 22 15:19:42.827461 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.827301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c8f3a91-005b-486c-9ff3-4bd72c02cd82-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dbsjk\" (UID: \"0c8f3a91-005b-486c-9ff3-4bd72c02cd82\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"
Jul 22 15:19:42.827461 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:19:42.827408    2580 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 22 15:19:42.827604 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:19:42.827505    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8f3a91-005b-486c-9ff3-4bd72c02cd82-cert podName:0c8f3a91-005b-486c-9ff3-4bd72c02cd82 nodeName:}" failed. No retries permitted until 2026-07-22 15:19:43.327472957 +0000 UTC m=+406.990622358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0c8f3a91-005b-486c-9ff3-4bd72c02cd82-cert") pod "llmisvc-controller-manager-777c6bd7d5-dbsjk" (UID: "0c8f3a91-005b-486c-9ff3-4bd72c02cd82") : secret "llmisvc-webhook-server-cert" not found
Jul 22 15:19:42.835196 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.835160    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"
Jul 22 15:19:42.848820 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.848794    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfxd4\" (UniqueName: \"kubernetes.io/projected/0c8f3a91-005b-486c-9ff3-4bd72c02cd82-kube-api-access-lfxd4\") pod \"llmisvc-controller-manager-777c6bd7d5-dbsjk\" (UID: \"0c8f3a91-005b-486c-9ff3-4bd72c02cd82\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"
Jul 22 15:19:42.988195 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:42.988169    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"]
Jul 22 15:19:42.990079 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:19:42.990052    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e31b5a_79d5_46ea_b8a5_15b5f5bb55ee.slice/crio-4953281d693032a2800c8f0f2049c1cf23f453a9fb1370a603d49b3bb569650d WatchSource:0}: Error finding container 4953281d693032a2800c8f0f2049c1cf23f453a9fb1370a603d49b3bb569650d: Status 404 returned error can't find the container with id 4953281d693032a2800c8f0f2049c1cf23f453a9fb1370a603d49b3bb569650d
Jul 22 15:19:43.332657 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:43.332618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c8f3a91-005b-486c-9ff3-4bd72c02cd82-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dbsjk\" (UID: \"0c8f3a91-005b-486c-9ff3-4bd72c02cd82\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"
Jul 22 15:19:43.335017 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:43.334993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c8f3a91-005b-486c-9ff3-4bd72c02cd82-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dbsjk\" (UID: \"0c8f3a91-005b-486c-9ff3-4bd72c02cd82\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"
Jul 22 15:19:43.397696 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:43.397663    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4" event={"ID":"39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee","Type":"ContainerStarted","Data":"4953281d693032a2800c8f0f2049c1cf23f453a9fb1370a603d49b3bb569650d"}
Jul 22 15:19:43.450601 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:43.450573    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"
Jul 22 15:19:43.593331 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:43.593228    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"]
Jul 22 15:19:43.595695 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:19:43.595672    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0c8f3a91_005b_486c_9ff3_4bd72c02cd82.slice/crio-69c53d0701162822f245c2d65aa23714b5d7b975cdbd97bb63cc1f35deb5b60b WatchSource:0}: Error finding container 69c53d0701162822f245c2d65aa23714b5d7b975cdbd97bb63cc1f35deb5b60b: Status 404 returned error can't find the container with id 69c53d0701162822f245c2d65aa23714b5d7b975cdbd97bb63cc1f35deb5b60b
Jul 22 15:19:44.404348 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:44.404317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk" event={"ID":"0c8f3a91-005b-486c-9ff3-4bd72c02cd82","Type":"ContainerStarted","Data":"69c53d0701162822f245c2d65aa23714b5d7b975cdbd97bb63cc1f35deb5b60b"}
Jul 22 15:19:45.069124 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.069073    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"]
Jul 22 15:19:45.072645 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.072626    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.075703 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.075673    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kjx2q\""
Jul 22 15:19:45.085230 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.085171    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"]
Jul 22 15:19:45.149893 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.149857    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9359a32a-6055-4731-a19e-3736631fbf12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.150092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.149905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.150092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.149958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9359a32a-6055-4731-a19e-3736631fbf12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.150092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.149981    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.150092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.150019    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5bcz\" (UniqueName: \"kubernetes.io/projected/9359a32a-6055-4731-a19e-3736631fbf12-kube-api-access-f5bcz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.150092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.150084    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9359a32a-6055-4731-a19e-3736631fbf12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.150350 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.150121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.150350 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.150144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.150350 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.150161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.250687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.250654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5bcz\" (UniqueName: \"kubernetes.io/projected/9359a32a-6055-4731-a19e-3736631fbf12-kube-api-access-f5bcz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.250863 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.250791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9359a32a-6055-4731-a19e-3736631fbf12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.250863 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.250833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.250863 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.250857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.251059 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.250881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.251059 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.250977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9359a32a-6055-4731-a19e-3736631fbf12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.251059 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.251011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.251059 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.251042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9359a32a-6055-4731-a19e-3736631fbf12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.251243 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.251070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.251332 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.251291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.251394 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.251341    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.251520 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.251477    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.251520 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.251502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.251815 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.251789    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9359a32a-6055-4731-a19e-3736631fbf12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.253213 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.253193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9359a32a-6055-4731-a19e-3736631fbf12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.253365 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.253344    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9359a32a-6055-4731-a19e-3736631fbf12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.268885 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.268855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9359a32a-6055-4731-a19e-3736631fbf12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.269023 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.269002    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5bcz\" (UniqueName: \"kubernetes.io/projected/9359a32a-6055-4731-a19e-3736631fbf12-kube-api-access-f5bcz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hdd5b\" (UID: \"9359a32a-6055-4731-a19e-3736631fbf12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.386030 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.386002    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:45.411266 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.411232    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4" event={"ID":"39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee","Type":"ContainerStarted","Data":"52901d819ab5752e25efa0a5a5ef99947a3c4c190bffca6d8631d6e6753e15e8"}
Jul 22 15:19:45.411390 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.411316    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"
Jul 22 15:19:45.430833 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.430787    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4" podStartSLOduration=1.123856161 podStartE2EDuration="3.430771163s" totalImagesPullingTime="2.306915002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:19:45.430186834 +0000 UTC m=+409.093336250" watchObservedRunningTime="2026-07-22 15:19:45.430771163 +0000 UTC m=+409.093920584"
Jul 22 15:19:45.862853 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:45.862824    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"]
Jul 22 15:19:45.864698 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:19:45.864670    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9359a32a_6055_4731_a19e_3736631fbf12.slice/crio-a51343a42b3add2555fedc6d36929fd05f33e833ff42406261a5d4358296f396 WatchSource:0}: Error finding container a51343a42b3add2555fedc6d36929fd05f33e833ff42406261a5d4358296f396: Status 404 returned error can't find the container with id a51343a42b3add2555fedc6d36929fd05f33e833ff42406261a5d4358296f396
Jul 22 15:19:46.416051 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:46.416018    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b" event={"ID":"9359a32a-6055-4731-a19e-3736631fbf12","Type":"ContainerStarted","Data":"a51343a42b3add2555fedc6d36929fd05f33e833ff42406261a5d4358296f396"}
Jul 22 15:19:47.985360 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:47.985323    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"]
Jul 22 15:19:48.374664 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:48.374633    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fbmrr"
Jul 22 15:19:49.970728 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:49.970692    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:19:49.971136 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:49.970775    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:19:49.976139 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:49.976109    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:19:49.976218 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:49.976182    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:19:49.976276 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:49.976222    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:19:50.388158 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.388083    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tz68s"
Jul 22 15:19:50.449191 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.448791    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b" event={"ID":"9359a32a-6055-4731-a19e-3736631fbf12","Type":"ContainerStarted","Data":"885cb11736edd4b4e9cd2592d4f3e25e6d825127252edcbdd214d9bf5713bea1"}
Jul 22 15:19:50.450619 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.450568    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk" event={"ID":"0c8f3a91-005b-486c-9ff3-4bd72c02cd82","Type":"ContainerStarted","Data":"ee911305ecd441ae6219b5e7c9ea29ad33da137e2257210e43e68d74559def88"}
Jul 22 15:19:50.450750 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.450707    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"
Jul 22 15:19:50.452252 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.452228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs" event={"ID":"73bf5947-b804-4841-b84e-611137e24d45","Type":"ContainerStarted","Data":"b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3"}
Jul 22 15:19:50.452379 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.452311    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs" podUID="73bf5947-b804-4841-b84e-611137e24d45" containerName="discovery" containerID="cri-o://b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3" gracePeriod=30
Jul 22 15:19:50.452450 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.452371    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:50.469861 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.469822    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b" podStartSLOduration=1.361129618 podStartE2EDuration="5.469808945s" totalImagesPullingTime="4.108679327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:19:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:19:50.46840223 +0000 UTC m=+414.131551655" watchObservedRunningTime="2026-07-22 15:19:50.469808945 +0000 UTC m=+414.132958366"
Jul 22 15:19:50.489300 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.489253    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs" podStartSLOduration=1.577091512 podStartE2EDuration="17.489235161s" totalImagesPullingTime="15.912143649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:19:50.488275646 +0000 UTC m=+414.151425067" watchObservedRunningTime="2026-07-22 15:19:50.489235161 +0000 UTC m=+414.152384585"
Jul 22 15:19:50.506655 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.506619    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk" podStartSLOduration=2.135400067 podStartE2EDuration="8.5066028s" totalImagesPullingTime="6.371202733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:19:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:19:50.506084201 +0000 UTC m=+414.169233623" watchObservedRunningTime="2026-07-22 15:19:50.5066028 +0000 UTC m=+414.169752221"
Jul 22 15:19:50.690581 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.690558    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:50.696487 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.696466    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73bf5947-b804-4841-b84e-611137e24d45-local-certs\") pod \"73bf5947-b804-4841-b84e-611137e24d45\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") "
Jul 22 15:19:50.696612 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.696526    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-ca-configmap\") pod \"73bf5947-b804-4841-b84e-611137e24d45\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") "
Jul 22 15:19:50.696612 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.696545    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-cacerts\") pod \"73bf5947-b804-4841-b84e-611137e24d45\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") "
Jul 22 15:19:50.696612 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.696564    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-dns-cert\") pod \"73bf5947-b804-4841-b84e-611137e24d45\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") "
Jul 22 15:19:50.696612 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.696586    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hhxh\" (UniqueName: \"kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-kube-api-access-5hhxh\") pod \"73bf5947-b804-4841-b84e-611137e24d45\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") "
Jul 22 15:19:50.696800 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.696617    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-kubeconfig\") pod \"73bf5947-b804-4841-b84e-611137e24d45\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") "
Jul 22 15:19:50.696800 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.696644    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-istio-token\") pod \"73bf5947-b804-4841-b84e-611137e24d45\" (UID: \"73bf5947-b804-4841-b84e-611137e24d45\") "
Jul 22 15:19:50.697038 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.697007    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "73bf5947-b804-4841-b84e-611137e24d45" (UID: "73bf5947-b804-4841-b84e-611137e24d45"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:19:50.698873 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.698842    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-cacerts" (OuterVolumeSpecName: "cacerts") pod "73bf5947-b804-4841-b84e-611137e24d45" (UID: "73bf5947-b804-4841-b84e-611137e24d45"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:19:50.699055 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.699009    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73bf5947-b804-4841-b84e-611137e24d45-local-certs" (OuterVolumeSpecName: "local-certs") pod "73bf5947-b804-4841-b84e-611137e24d45" (UID: "73bf5947-b804-4841-b84e-611137e24d45"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:19:50.699161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.699089    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "73bf5947-b804-4841-b84e-611137e24d45" (UID: "73bf5947-b804-4841-b84e-611137e24d45"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:19:50.699244 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.699215    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "73bf5947-b804-4841-b84e-611137e24d45" (UID: "73bf5947-b804-4841-b84e-611137e24d45"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:19:50.699370 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.699345    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-istio-token" (OuterVolumeSpecName: "istio-token") pod "73bf5947-b804-4841-b84e-611137e24d45" (UID: "73bf5947-b804-4841-b84e-611137e24d45"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:19:50.699457 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.699404    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-kube-api-access-5hhxh" (OuterVolumeSpecName: "kube-api-access-5hhxh") pod "73bf5947-b804-4841-b84e-611137e24d45" (UID: "73bf5947-b804-4841-b84e-611137e24d45"). InnerVolumeSpecName "kube-api-access-5hhxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:19:50.798099 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.798073    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hhxh\" (UniqueName: \"kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-kube-api-access-5hhxh\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:19:50.798099 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.798099    2580 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-kubeconfig\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:19:50.798270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.798108    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73bf5947-b804-4841-b84e-611137e24d45-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:19:50.798270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.798117    2580 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/73bf5947-b804-4841-b84e-611137e24d45-local-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:19:50.798270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.798125    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-ca-configmap\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:19:50.798270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.798137    2580 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-cacerts\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:19:50.798270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:50.798151    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/73bf5947-b804-4841-b84e-611137e24d45-istio-csr-dns-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:19:51.386702 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.386611    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:51.391423 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.391400    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:51.457983 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.457951    2580 generic.go:356] "Generic (PLEG): container finished" podID="73bf5947-b804-4841-b84e-611137e24d45" containerID="b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3" exitCode=2
Jul 22 15:19:51.458135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.457992    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"
Jul 22 15:19:51.458135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.458024    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs" event={"ID":"73bf5947-b804-4841-b84e-611137e24d45","Type":"ContainerDied","Data":"b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3"}
Jul 22 15:19:51.458135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.458060    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs" event={"ID":"73bf5947-b804-4841-b84e-611137e24d45","Type":"ContainerDied","Data":"4d2f8cfb2c14a8f884e15186af9567b2544e33a5c49f255da4b267be0777f147"}
Jul 22 15:19:51.458135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.458079    2580 scope.go:117] "RemoveContainer" containerID="b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3"
Jul 22 15:19:51.458631 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.458607    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:51.459854 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.459799    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hdd5b"
Jul 22 15:19:51.468417 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.468394    2580 scope.go:117] "RemoveContainer" containerID="b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3"
Jul 22 15:19:51.468675 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:19:51.468651    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3\": container with ID starting with b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3 not found: ID does not exist" containerID="b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3"
Jul 22 15:19:51.468730 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.468684    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3"} err="failed to get container status \"b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3\": rpc error: code = NotFound desc = could not find container \"b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3\": container with ID starting with b6b8bce66890a5db932f8611d8f256b34c19dda48af840c5ef6d73389be5d0e3 not found: ID does not exist"
Jul 22 15:19:51.499513 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.499474    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"]
Jul 22 15:19:51.503009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:51.502986    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9tnrs"]
Jul 22 15:19:52.781581 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:19:52.781545    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73bf5947-b804-4841-b84e-611137e24d45" path="/var/lib/kubelet/pods/73bf5947-b804-4841-b84e-611137e24d45/volumes"
Jul 22 15:20:16.421760 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:16.421729    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-thkz4"
Jul 22 15:20:21.460588 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:21.460497    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dbsjk"
Jul 22 15:20:33.087305 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.087267    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jrq54"]
Jul 22 15:20:33.087781 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.087710    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73bf5947-b804-4841-b84e-611137e24d45" containerName="discovery"
Jul 22 15:20:33.087781 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.087728    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="73bf5947-b804-4841-b84e-611137e24d45" containerName="discovery"
Jul 22 15:20:33.087893 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.087816    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="73bf5947-b804-4841-b84e-611137e24d45" containerName="discovery"
Jul 22 15:20:33.098005 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.097980    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jrq54"
Jul 22 15:20:33.100796 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.100774    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 15:20:33.100943 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.100905    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 15:20:33.101024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.100969    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4mvds\""
Jul 22 15:20:33.106737 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.106718    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jrq54"]
Jul 22 15:20:33.239953 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.239903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngbz\" (UniqueName: \"kubernetes.io/projected/d48a5080-c78e-4ee7-ac6d-3d97bd796cf9-kube-api-access-mngbz\") pod \"kuadrant-operator-catalog-jrq54\" (UID: \"d48a5080-c78e-4ee7-ac6d-3d97bd796cf9\") " pod="kuadrant-system/kuadrant-operator-catalog-jrq54"
Jul 22 15:20:33.341050 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.340954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mngbz\" (UniqueName: \"kubernetes.io/projected/d48a5080-c78e-4ee7-ac6d-3d97bd796cf9-kube-api-access-mngbz\") pod \"kuadrant-operator-catalog-jrq54\" (UID: \"d48a5080-c78e-4ee7-ac6d-3d97bd796cf9\") " pod="kuadrant-system/kuadrant-operator-catalog-jrq54"
Jul 22 15:20:33.349812 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.349781    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngbz\" (UniqueName: \"kubernetes.io/projected/d48a5080-c78e-4ee7-ac6d-3d97bd796cf9-kube-api-access-mngbz\") pod \"kuadrant-operator-catalog-jrq54\" (UID: \"d48a5080-c78e-4ee7-ac6d-3d97bd796cf9\") " pod="kuadrant-system/kuadrant-operator-catalog-jrq54"
Jul 22 15:20:33.409877 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.409841    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jrq54"
Jul 22 15:20:33.539294 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.539184    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jrq54"]
Jul 22 15:20:33.541880 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:20:33.541848    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd48a5080_c78e_4ee7_ac6d_3d97bd796cf9.slice/crio-5035d9df56765ce78d0a88faf4a412f7526f9d72c56b28fba52251976023e333 WatchSource:0}: Error finding container 5035d9df56765ce78d0a88faf4a412f7526f9d72c56b28fba52251976023e333: Status 404 returned error can't find the container with id 5035d9df56765ce78d0a88faf4a412f7526f9d72c56b28fba52251976023e333
Jul 22 15:20:33.619408 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.619340    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jrq54"]
Jul 22 15:20:33.627645 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.627616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jrq54" event={"ID":"d48a5080-c78e-4ee7-ac6d-3d97bd796cf9","Type":"ContainerStarted","Data":"5035d9df56765ce78d0a88faf4a412f7526f9d72c56b28fba52251976023e333"}
Jul 22 15:20:33.650568 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.650540    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pd8rt"]
Jul 22 15:20:33.655083 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.655067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pd8rt"
Jul 22 15:20:33.663869 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.663845    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pd8rt"]
Jul 22 15:20:33.744229 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.744193    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7dwn\" (UniqueName: \"kubernetes.io/projected/f84ac639-9452-455d-9d4a-803fefd54c8b-kube-api-access-l7dwn\") pod \"kuadrant-operator-catalog-pd8rt\" (UID: \"f84ac639-9452-455d-9d4a-803fefd54c8b\") " pod="kuadrant-system/kuadrant-operator-catalog-pd8rt"
Jul 22 15:20:33.845340 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.845017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7dwn\" (UniqueName: \"kubernetes.io/projected/f84ac639-9452-455d-9d4a-803fefd54c8b-kube-api-access-l7dwn\") pod \"kuadrant-operator-catalog-pd8rt\" (UID: \"f84ac639-9452-455d-9d4a-803fefd54c8b\") " pod="kuadrant-system/kuadrant-operator-catalog-pd8rt"
Jul 22 15:20:33.853706 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.853680    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7dwn\" (UniqueName: \"kubernetes.io/projected/f84ac639-9452-455d-9d4a-803fefd54c8b-kube-api-access-l7dwn\") pod \"kuadrant-operator-catalog-pd8rt\" (UID: \"f84ac639-9452-455d-9d4a-803fefd54c8b\") " pod="kuadrant-system/kuadrant-operator-catalog-pd8rt"
Jul 22 15:20:33.965872 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:33.965781    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pd8rt"
Jul 22 15:20:34.104331 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:34.104293    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pd8rt"]
Jul 22 15:20:34.106981 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:20:34.106957    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84ac639_9452_455d_9d4a_803fefd54c8b.slice/crio-6fd2e4d642a3e35d9cc07141fce9089b21fbe1dc2b1c02babd6ce36b9fc6894f WatchSource:0}: Error finding container 6fd2e4d642a3e35d9cc07141fce9089b21fbe1dc2b1c02babd6ce36b9fc6894f: Status 404 returned error can't find the container with id 6fd2e4d642a3e35d9cc07141fce9089b21fbe1dc2b1c02babd6ce36b9fc6894f
Jul 22 15:20:34.633909 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:34.633870    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pd8rt" event={"ID":"f84ac639-9452-455d-9d4a-803fefd54c8b","Type":"ContainerStarted","Data":"6fd2e4d642a3e35d9cc07141fce9089b21fbe1dc2b1c02babd6ce36b9fc6894f"}
Jul 22 15:20:36.643551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:36.643461    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jrq54" event={"ID":"d48a5080-c78e-4ee7-ac6d-3d97bd796cf9","Type":"ContainerStarted","Data":"5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06"}
Jul 22 15:20:36.643551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:36.643500    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jrq54" podUID="d48a5080-c78e-4ee7-ac6d-3d97bd796cf9" containerName="registry-server" containerID="cri-o://5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06" gracePeriod=2
Jul 22 15:20:36.645085 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:36.645056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pd8rt" event={"ID":"f84ac639-9452-455d-9d4a-803fefd54c8b","Type":"ContainerStarted","Data":"321dc136df5835cb32bb90012fc670e6e4f56f1c038e9f1cf14526cd58352464"}
Jul 22 15:20:36.659929 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:36.659880    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jrq54" podStartSLOduration=0.893927306 podStartE2EDuration="3.659866689s" totalImagesPullingTime="2.765939383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:20:36.659319955 +0000 UTC m=+460.322469376" watchObservedRunningTime="2026-07-22 15:20:36.659866689 +0000 UTC m=+460.323016110"
Jul 22 15:20:36.674617 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:36.674578    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pd8rt" podStartSLOduration=1.471140953 podStartE2EDuration="3.67456505s" totalImagesPullingTime="2.203424097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:20:36.673771387 +0000 UTC m=+460.336920810" watchObservedRunningTime="2026-07-22 15:20:36.67456505 +0000 UTC m=+460.337714490"
Jul 22 15:20:36.883209 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:36.883187    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jrq54"
Jul 22 15:20:36.972202 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:36.972100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mngbz\" (UniqueName: \"kubernetes.io/projected/d48a5080-c78e-4ee7-ac6d-3d97bd796cf9-kube-api-access-mngbz\") pod \"d48a5080-c78e-4ee7-ac6d-3d97bd796cf9\" (UID: \"d48a5080-c78e-4ee7-ac6d-3d97bd796cf9\") "
Jul 22 15:20:36.974258 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:36.974223    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d48a5080-c78e-4ee7-ac6d-3d97bd796cf9-kube-api-access-mngbz" (OuterVolumeSpecName: "kube-api-access-mngbz") pod "d48a5080-c78e-4ee7-ac6d-3d97bd796cf9" (UID: "d48a5080-c78e-4ee7-ac6d-3d97bd796cf9"). InnerVolumeSpecName "kube-api-access-mngbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:20:37.073563 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:37.073531    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mngbz\" (UniqueName: \"kubernetes.io/projected/d48a5080-c78e-4ee7-ac6d-3d97bd796cf9-kube-api-access-mngbz\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:20:37.650562 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:37.650477    2580 generic.go:356] "Generic (PLEG): container finished" podID="d48a5080-c78e-4ee7-ac6d-3d97bd796cf9" containerID="5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06" exitCode=0
Jul 22 15:20:37.650562 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:37.650521    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jrq54"
Jul 22 15:20:37.651055 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:37.650567    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jrq54" event={"ID":"d48a5080-c78e-4ee7-ac6d-3d97bd796cf9","Type":"ContainerDied","Data":"5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06"}
Jul 22 15:20:37.651055 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:37.650651    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jrq54" event={"ID":"d48a5080-c78e-4ee7-ac6d-3d97bd796cf9","Type":"ContainerDied","Data":"5035d9df56765ce78d0a88faf4a412f7526f9d72c56b28fba52251976023e333"}
Jul 22 15:20:37.651055 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:37.650684    2580 scope.go:117] "RemoveContainer" containerID="5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06"
Jul 22 15:20:37.660074 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:37.660059    2580 scope.go:117] "RemoveContainer" containerID="5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06"
Jul 22 15:20:37.660361 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:20:37.660341    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06\": container with ID starting with 5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06 not found: ID does not exist" containerID="5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06"
Jul 22 15:20:37.660411 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:37.660371    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06"} err="failed to get container status \"5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06\": rpc error: code = NotFound desc = could not find container \"5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06\": container with ID starting with 5ca859f50e11a7f8ec3d9002bdcd9b2eb1e23d70e19c94f7e738e671d82ebf06 not found: ID does not exist"
Jul 22 15:20:37.671546 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:37.671522    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jrq54"]
Jul 22 15:20:37.675420 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:37.675400    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jrq54"]
Jul 22 15:20:38.780075 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:38.780042    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d48a5080-c78e-4ee7-ac6d-3d97bd796cf9" path="/var/lib/kubelet/pods/d48a5080-c78e-4ee7-ac6d-3d97bd796cf9/volumes"
Jul 22 15:20:43.966248 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:43.966214    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pd8rt"
Jul 22 15:20:43.966675 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:43.966499    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pd8rt"
Jul 22 15:20:43.988292 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:43.988271    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pd8rt"
Jul 22 15:20:44.700604 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:20:44.700579    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pd8rt"
Jul 22 15:21:06.298006 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.297968    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"]
Jul 22 15:21:06.298394 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.298264    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d48a5080-c78e-4ee7-ac6d-3d97bd796cf9" containerName="registry-server"
Jul 22 15:21:06.298394 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.298273    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d48a5080-c78e-4ee7-ac6d-3d97bd796cf9" containerName="registry-server"
Jul 22 15:21:06.298394 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.298333    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d48a5080-c78e-4ee7-ac6d-3d97bd796cf9" containerName="registry-server"
Jul 22 15:21:06.302612 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.302594    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:06.305894 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.305874    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9fx7l\""
Jul 22 15:21:06.312690 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.312666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"]
Jul 22 15:21:06.398174 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.398143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9btc5\" (UniqueName: \"kubernetes.io/projected/4fbd17a6-3f32-4b12-90a9-d31b7e4798f6-kube-api-access-9btc5\") pod \"limitador-operator-controller-manager-859d7b78bd-fqsbh\" (UID: \"4fbd17a6-3f32-4b12-90a9-d31b7e4798f6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:06.498724 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.498688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9btc5\" (UniqueName: \"kubernetes.io/projected/4fbd17a6-3f32-4b12-90a9-d31b7e4798f6-kube-api-access-9btc5\") pod \"limitador-operator-controller-manager-859d7b78bd-fqsbh\" (UID: \"4fbd17a6-3f32-4b12-90a9-d31b7e4798f6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:06.510464 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.510447    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9btc5\" (UniqueName: \"kubernetes.io/projected/4fbd17a6-3f32-4b12-90a9-d31b7e4798f6-kube-api-access-9btc5\") pod \"limitador-operator-controller-manager-859d7b78bd-fqsbh\" (UID: \"4fbd17a6-3f32-4b12-90a9-d31b7e4798f6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:06.612716 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.612638    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:06.763403 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:06.763380    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"]
Jul 22 15:21:06.765929 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:21:06.765894    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbd17a6_3f32_4b12_90a9_d31b7e4798f6.slice/crio-c2b596deea9006190f80beb8c9fc2965f1cb9361ae913af6eb9a7a01a5e0d80e WatchSource:0}: Error finding container c2b596deea9006190f80beb8c9fc2965f1cb9361ae913af6eb9a7a01a5e0d80e: Status 404 returned error can't find the container with id c2b596deea9006190f80beb8c9fc2965f1cb9361ae913af6eb9a7a01a5e0d80e
Jul 22 15:21:07.774771 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:07.774723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh" event={"ID":"4fbd17a6-3f32-4b12-90a9-d31b7e4798f6","Type":"ContainerStarted","Data":"c2b596deea9006190f80beb8c9fc2965f1cb9361ae913af6eb9a7a01a5e0d80e"}
Jul 22 15:21:08.783789 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:08.783752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh" event={"ID":"4fbd17a6-3f32-4b12-90a9-d31b7e4798f6","Type":"ContainerStarted","Data":"362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32"}
Jul 22 15:21:08.784239 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:08.783904    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:08.816713 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:08.816622    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh" podStartSLOduration=1.020870691 podStartE2EDuration="2.81660875s" totalImagesPullingTime="1.795738059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:21:08.815254778 +0000 UTC m=+492.478404199" watchObservedRunningTime="2026-07-22 15:21:08.81660875 +0000 UTC m=+492.479758171"
Jul 22 15:21:09.810671 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:09.810638    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h"]
Jul 22 15:21:09.818665 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:09.818644    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h"
Jul 22 15:21:09.821777 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:09.821755    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bp2bw\""
Jul 22 15:21:09.821875 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:09.821805    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 22 15:21:09.826590 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:09.826568    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h"]
Jul 22 15:21:09.926304 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:09.926265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh8x6\" (UniqueName: \"kubernetes.io/projected/0b61a989-397a-468c-a84e-d03d280e635a-kube-api-access-sh8x6\") pod \"dns-operator-controller-manager-864dd78c4c-c8p6h\" (UID: \"0b61a989-397a-468c-a84e-d03d280e635a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h"
Jul 22 15:21:10.026959 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:10.026890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8x6\" (UniqueName: \"kubernetes.io/projected/0b61a989-397a-468c-a84e-d03d280e635a-kube-api-access-sh8x6\") pod \"dns-operator-controller-manager-864dd78c4c-c8p6h\" (UID: \"0b61a989-397a-468c-a84e-d03d280e635a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h"
Jul 22 15:21:10.035522 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:10.035490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh8x6\" (UniqueName: \"kubernetes.io/projected/0b61a989-397a-468c-a84e-d03d280e635a-kube-api-access-sh8x6\") pod \"dns-operator-controller-manager-864dd78c4c-c8p6h\" (UID: \"0b61a989-397a-468c-a84e-d03d280e635a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h"
Jul 22 15:21:10.129144 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:10.129059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h"
Jul 22 15:21:10.264503 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:10.264475    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h"]
Jul 22 15:21:10.266770 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:21:10.266741    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b61a989_397a_468c_a84e_d03d280e635a.slice/crio-827c445ab8a8fd7fb0788faba423b45be80bdd56e8b544c46432170c546ab4c2 WatchSource:0}: Error finding container 827c445ab8a8fd7fb0788faba423b45be80bdd56e8b544c46432170c546ab4c2: Status 404 returned error can't find the container with id 827c445ab8a8fd7fb0788faba423b45be80bdd56e8b544c46432170c546ab4c2
Jul 22 15:21:10.793396 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:10.793354    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h" event={"ID":"0b61a989-397a-468c-a84e-d03d280e635a","Type":"ContainerStarted","Data":"827c445ab8a8fd7fb0788faba423b45be80bdd56e8b544c46432170c546ab4c2"}
Jul 22 15:21:12.803445 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:12.803410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h" event={"ID":"0b61a989-397a-468c-a84e-d03d280e635a","Type":"ContainerStarted","Data":"1ce466f3f89f5d91a3aceb00b4167a15c8e6cdb7ce74de8608a608a270cba472"}
Jul 22 15:21:12.803935 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:12.803538    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h"
Jul 22 15:21:12.823452 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:12.823406    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h" podStartSLOduration=2.022769088 podStartE2EDuration="3.8233915s" totalImagesPullingTime="1.800622412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:21:12.822731386 +0000 UTC m=+496.485880807" watchObservedRunningTime="2026-07-22 15:21:12.8233915 +0000 UTC m=+496.486540921"
Jul 22 15:21:14.742368 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:14.742331    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"]
Jul 22 15:21:14.745764 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:14.745748    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:14.748767 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:14.748739    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ps56l\""
Jul 22 15:21:14.762218 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:14.762192    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"]
Jul 22 15:21:14.875742 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:14.875713    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx95r\" (UniqueName: \"kubernetes.io/projected/a07a0842-eab9-411d-bb2b-5494179cc395-kube-api-access-tx95r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" (UID: \"a07a0842-eab9-411d-bb2b-5494179cc395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:14.875906 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:14.875768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a07a0842-eab9-411d-bb2b-5494179cc395-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" (UID: \"a07a0842-eab9-411d-bb2b-5494179cc395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:14.976644 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:14.976611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx95r\" (UniqueName: \"kubernetes.io/projected/a07a0842-eab9-411d-bb2b-5494179cc395-kube-api-access-tx95r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" (UID: \"a07a0842-eab9-411d-bb2b-5494179cc395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:14.976794 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:14.976666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a07a0842-eab9-411d-bb2b-5494179cc395-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" (UID: \"a07a0842-eab9-411d-bb2b-5494179cc395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:14.977017 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:14.977002    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a07a0842-eab9-411d-bb2b-5494179cc395-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" (UID: \"a07a0842-eab9-411d-bb2b-5494179cc395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:14.988201 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:14.988173    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx95r\" (UniqueName: \"kubernetes.io/projected/a07a0842-eab9-411d-bb2b-5494179cc395-kube-api-access-tx95r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" (UID: \"a07a0842-eab9-411d-bb2b-5494179cc395\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:15.055739 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:15.055652    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:15.190111 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:15.190091    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"]
Jul 22 15:21:15.192241 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:21:15.192208    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07a0842_eab9_411d_bb2b_5494179cc395.slice/crio-04c30bb8be995faca9eafad84ee454ce613447a3418a597bcdf49db509ec75d3 WatchSource:0}: Error finding container 04c30bb8be995faca9eafad84ee454ce613447a3418a597bcdf49db509ec75d3: Status 404 returned error can't find the container with id 04c30bb8be995faca9eafad84ee454ce613447a3418a597bcdf49db509ec75d3
Jul 22 15:21:15.817760 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:15.817727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr" event={"ID":"a07a0842-eab9-411d-bb2b-5494179cc395","Type":"ContainerStarted","Data":"04c30bb8be995faca9eafad84ee454ce613447a3418a597bcdf49db509ec75d3"}
Jul 22 15:21:18.457768 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:18.457735    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mc898"]
Jul 22 15:21:18.461098 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:18.461080    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mc898"
Jul 22 15:21:18.463739 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:18.463719    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-424s8\""
Jul 22 15:21:18.477549 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:18.477530    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mc898"]
Jul 22 15:21:18.510480 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:18.510456    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdtp8\" (UniqueName: \"kubernetes.io/projected/3adb4a3e-7f25-48a6-a4c7-340d46a17bd1-kube-api-access-kdtp8\") pod \"authorino-operator-75cc8d5cb7-mc898\" (UID: \"3adb4a3e-7f25-48a6-a4c7-340d46a17bd1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mc898"
Jul 22 15:21:18.611928 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:18.611881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdtp8\" (UniqueName: \"kubernetes.io/projected/3adb4a3e-7f25-48a6-a4c7-340d46a17bd1-kube-api-access-kdtp8\") pod \"authorino-operator-75cc8d5cb7-mc898\" (UID: \"3adb4a3e-7f25-48a6-a4c7-340d46a17bd1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mc898"
Jul 22 15:21:18.620799 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:18.620775    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdtp8\" (UniqueName: \"kubernetes.io/projected/3adb4a3e-7f25-48a6-a4c7-340d46a17bd1-kube-api-access-kdtp8\") pod \"authorino-operator-75cc8d5cb7-mc898\" (UID: \"3adb4a3e-7f25-48a6-a4c7-340d46a17bd1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mc898"
Jul 22 15:21:18.771146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:18.771115    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mc898"
Jul 22 15:21:18.927203 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:18.927169    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mc898"]
Jul 22 15:21:18.930778 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:21:18.930749    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adb4a3e_7f25_48a6_a4c7_340d46a17bd1.slice/crio-d3b1138854f62f1c221cd78953de8af03462b3dc2f6d63744c6d40236ad72cb5 WatchSource:0}: Error finding container d3b1138854f62f1c221cd78953de8af03462b3dc2f6d63744c6d40236ad72cb5: Status 404 returned error can't find the container with id d3b1138854f62f1c221cd78953de8af03462b3dc2f6d63744c6d40236ad72cb5
Jul 22 15:21:19.790574 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:19.790543    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:19.841539 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:19.841501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mc898" event={"ID":"3adb4a3e-7f25-48a6-a4c7-340d46a17bd1","Type":"ContainerStarted","Data":"d3b1138854f62f1c221cd78953de8af03462b3dc2f6d63744c6d40236ad72cb5"}
Jul 22 15:21:20.849441 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:20.849350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr" event={"ID":"a07a0842-eab9-411d-bb2b-5494179cc395","Type":"ContainerStarted","Data":"171716a5c927c91173d8ef1bd75b090362df5903044f6ea395f618db3f697008"}
Jul 22 15:21:20.849883 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:20.849440    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:20.889029 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:20.888964    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr" podStartSLOduration=1.5910601469999999 podStartE2EDuration="6.888944447s" totalImagesPullingTime="5.2978843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:21:20.886134204 +0000 UTC m=+504.549283625" watchObservedRunningTime="2026-07-22 15:21:20.888944447 +0000 UTC m=+504.552093865"
Jul 22 15:21:22.860288 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:22.860251    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mc898" event={"ID":"3adb4a3e-7f25-48a6-a4c7-340d46a17bd1","Type":"ContainerStarted","Data":"cbb3d72a353b27ab4aa5f3848abc1055ccbff3b3e6f8908faad03eeab04f8646"}
Jul 22 15:21:22.860748 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:22.860327    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mc898"
Jul 22 15:21:22.879219 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:22.879171    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mc898" podStartSLOduration=1.604406311 podStartE2EDuration="4.879155225s" totalImagesPullingTime="3.274748914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:21:22.877353735 +0000 UTC m=+506.540503157" watchObservedRunningTime="2026-07-22 15:21:22.879155225 +0000 UTC m=+506.542304645"
Jul 22 15:21:23.810140 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:23.810113    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-c8p6h"
Jul 22 15:21:31.856892 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:31.856857    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:33.680184 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.680145    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"]
Jul 22 15:21:33.683592 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.683573    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:33.686538 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.686505    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="1a99e3b2-8801-4522-a376-20b590570a56" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:33.702552 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.702530    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"]
Jul 22 15:21:33.753327 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.753299    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"]
Jul 22 15:21:33.753511 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.753486    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" containerName="manager" containerID="cri-o://171716a5c927c91173d8ef1bd75b090362df5903044f6ea395f618db3f697008" gracePeriod=2
Jul 22 15:21:33.761626 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.761587    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"]
Jul 22 15:21:33.773714 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.773693    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"]
Jul 22 15:21:33.773956 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.773937    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-rw9jq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v" podUID="1a99e3b2-8801-4522-a376-20b590570a56"
Jul 22 15:21:33.784520 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.784495    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"]
Jul 22 15:21:33.786380 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.786355    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"]
Jul 22 15:21:33.786678 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.786660    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" containerName="manager"
Jul 22 15:21:33.786747 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.786679    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" containerName="manager"
Jul 22 15:21:33.786789 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.786781    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" containerName="manager"
Jul 22 15:21:33.789729 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.789711    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:33.798060 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.798031    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"]
Jul 22 15:21:33.798248 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.798223    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh" podUID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" containerName="manager" containerID="cri-o://362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32" gracePeriod=2
Jul 22 15:21:33.807026 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.806978    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"]
Jul 22 15:21:33.810721 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.810700    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"]
Jul 22 15:21:33.810824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.810736    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"]
Jul 22 15:21:33.810824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.810808    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:21:33.826972 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.826948    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"]
Jul 22 15:21:33.832472 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.832441    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:33.834760 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.834731    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:33.836911 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.836883    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqsbh\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:33.845935 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.845893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw9jq\" (UniqueName: \"kubernetes.io/projected/1a99e3b2-8801-4522-a376-20b590570a56-kube-api-access-rw9jq\") pod \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" (UID: \"1a99e3b2-8801-4522-a376-20b590570a56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:33.846037 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.845968    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a99e3b2-8801-4522-a376-20b590570a56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" (UID: \"1a99e3b2-8801-4522-a376-20b590570a56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:33.867051 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.867028    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mc898"
Jul 22 15:21:33.871598 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.871575    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:33.874001 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.873975    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqsbh\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:33.909592 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.909562    2580 generic.go:356] "Generic (PLEG): container finished" podID="a07a0842-eab9-411d-bb2b-5494179cc395" containerID="171716a5c927c91173d8ef1bd75b090362df5903044f6ea395f618db3f697008" exitCode=0
Jul 22 15:21:33.909747 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.909656    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:33.912848 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.912817    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:33.916054 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.916026    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="1a99e3b2-8801-4522-a376-20b590570a56" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:33.917272 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.917235    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:33.918437 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.918407    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqsbh\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:33.920879 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.920851    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:33.923521 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.923491    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="1a99e3b2-8801-4522-a376-20b590570a56" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:33.925896 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.925868    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqsbh\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:33.947551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.947404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr2gt\" (UniqueName: \"kubernetes.io/projected/bdfb8048-b047-49e7-ba62-eb36b37e0408-kube-api-access-xr2gt\") pod \"kuadrant-operator-controller-manager-86878c769f-9r5fx\" (UID: \"bdfb8048-b047-49e7-ba62-eb36b37e0408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:21:33.947551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.947483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5f42\" (UniqueName: \"kubernetes.io/projected/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-kube-api-access-s5f42\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4lj5\" (UID: \"21e7f5a8-30ff-474c-b83c-c0b48bbc147b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:33.947551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.947544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9jq\" (UniqueName: \"kubernetes.io/projected/1a99e3b2-8801-4522-a376-20b590570a56-kube-api-access-rw9jq\") pod \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" (UID: \"1a99e3b2-8801-4522-a376-20b590570a56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:33.947820 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.947577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdfb8048-b047-49e7-ba62-eb36b37e0408-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9r5fx\" (UID: \"bdfb8048-b047-49e7-ba62-eb36b37e0408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:21:33.947820 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.947627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a99e3b2-8801-4522-a376-20b590570a56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" (UID: \"1a99e3b2-8801-4522-a376-20b590570a56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:33.947820 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.947688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4lj5\" (UID: \"21e7f5a8-30ff-474c-b83c-c0b48bbc147b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:33.948174 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:33.948140    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a99e3b2-8801-4522-a376-20b590570a56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" (UID: \"1a99e3b2-8801-4522-a376-20b590570a56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:33.953912 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.953861    2580 projected.go:196] Error preparing data for projected volume kube-api-access-rw9jq for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-cxn9v" not found
Jul 22 15:21:33.954040 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:33.953947    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a99e3b2-8801-4522-a376-20b590570a56-kube-api-access-rw9jq podName:1a99e3b2-8801-4522-a376-20b590570a56 nodeName:}" failed. No retries permitted until 2026-07-22 15:21:34.45392701 +0000 UTC m=+518.117076426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rw9jq" (UniqueName: "kubernetes.io/projected/1a99e3b2-8801-4522-a376-20b590570a56-kube-api-access-rw9jq") pod "kuadrant-operator-controller-manager-86878c769f-cxn9v" (UID: "1a99e3b2-8801-4522-a376-20b590570a56") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-cxn9v" not found
Jul 22 15:21:34.045545 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.045520    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:34.048155 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.048131    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a99e3b2-8801-4522-a376-20b590570a56-extensions-socket-volume\") pod \"1a99e3b2-8801-4522-a376-20b590570a56\" (UID: \"1a99e3b2-8801-4522-a376-20b590570a56\") "
Jul 22 15:21:34.048271 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:34.048172    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:34.048347 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.048329    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr2gt\" (UniqueName: \"kubernetes.io/projected/bdfb8048-b047-49e7-ba62-eb36b37e0408-kube-api-access-xr2gt\") pod \"kuadrant-operator-controller-manager-86878c769f-9r5fx\" (UID: \"bdfb8048-b047-49e7-ba62-eb36b37e0408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:21:34.048403 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.048347    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a99e3b2-8801-4522-a376-20b590570a56-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1a99e3b2-8801-4522-a376-20b590570a56" (UID: "1a99e3b2-8801-4522-a376-20b590570a56"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:21:34.048453 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.048403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5f42\" (UniqueName: \"kubernetes.io/projected/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-kube-api-access-s5f42\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4lj5\" (UID: \"21e7f5a8-30ff-474c-b83c-c0b48bbc147b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:34.048504 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.048452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdfb8048-b047-49e7-ba62-eb36b37e0408-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9r5fx\" (UID: \"bdfb8048-b047-49e7-ba62-eb36b37e0408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:21:34.048558 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.048527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4lj5\" (UID: \"21e7f5a8-30ff-474c-b83c-c0b48bbc147b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:34.048620 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.048577    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw9jq\" (UniqueName: \"kubernetes.io/projected/1a99e3b2-8801-4522-a376-20b590570a56-kube-api-access-rw9jq\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:21:34.048620 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.048597    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a99e3b2-8801-4522-a376-20b590570a56-extensions-socket-volume\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:21:34.048896 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.048874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdfb8048-b047-49e7-ba62-eb36b37e0408-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9r5fx\" (UID: \"bdfb8048-b047-49e7-ba62-eb36b37e0408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:21:34.048957 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.048874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4lj5\" (UID: \"21e7f5a8-30ff-474c-b83c-c0b48bbc147b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:34.051104 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:34.051068    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="1a99e3b2-8801-4522-a376-20b590570a56" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:34.053197 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:34.053168    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqsbh\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:34.064542 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.064517    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:34.065470 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.065447    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5f42\" (UniqueName: \"kubernetes.io/projected/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-kube-api-access-s5f42\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v4lj5\" (UID: \"21e7f5a8-30ff-474c-b83c-c0b48bbc147b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:34.067119 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:34.067089    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nr5mr\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:34.067633 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.067613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr2gt\" (UniqueName: \"kubernetes.io/projected/bdfb8048-b047-49e7-ba62-eb36b37e0408-kube-api-access-xr2gt\") pod \"kuadrant-operator-controller-manager-86878c769f-9r5fx\" (UID: \"bdfb8048-b047-49e7-ba62-eb36b37e0408\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:21:34.069389 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:34.069369    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="1a99e3b2-8801-4522-a376-20b590570a56" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:34.071682 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:34.071659    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqsbh\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:34.149794 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.149764    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx95r\" (UniqueName: \"kubernetes.io/projected/a07a0842-eab9-411d-bb2b-5494179cc395-kube-api-access-tx95r\") pod \"a07a0842-eab9-411d-bb2b-5494179cc395\" (UID: \"a07a0842-eab9-411d-bb2b-5494179cc395\") "
Jul 22 15:21:34.149949 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.149840    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a07a0842-eab9-411d-bb2b-5494179cc395-extensions-socket-volume\") pod \"a07a0842-eab9-411d-bb2b-5494179cc395\" (UID: \"a07a0842-eab9-411d-bb2b-5494179cc395\") "
Jul 22 15:21:34.150345 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.150323    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a07a0842-eab9-411d-bb2b-5494179cc395-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a07a0842-eab9-411d-bb2b-5494179cc395" (UID: "a07a0842-eab9-411d-bb2b-5494179cc395"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:21:34.151780 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.151756    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a07a0842-eab9-411d-bb2b-5494179cc395-kube-api-access-tx95r" (OuterVolumeSpecName: "kube-api-access-tx95r") pod "a07a0842-eab9-411d-bb2b-5494179cc395" (UID: "a07a0842-eab9-411d-bb2b-5494179cc395"). InnerVolumeSpecName "kube-api-access-tx95r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:21:34.179110 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.179082    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:34.184020 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.184001    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:21:34.250876 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.250849    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9btc5\" (UniqueName: \"kubernetes.io/projected/4fbd17a6-3f32-4b12-90a9-d31b7e4798f6-kube-api-access-9btc5\") pod \"4fbd17a6-3f32-4b12-90a9-d31b7e4798f6\" (UID: \"4fbd17a6-3f32-4b12-90a9-d31b7e4798f6\") "
Jul 22 15:21:34.251148 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.251087    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx95r\" (UniqueName: \"kubernetes.io/projected/a07a0842-eab9-411d-bb2b-5494179cc395-kube-api-access-tx95r\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:21:34.251148 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.251108    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a07a0842-eab9-411d-bb2b-5494179cc395-extensions-socket-volume\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:21:34.253166 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.253141    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fbd17a6-3f32-4b12-90a9-d31b7e4798f6-kube-api-access-9btc5" (OuterVolumeSpecName: "kube-api-access-9btc5") pod "4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" (UID: "4fbd17a6-3f32-4b12-90a9-d31b7e4798f6"). InnerVolumeSpecName "kube-api-access-9btc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:21:34.346697 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.346671    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"]
Jul 22 15:21:34.350985 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:21:34.350953    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e7f5a8_30ff_474c_b83c_c0b48bbc147b.slice/crio-88f587d84f5ba021fe604b1792425d9dd287692002aac4b720db0fa2010e8c50 WatchSource:0}: Error finding container 88f587d84f5ba021fe604b1792425d9dd287692002aac4b720db0fa2010e8c50: Status 404 returned error can't find the container with id 88f587d84f5ba021fe604b1792425d9dd287692002aac4b720db0fa2010e8c50
Jul 22 15:21:34.352481 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.352448    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9btc5\" (UniqueName: \"kubernetes.io/projected/4fbd17a6-3f32-4b12-90a9-d31b7e4798f6-kube-api-access-9btc5\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:21:34.374122 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.374101    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"]
Jul 22 15:21:34.384060 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:21:34.384036    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdfb8048_b047_49e7_ba62_eb36b37e0408.slice/crio-e98baf9b88472c285558db75dd84dc5f9d64769e756f529c4543f39b721aa24f WatchSource:0}: Error finding container e98baf9b88472c285558db75dd84dc5f9d64769e756f529c4543f39b721aa24f: Status 404 returned error can't find the container with id e98baf9b88472c285558db75dd84dc5f9d64769e756f529c4543f39b721aa24f
Jul 22 15:21:34.781692 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.781662    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a99e3b2-8801-4522-a376-20b590570a56" path="/var/lib/kubelet/pods/1a99e3b2-8801-4522-a376-20b590570a56/volumes"
Jul 22 15:21:34.782016 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.781882    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" path="/var/lib/kubelet/pods/4fbd17a6-3f32-4b12-90a9-d31b7e4798f6/volumes"
Jul 22 15:21:34.782217 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.782204    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a07a0842-eab9-411d-bb2b-5494179cc395" path="/var/lib/kubelet/pods/a07a0842-eab9-411d-bb2b-5494179cc395/volumes"
Jul 22 15:21:34.915485 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.915445    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5" event={"ID":"21e7f5a8-30ff-474c-b83c-c0b48bbc147b","Type":"ContainerStarted","Data":"18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1"}
Jul 22 15:21:34.915689 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.915517    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5" event={"ID":"21e7f5a8-30ff-474c-b83c-c0b48bbc147b","Type":"ContainerStarted","Data":"88f587d84f5ba021fe604b1792425d9dd287692002aac4b720db0fa2010e8c50"}
Jul 22 15:21:34.915689 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.915563    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:34.916711 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.916684    2580 generic.go:356] "Generic (PLEG): container finished" podID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" containerID="362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32" exitCode=0
Jul 22 15:21:34.916839 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.916738    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqsbh"
Jul 22 15:21:34.916839 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.916767    2580 scope.go:117] "RemoveContainer" containerID="362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32"
Jul 22 15:21:34.918222 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.918203    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nr5mr"
Jul 22 15:21:34.919977 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.919951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx" event={"ID":"bdfb8048-b047-49e7-ba62-eb36b37e0408","Type":"ContainerStarted","Data":"fb2bfcf2c1fbce2fda5e3e8d38dcd90d8880ac0a3d39619be7b11e8d5408e5fb"}
Jul 22 15:21:34.919977 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.919971    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:34.920149 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.920001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx" event={"ID":"bdfb8048-b047-49e7-ba62-eb36b37e0408","Type":"ContainerStarted","Data":"e98baf9b88472c285558db75dd84dc5f9d64769e756f529c4543f39b721aa24f"}
Jul 22 15:21:34.920149 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.920089    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:21:34.926517 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.926499    2580 scope.go:117] "RemoveContainer" containerID="362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32"
Jul 22 15:21:34.926776 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:34.926753    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32\": container with ID starting with 362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32 not found: ID does not exist" containerID="362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32"
Jul 22 15:21:34.926844 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.926784    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32"} err="failed to get container status \"362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32\": rpc error: code = NotFound desc = could not find container \"362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32\": container with ID starting with 362723ffbb7fad9a9ae47f25e68bbe0856791cf61e5e211ab12e94cb408b9f32 not found: ID does not exist"
Jul 22 15:21:34.926844 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.926801    2580 scope.go:117] "RemoveContainer" containerID="171716a5c927c91173d8ef1bd75b090362df5903044f6ea395f618db3f697008"
Jul 22 15:21:34.956415 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.956376    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5" podStartSLOduration=1.9563634589999999 podStartE2EDuration="1.956363459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:21:34.952451744 +0000 UTC m=+518.615601236" watchObservedRunningTime="2026-07-22 15:21:34.956363459 +0000 UTC m=+518.619512913"
Jul 22 15:21:34.989436 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:34.989391    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx" podStartSLOduration=1.989377462 podStartE2EDuration="1.989377462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:21:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:21:34.9877892 +0000 UTC m=+518.650938622" watchObservedRunningTime="2026-07-22 15:21:34.989377462 +0000 UTC m=+518.652526883"
Jul 22 15:21:34.990857 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:34.990836    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="1a99e3b2-8801-4522-a376-20b590570a56" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:36.779760 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:36.779718    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-cxn9v\" is forbidden: User \"system:node:ip-10-0-133-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-167.ec2.internal' and this object" podUID="1a99e3b2-8801-4522-a376-20b590570a56" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cxn9v"
Jul 22 15:21:45.929000 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:45.928968    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:21:45.929483 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:45.929051    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:46.007089 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.007057    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"]
Jul 22 15:21:46.007297 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.007274    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5" podUID="21e7f5a8-30ff-474c-b83c-c0b48bbc147b" containerName="manager" containerID="cri-o://18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1" gracePeriod=10
Jul 22 15:21:46.258563 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.258538    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:46.341169 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.341142    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5f42\" (UniqueName: \"kubernetes.io/projected/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-kube-api-access-s5f42\") pod \"21e7f5a8-30ff-474c-b83c-c0b48bbc147b\" (UID: \"21e7f5a8-30ff-474c-b83c-c0b48bbc147b\") "
Jul 22 15:21:46.341336 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.341204    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-extensions-socket-volume\") pod \"21e7f5a8-30ff-474c-b83c-c0b48bbc147b\" (UID: \"21e7f5a8-30ff-474c-b83c-c0b48bbc147b\") "
Jul 22 15:21:46.341528 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.341502    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "21e7f5a8-30ff-474c-b83c-c0b48bbc147b" (UID: "21e7f5a8-30ff-474c-b83c-c0b48bbc147b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:21:46.343027 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.343002    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-kube-api-access-s5f42" (OuterVolumeSpecName: "kube-api-access-s5f42") pod "21e7f5a8-30ff-474c-b83c-c0b48bbc147b" (UID: "21e7f5a8-30ff-474c-b83c-c0b48bbc147b"). InnerVolumeSpecName "kube-api-access-s5f42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:21:46.442084 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.442045    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5f42\" (UniqueName: \"kubernetes.io/projected/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-kube-api-access-s5f42\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:21:46.442084 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.442073    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21e7f5a8-30ff-474c-b83c-c0b48bbc147b-extensions-socket-volume\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:21:46.973850 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.973815    2580 generic.go:356] "Generic (PLEG): container finished" podID="21e7f5a8-30ff-474c-b83c-c0b48bbc147b" containerID="18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1" exitCode=0
Jul 22 15:21:46.974297 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.973870    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"
Jul 22 15:21:46.974297 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.973879    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5" event={"ID":"21e7f5a8-30ff-474c-b83c-c0b48bbc147b","Type":"ContainerDied","Data":"18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1"}
Jul 22 15:21:46.974297 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.973948    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5" event={"ID":"21e7f5a8-30ff-474c-b83c-c0b48bbc147b","Type":"ContainerDied","Data":"88f587d84f5ba021fe604b1792425d9dd287692002aac4b720db0fa2010e8c50"}
Jul 22 15:21:46.974297 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.973974    2580 scope.go:117] "RemoveContainer" containerID="18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1"
Jul 22 15:21:46.982146 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.982129    2580 scope.go:117] "RemoveContainer" containerID="18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1"
Jul 22 15:21:46.982387 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:21:46.982368    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1\": container with ID starting with 18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1 not found: ID does not exist" containerID="18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1"
Jul 22 15:21:46.982434 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:46.982396    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1"} err="failed to get container status \"18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1\": rpc error: code = NotFound desc = could not find container \"18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1\": container with ID starting with 18c8a8833fc1825e58c48290e7a6017bb87431a40d7bbb8a9a6fe03d6d5cded1 not found: ID does not exist"
Jul 22 15:21:47.002422 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:47.002396    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"]
Jul 22 15:21:47.006509 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:47.006490    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v4lj5"]
Jul 22 15:21:48.780395 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:21:48.780325    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21e7f5a8-30ff-474c-b83c-c0b48bbc147b" path="/var/lib/kubelet/pods/21e7f5a8-30ff-474c-b83c-c0b48bbc147b/volumes"
Jul 22 15:22:02.373545 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.373511    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"]
Jul 22 15:22:02.373983 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.373856    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" containerName="manager"
Jul 22 15:22:02.373983 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.373868    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" containerName="manager"
Jul 22 15:22:02.373983 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.373879    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e7f5a8-30ff-474c-b83c-c0b48bbc147b" containerName="manager"
Jul 22 15:22:02.373983 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.373885    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e7f5a8-30ff-474c-b83c-c0b48bbc147b" containerName="manager"
Jul 22 15:22:02.373983 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.373954    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fbd17a6-3f32-4b12-90a9-d31b7e4798f6" containerName="manager"
Jul 22 15:22:02.373983 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.373963    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e7f5a8-30ff-474c-b83c-c0b48bbc147b" containerName="manager"
Jul 22 15:22:02.379710 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.379690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.382388 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.382366    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tbws6\""
Jul 22 15:22:02.393171 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.393148    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"]
Jul 22 15:22:02.472696 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.472660    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdqzr\" (UniqueName: \"kubernetes.io/projected/3327f692-983e-4835-9815-3a85f2634d75-kube-api-access-jdqzr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.472878 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.472703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.472878 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.472723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.472878 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.472794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3327f692-983e-4835-9815-3a85f2634d75-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.472878 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.472869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3327f692-983e-4835-9815-3a85f2634d75-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.473114 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.472911    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3327f692-983e-4835-9815-3a85f2634d75-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.473114 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.472972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.473114 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.473030    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.473114 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.473059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.574487 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.574453    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.574487 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.574489    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.574734 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.574516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdqzr\" (UniqueName: \"kubernetes.io/projected/3327f692-983e-4835-9815-3a85f2634d75-kube-api-access-jdqzr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.574734 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.574544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.574734 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.574567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.574734 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.574610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3327f692-983e-4835-9815-3a85f2634d75-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.574734 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.574662    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3327f692-983e-4835-9815-3a85f2634d75-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.574734 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.574699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3327f692-983e-4835-9815-3a85f2634d75-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.575135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.574738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.575469 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.575440    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.575469 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.575454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.575469 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.575464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3327f692-983e-4835-9815-3a85f2634d75-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.575646 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.575507    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.575751 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.575721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.577649 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.577623    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3327f692-983e-4835-9815-3a85f2634d75-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.577791 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.577772    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3327f692-983e-4835-9815-3a85f2634d75-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.585291 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.585270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3327f692-983e-4835-9815-3a85f2634d75-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.585562 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.585544    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdqzr\" (UniqueName: \"kubernetes.io/projected/3327f692-983e-4835-9815-3a85f2634d75-kube-api-access-jdqzr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-9nlnb\" (UID: \"3327f692-983e-4835-9815-3a85f2634d75\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.693601 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.693514    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:02.829733 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.829666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"]
Jul 22 15:22:02.831859 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:22:02.831829    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3327f692_983e_4835_9815_3a85f2634d75.slice/crio-576a95cd14283d8e22117b3c99e4eeaae2c5c3bc6d3e7ad00913e7138d28fab7 WatchSource:0}: Error finding container 576a95cd14283d8e22117b3c99e4eeaae2c5c3bc6d3e7ad00913e7138d28fab7: Status 404 returned error can't find the container with id 576a95cd14283d8e22117b3c99e4eeaae2c5c3bc6d3e7ad00913e7138d28fab7
Jul 22 15:22:02.833896 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.833864    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:22:02.833970 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.833954    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:22:02.834015 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:02.833984    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:22:03.046432 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:03.046396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb" event={"ID":"3327f692-983e-4835-9815-3a85f2634d75","Type":"ContainerStarted","Data":"110cffd4ca851098ca760100edaf4d192728519e566535e2b632e2671c27de18"}
Jul 22 15:22:03.046602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:03.046451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb" event={"ID":"3327f692-983e-4835-9815-3a85f2634d75","Type":"ContainerStarted","Data":"576a95cd14283d8e22117b3c99e4eeaae2c5c3bc6d3e7ad00913e7138d28fab7"}
Jul 22 15:22:03.082302 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:03.082256    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb" podStartSLOduration=1.082239564 podStartE2EDuration="1.082239564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:22:03.08071158 +0000 UTC m=+546.743861001" watchObservedRunningTime="2026-07-22 15:22:03.082239564 +0000 UTC m=+546.745388985"
Jul 22 15:22:03.693972 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:03.693943    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:03.698389 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:03.698360    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:04.050677 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.050643    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:04.051556 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.051537    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:22:04.848174 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.848140    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-vswwl"]
Jul 22 15:22:04.851619 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.851598    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vswwl"
Jul 22 15:22:04.854228 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.854207    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xrngw\""
Jul 22 15:22:04.860283 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.860259    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vswwl"]
Jul 22 15:22:04.893418 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.893387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7srw\" (UniqueName: \"kubernetes.io/projected/c42b0084-2e19-458b-a439-4a1020031e00-kube-api-access-n7srw\") pod \"authorino-58cd955675-vswwl\" (UID: \"c42b0084-2e19-458b-a439-4a1020031e00\") " pod="kuadrant-system/authorino-58cd955675-vswwl"
Jul 22 15:22:04.959993 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.959960    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-4wjg9"]
Jul 22 15:22:04.963124 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.963103    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4wjg9"
Jul 22 15:22:04.970752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.970726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4wjg9"]
Jul 22 15:22:04.994378 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.994354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7srw\" (UniqueName: \"kubernetes.io/projected/c42b0084-2e19-458b-a439-4a1020031e00-kube-api-access-n7srw\") pod \"authorino-58cd955675-vswwl\" (UID: \"c42b0084-2e19-458b-a439-4a1020031e00\") " pod="kuadrant-system/authorino-58cd955675-vswwl"
Jul 22 15:22:04.994495 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:04.994413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2758v\" (UniqueName: \"kubernetes.io/projected/32079289-b899-4001-9f73-49fc1b5909b5-kube-api-access-2758v\") pod \"authorino-75d556bd77-4wjg9\" (UID: \"32079289-b899-4001-9f73-49fc1b5909b5\") " pod="kuadrant-system/authorino-75d556bd77-4wjg9"
Jul 22 15:22:05.002632 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:05.002609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7srw\" (UniqueName: \"kubernetes.io/projected/c42b0084-2e19-458b-a439-4a1020031e00-kube-api-access-n7srw\") pod \"authorino-58cd955675-vswwl\" (UID: \"c42b0084-2e19-458b-a439-4a1020031e00\") " pod="kuadrant-system/authorino-58cd955675-vswwl"
Jul 22 15:22:05.095003 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:05.094972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2758v\" (UniqueName: \"kubernetes.io/projected/32079289-b899-4001-9f73-49fc1b5909b5-kube-api-access-2758v\") pod \"authorino-75d556bd77-4wjg9\" (UID: \"32079289-b899-4001-9f73-49fc1b5909b5\") " pod="kuadrant-system/authorino-75d556bd77-4wjg9"
Jul 22 15:22:05.103168 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:05.103107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2758v\" (UniqueName: \"kubernetes.io/projected/32079289-b899-4001-9f73-49fc1b5909b5-kube-api-access-2758v\") pod \"authorino-75d556bd77-4wjg9\" (UID: \"32079289-b899-4001-9f73-49fc1b5909b5\") " pod="kuadrant-system/authorino-75d556bd77-4wjg9"
Jul 22 15:22:05.161857 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:05.161828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vswwl"
Jul 22 15:22:05.273438 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:05.273403    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4wjg9"
Jul 22 15:22:05.292808 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:05.292785    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vswwl"]
Jul 22 15:22:05.294957 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:22:05.294927    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc42b0084_2e19_458b_a439_4a1020031e00.slice/crio-04a947e8f5e31ba59a178ad85550e3bdf44d5178cf940df2f0c6040ddd98cda2 WatchSource:0}: Error finding container 04a947e8f5e31ba59a178ad85550e3bdf44d5178cf940df2f0c6040ddd98cda2: Status 404 returned error can't find the container with id 04a947e8f5e31ba59a178ad85550e3bdf44d5178cf940df2f0c6040ddd98cda2
Jul 22 15:22:05.406984 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:05.406953    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4wjg9"]
Jul 22 15:22:05.409163 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:22:05.409133    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32079289_b899_4001_9f73_49fc1b5909b5.slice/crio-71c9f26f2408c40dd5b829f669726f81cf3785fb9a9a64f9c1416da0f9655271 WatchSource:0}: Error finding container 71c9f26f2408c40dd5b829f669726f81cf3785fb9a9a64f9c1416da0f9655271: Status 404 returned error can't find the container with id 71c9f26f2408c40dd5b829f669726f81cf3785fb9a9a64f9c1416da0f9655271
Jul 22 15:22:06.060364 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.060329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4wjg9" event={"ID":"32079289-b899-4001-9f73-49fc1b5909b5","Type":"ContainerStarted","Data":"71c9f26f2408c40dd5b829f669726f81cf3785fb9a9a64f9c1416da0f9655271"}
Jul 22 15:22:06.061468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.061442    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vswwl" event={"ID":"c42b0084-2e19-458b-a439-4a1020031e00","Type":"ContainerStarted","Data":"04a947e8f5e31ba59a178ad85550e3bdf44d5178cf940df2f0c6040ddd98cda2"}
Jul 22 15:22:06.292012 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.291977    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hcljd"]
Jul 22 15:22:06.296382 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.295943    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:06.300236 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.298866    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 15:22:06.300236 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.299116    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9z9zk\""
Jul 22 15:22:06.306702 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.306641    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hcljd"]
Jul 22 15:22:06.389501 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.389411    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hcljd"]
Jul 22 15:22:06.405046 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.405006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wv8r\" (UniqueName: \"kubernetes.io/projected/b5596a78-f88f-47d2-b35a-db33d396e978-kube-api-access-5wv8r\") pod \"limitador-limitador-64c94fd64f-hcljd\" (UID: \"b5596a78-f88f-47d2-b35a-db33d396e978\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:06.405212 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.405065    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5596a78-f88f-47d2-b35a-db33d396e978-config-file\") pod \"limitador-limitador-64c94fd64f-hcljd\" (UID: \"b5596a78-f88f-47d2-b35a-db33d396e978\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:06.507607 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.506373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wv8r\" (UniqueName: \"kubernetes.io/projected/b5596a78-f88f-47d2-b35a-db33d396e978-kube-api-access-5wv8r\") pod \"limitador-limitador-64c94fd64f-hcljd\" (UID: \"b5596a78-f88f-47d2-b35a-db33d396e978\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:06.507607 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.506421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5596a78-f88f-47d2-b35a-db33d396e978-config-file\") pod \"limitador-limitador-64c94fd64f-hcljd\" (UID: \"b5596a78-f88f-47d2-b35a-db33d396e978\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:06.507607 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.507196    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5596a78-f88f-47d2-b35a-db33d396e978-config-file\") pod \"limitador-limitador-64c94fd64f-hcljd\" (UID: \"b5596a78-f88f-47d2-b35a-db33d396e978\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:06.523183 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.522101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wv8r\" (UniqueName: \"kubernetes.io/projected/b5596a78-f88f-47d2-b35a-db33d396e978-kube-api-access-5wv8r\") pod \"limitador-limitador-64c94fd64f-hcljd\" (UID: \"b5596a78-f88f-47d2-b35a-db33d396e978\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:06.617822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.617454    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:06.841883 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:06.841856    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hcljd"]
Jul 22 15:22:07.071528 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:07.071489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd" event={"ID":"b5596a78-f88f-47d2-b35a-db33d396e978","Type":"ContainerStarted","Data":"6ebe72fd817391c54c0f0c4edc4612ee0b745f92a7bd380cebeb8427eda77d41"}
Jul 22 15:22:11.095223 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:11.095188    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4wjg9" event={"ID":"32079289-b899-4001-9f73-49fc1b5909b5","Type":"ContainerStarted","Data":"2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4"}
Jul 22 15:22:11.096649 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:11.096623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd" event={"ID":"b5596a78-f88f-47d2-b35a-db33d396e978","Type":"ContainerStarted","Data":"bc2c8b3620b64415c0daa7dc036f5ac9ab8b4656816ec9722345d1fd8b982500"}
Jul 22 15:22:11.096775 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:11.096692    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:11.098095 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:11.098072    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vswwl" event={"ID":"c42b0084-2e19-458b-a439-4a1020031e00","Type":"ContainerStarted","Data":"157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef"}
Jul 22 15:22:11.112559 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:11.112487    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-4wjg9" podStartSLOduration=2.019170134 podStartE2EDuration="7.112473109s" totalImagesPullingTime="5.093302975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:22:11.111458356 +0000 UTC m=+554.774607777" watchObservedRunningTime="2026-07-22 15:22:11.112473109 +0000 UTC m=+554.775622529"
Jul 22 15:22:11.128076 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:11.128028    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-vswwl" podStartSLOduration=2.11692977 podStartE2EDuration="7.128011228s" totalImagesPullingTime="5.011081458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:22:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:22:11.126350264 +0000 UTC m=+554.789499686" watchObservedRunningTime="2026-07-22 15:22:11.128011228 +0000 UTC m=+554.791160650"
Jul 22 15:22:11.143168 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:11.143124    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd" podStartSLOduration=1.435744238 podStartE2EDuration="5.143109s" totalImagesPullingTime="3.707364762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:22:11.14189144 +0000 UTC m=+554.805040864" watchObservedRunningTime="2026-07-22 15:22:11.143109 +0000 UTC m=+554.806258421"
Jul 22 15:22:11.159898 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:11.159869    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vswwl"]
Jul 22 15:22:13.107644 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:13.107605    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-vswwl" podUID="c42b0084-2e19-458b-a439-4a1020031e00" containerName="authorino" containerID="cri-o://157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef" gracePeriod=30
Jul 22 15:22:13.361888 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:13.361828    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vswwl"
Jul 22 15:22:13.468542 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:13.468510    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7srw\" (UniqueName: \"kubernetes.io/projected/c42b0084-2e19-458b-a439-4a1020031e00-kube-api-access-n7srw\") pod \"c42b0084-2e19-458b-a439-4a1020031e00\" (UID: \"c42b0084-2e19-458b-a439-4a1020031e00\") "
Jul 22 15:22:13.470551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:13.470517    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c42b0084-2e19-458b-a439-4a1020031e00-kube-api-access-n7srw" (OuterVolumeSpecName: "kube-api-access-n7srw") pod "c42b0084-2e19-458b-a439-4a1020031e00" (UID: "c42b0084-2e19-458b-a439-4a1020031e00"). InnerVolumeSpecName "kube-api-access-n7srw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:22:13.570091 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:13.570057    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7srw\" (UniqueName: \"kubernetes.io/projected/c42b0084-2e19-458b-a439-4a1020031e00-kube-api-access-n7srw\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:22:14.113569 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:14.113530    2580 generic.go:356] "Generic (PLEG): container finished" podID="c42b0084-2e19-458b-a439-4a1020031e00" containerID="157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef" exitCode=0
Jul 22 15:22:14.113569 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:14.113570    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vswwl"
Jul 22 15:22:14.114070 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:14.113595    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vswwl" event={"ID":"c42b0084-2e19-458b-a439-4a1020031e00","Type":"ContainerDied","Data":"157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef"}
Jul 22 15:22:14.114070 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:14.113633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vswwl" event={"ID":"c42b0084-2e19-458b-a439-4a1020031e00","Type":"ContainerDied","Data":"04a947e8f5e31ba59a178ad85550e3bdf44d5178cf940df2f0c6040ddd98cda2"}
Jul 22 15:22:14.114070 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:14.113652    2580 scope.go:117] "RemoveContainer" containerID="157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef"
Jul 22 15:22:14.122596 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:14.122576    2580 scope.go:117] "RemoveContainer" containerID="157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef"
Jul 22 15:22:14.122849 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:22:14.122832    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef\": container with ID starting with 157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef not found: ID does not exist" containerID="157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef"
Jul 22 15:22:14.122898 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:14.122859    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef"} err="failed to get container status \"157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef\": rpc error: code = NotFound desc = could not find container \"157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef\": container with ID starting with 157bb5e9e88db874d16c6a3b3c2955020ce651be31943ecc85c8c770984a39ef not found: ID does not exist"
Jul 22 15:22:14.134540 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:14.134514    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vswwl"]
Jul 22 15:22:14.140510 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:14.140490    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-vswwl"]
Jul 22 15:22:14.780104 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:14.780071    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c42b0084-2e19-458b-a439-4a1020031e00" path="/var/lib/kubelet/pods/c42b0084-2e19-458b-a439-4a1020031e00/volumes"
Jul 22 15:22:20.704715 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:20.704680    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hcljd"]
Jul 22 15:22:20.705354 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:20.704899    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd" podUID="b5596a78-f88f-47d2-b35a-db33d396e978" containerName="limitador" containerID="cri-o://bc2c8b3620b64415c0daa7dc036f5ac9ab8b4656816ec9722345d1fd8b982500" gracePeriod=30
Jul 22 15:22:20.705746 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:20.705625    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:21.148738 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:21.148708    2580 generic.go:356] "Generic (PLEG): container finished" podID="b5596a78-f88f-47d2-b35a-db33d396e978" containerID="bc2c8b3620b64415c0daa7dc036f5ac9ab8b4656816ec9722345d1fd8b982500" exitCode=0
Jul 22 15:22:21.148879 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:21.148777    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd" event={"ID":"b5596a78-f88f-47d2-b35a-db33d396e978","Type":"ContainerDied","Data":"bc2c8b3620b64415c0daa7dc036f5ac9ab8b4656816ec9722345d1fd8b982500"}
Jul 22 15:22:21.253500 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:21.253478    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:21.338064 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:21.337988    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wv8r\" (UniqueName: \"kubernetes.io/projected/b5596a78-f88f-47d2-b35a-db33d396e978-kube-api-access-5wv8r\") pod \"b5596a78-f88f-47d2-b35a-db33d396e978\" (UID: \"b5596a78-f88f-47d2-b35a-db33d396e978\") "
Jul 22 15:22:21.338209 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:21.338069    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5596a78-f88f-47d2-b35a-db33d396e978-config-file\") pod \"b5596a78-f88f-47d2-b35a-db33d396e978\" (UID: \"b5596a78-f88f-47d2-b35a-db33d396e978\") "
Jul 22 15:22:21.338445 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:21.338418    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5596a78-f88f-47d2-b35a-db33d396e978-config-file" (OuterVolumeSpecName: "config-file") pod "b5596a78-f88f-47d2-b35a-db33d396e978" (UID: "b5596a78-f88f-47d2-b35a-db33d396e978"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:22:21.340011 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:21.339988    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5596a78-f88f-47d2-b35a-db33d396e978-kube-api-access-5wv8r" (OuterVolumeSpecName: "kube-api-access-5wv8r") pod "b5596a78-f88f-47d2-b35a-db33d396e978" (UID: "b5596a78-f88f-47d2-b35a-db33d396e978"). InnerVolumeSpecName "kube-api-access-5wv8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:22:21.439632 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:21.439590    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5596a78-f88f-47d2-b35a-db33d396e978-config-file\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:22:21.439632 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:21.439628    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wv8r\" (UniqueName: \"kubernetes.io/projected/b5596a78-f88f-47d2-b35a-db33d396e978-kube-api-access-5wv8r\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:22:22.154548 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:22.154516    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd"
Jul 22 15:22:22.154548 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:22.154534    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hcljd" event={"ID":"b5596a78-f88f-47d2-b35a-db33d396e978","Type":"ContainerDied","Data":"6ebe72fd817391c54c0f0c4edc4612ee0b745f92a7bd380cebeb8427eda77d41"}
Jul 22 15:22:22.155091 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:22.154597    2580 scope.go:117] "RemoveContainer" containerID="bc2c8b3620b64415c0daa7dc036f5ac9ab8b4656816ec9722345d1fd8b982500"
Jul 22 15:22:22.179508 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:22.179461    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hcljd"]
Jul 22 15:22:22.182369 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:22.182346    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hcljd"]
Jul 22 15:22:22.780822 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:22.780795    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5596a78-f88f-47d2-b35a-db33d396e978" path="/var/lib/kubelet/pods/b5596a78-f88f-47d2-b35a-db33d396e978/volumes"
Jul 22 15:22:25.744051 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.744014    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"]
Jul 22 15:22:25.744510 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.744360    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c42b0084-2e19-458b-a439-4a1020031e00" containerName="authorino"
Jul 22 15:22:25.744510 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.744373    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c42b0084-2e19-458b-a439-4a1020031e00" containerName="authorino"
Jul 22 15:22:25.744510 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.744381    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5596a78-f88f-47d2-b35a-db33d396e978" containerName="limitador"
Jul 22 15:22:25.744510 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.744386    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5596a78-f88f-47d2-b35a-db33d396e978" containerName="limitador"
Jul 22 15:22:25.744510 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.744449    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5596a78-f88f-47d2-b35a-db33d396e978" containerName="limitador"
Jul 22 15:22:25.744510 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.744459    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c42b0084-2e19-458b-a439-4a1020031e00" containerName="authorino"
Jul 22 15:22:25.749029 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.749006    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"
Jul 22 15:22:25.751755 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.751736    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 22 15:22:25.751881 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.751774    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 15:22:25.751881 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.751870    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-lsm9w\""
Jul 22 15:22:25.752639 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.752623    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 15:22:25.756627 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.756525    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"]
Jul 22 15:22:25.879367 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.879333    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e65b68e-bc23-436b-93cd-98fe2ca2532f-data\") pod \"postgres-69fb4594cf-qsp94\" (UID: \"3e65b68e-bc23-436b-93cd-98fe2ca2532f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"
Jul 22 15:22:25.879558 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.879383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gv77\" (UniqueName: \"kubernetes.io/projected/3e65b68e-bc23-436b-93cd-98fe2ca2532f-kube-api-access-9gv77\") pod \"postgres-69fb4594cf-qsp94\" (UID: \"3e65b68e-bc23-436b-93cd-98fe2ca2532f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"
Jul 22 15:22:25.980718 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.980680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gv77\" (UniqueName: \"kubernetes.io/projected/3e65b68e-bc23-436b-93cd-98fe2ca2532f-kube-api-access-9gv77\") pod \"postgres-69fb4594cf-qsp94\" (UID: \"3e65b68e-bc23-436b-93cd-98fe2ca2532f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"
Jul 22 15:22:25.980882 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.980783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e65b68e-bc23-436b-93cd-98fe2ca2532f-data\") pod \"postgres-69fb4594cf-qsp94\" (UID: \"3e65b68e-bc23-436b-93cd-98fe2ca2532f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"
Jul 22 15:22:25.981204 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.981185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3e65b68e-bc23-436b-93cd-98fe2ca2532f-data\") pod \"postgres-69fb4594cf-qsp94\" (UID: \"3e65b68e-bc23-436b-93cd-98fe2ca2532f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"
Jul 22 15:22:25.989391 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:25.989369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gv77\" (UniqueName: \"kubernetes.io/projected/3e65b68e-bc23-436b-93cd-98fe2ca2532f-kube-api-access-9gv77\") pod \"postgres-69fb4594cf-qsp94\" (UID: \"3e65b68e-bc23-436b-93cd-98fe2ca2532f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"
Jul 22 15:22:26.060638 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:26.060570    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"
Jul 22 15:22:26.189747 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:26.189723    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"]
Jul 22 15:22:26.191183 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:22:26.191158    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e65b68e_bc23_436b_93cd_98fe2ca2532f.slice/crio-2a438ef517822fc81a0e26a6cc44c63e7256881e6fa4650623d265a21100c988 WatchSource:0}: Error finding container 2a438ef517822fc81a0e26a6cc44c63e7256881e6fa4650623d265a21100c988: Status 404 returned error can't find the container with id 2a438ef517822fc81a0e26a6cc44c63e7256881e6fa4650623d265a21100c988
Jul 22 15:22:27.183811 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:27.183776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94" event={"ID":"3e65b68e-bc23-436b-93cd-98fe2ca2532f","Type":"ContainerStarted","Data":"2a438ef517822fc81a0e26a6cc44c63e7256881e6fa4650623d265a21100c988"}
Jul 22 15:22:31.207379 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:31.207341    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94" event={"ID":"3e65b68e-bc23-436b-93cd-98fe2ca2532f","Type":"ContainerStarted","Data":"2ce641940fb63969aebf6560b25c7eeeb6fc29b52636525c105b0071fec18dc2"}
Jul 22 15:22:31.207736 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:31.207519    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"
Jul 22 15:22:31.225655 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:31.225607    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94" podStartSLOduration=1.401319831 podStartE2EDuration="6.225590916s" totalImagesPullingTime="4.824271085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:22:31.223870135 +0000 UTC m=+574.887019547" watchObservedRunningTime="2026-07-22 15:22:31.225590916 +0000 UTC m=+574.888740349"
Jul 22 15:22:37.241437 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:37.241403    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsp94"
Jul 22 15:22:37.773371 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:37.773337    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vvk8g"]
Jul 22 15:22:37.780180 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:37.780155    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vvk8g"
Jul 22 15:22:37.783899 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:37.783874    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vvk8g"]
Jul 22 15:22:37.889056 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:37.889022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dvmw\" (UniqueName: \"kubernetes.io/projected/5d628f84-6100-48e7-9a4d-0edcc04d17f4-kube-api-access-8dvmw\") pod \"authorino-5d4b67c446-vvk8g\" (UID: \"5d628f84-6100-48e7-9a4d-0edcc04d17f4\") " pod="kuadrant-system/authorino-5d4b67c446-vvk8g"
Jul 22 15:22:37.989893 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:37.989855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dvmw\" (UniqueName: \"kubernetes.io/projected/5d628f84-6100-48e7-9a4d-0edcc04d17f4-kube-api-access-8dvmw\") pod \"authorino-5d4b67c446-vvk8g\" (UID: \"5d628f84-6100-48e7-9a4d-0edcc04d17f4\") " pod="kuadrant-system/authorino-5d4b67c446-vvk8g"
Jul 22 15:22:37.998005 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:37.997975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dvmw\" (UniqueName: \"kubernetes.io/projected/5d628f84-6100-48e7-9a4d-0edcc04d17f4-kube-api-access-8dvmw\") pod \"authorino-5d4b67c446-vvk8g\" (UID: \"5d628f84-6100-48e7-9a4d-0edcc04d17f4\") " pod="kuadrant-system/authorino-5d4b67c446-vvk8g"
Jul 22 15:22:38.005946 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.005904    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vvk8g"]
Jul 22 15:22:38.006168 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.006156    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vvk8g"
Jul 22 15:22:38.030114 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.030052    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-577bffb948-j297z"]
Jul 22 15:22:38.035620 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.035596    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577bffb948-j297z"
Jul 22 15:22:38.045306 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.045280    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-577bffb948-j297z"]
Jul 22 15:22:38.143544 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.143513    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vvk8g"]
Jul 22 15:22:38.145941 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:22:38.145898    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d628f84_6100_48e7_9a4d_0edcc04d17f4.slice/crio-b64e15f2be2e3836c7434da03f07e6be819a61a989688b898ff4ba6e590714e4 WatchSource:0}: Error finding container b64e15f2be2e3836c7434da03f07e6be819a61a989688b898ff4ba6e590714e4: Status 404 returned error can't find the container with id b64e15f2be2e3836c7434da03f07e6be819a61a989688b898ff4ba6e590714e4
Jul 22 15:22:38.191963 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.191910    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5ljb\" (UniqueName: \"kubernetes.io/projected/3db81fda-44bb-4b8d-a215-69c03bf9ec1e-kube-api-access-n5ljb\") pod \"authorino-577bffb948-j297z\" (UID: \"3db81fda-44bb-4b8d-a215-69c03bf9ec1e\") " pod="kuadrant-system/authorino-577bffb948-j297z"
Jul 22 15:22:38.211954 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.211908    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-577bffb948-j297z"]
Jul 22 15:22:38.212167 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:22:38.212146    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-n5ljb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-577bffb948-j297z" podUID="3db81fda-44bb-4b8d-a215-69c03bf9ec1e"
Jul 22 15:22:38.238301 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.238268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vvk8g" event={"ID":"5d628f84-6100-48e7-9a4d-0edcc04d17f4","Type":"ContainerStarted","Data":"b64e15f2be2e3836c7434da03f07e6be819a61a989688b898ff4ba6e590714e4"}
Jul 22 15:22:38.238301 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.238289    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577bffb948-j297z"
Jul 22 15:22:38.240992 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.240967    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99895948-78qbh"]
Jul 22 15:22:38.245020 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.245002    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99895948-78qbh"
Jul 22 15:22:38.246086 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.246070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577bffb948-j297z"
Jul 22 15:22:38.247203 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.247187    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 22 15:22:38.256075 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.256054    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99895948-78qbh"]
Jul 22 15:22:38.292726 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.292663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5ljb\" (UniqueName: \"kubernetes.io/projected/3db81fda-44bb-4b8d-a215-69c03bf9ec1e-kube-api-access-n5ljb\") pod \"authorino-577bffb948-j297z\" (UID: \"3db81fda-44bb-4b8d-a215-69c03bf9ec1e\") " pod="kuadrant-system/authorino-577bffb948-j297z"
Jul 22 15:22:38.300500 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.300480    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5ljb\" (UniqueName: \"kubernetes.io/projected/3db81fda-44bb-4b8d-a215-69c03bf9ec1e-kube-api-access-n5ljb\") pod \"authorino-577bffb948-j297z\" (UID: \"3db81fda-44bb-4b8d-a215-69c03bf9ec1e\") " pod="kuadrant-system/authorino-577bffb948-j297z"
Jul 22 15:22:38.393338 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.393305    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5ljb\" (UniqueName: \"kubernetes.io/projected/3db81fda-44bb-4b8d-a215-69c03bf9ec1e-kube-api-access-n5ljb\") pod \"3db81fda-44bb-4b8d-a215-69c03bf9ec1e\" (UID: \"3db81fda-44bb-4b8d-a215-69c03bf9ec1e\") "
Jul 22 15:22:38.393508 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.393493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cngn7\" (UniqueName: \"kubernetes.io/projected/5a3aa3d8-fd6c-4040-a807-c21416304f6c-kube-api-access-cngn7\") pod \"authorino-f99895948-78qbh\" (UID: \"5a3aa3d8-fd6c-4040-a807-c21416304f6c\") " pod="kuadrant-system/authorino-f99895948-78qbh"
Jul 22 15:22:38.393566 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.393523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a3aa3d8-fd6c-4040-a807-c21416304f6c-tls-cert\") pod \"authorino-f99895948-78qbh\" (UID: \"5a3aa3d8-fd6c-4040-a807-c21416304f6c\") " pod="kuadrant-system/authorino-f99895948-78qbh"
Jul 22 15:22:38.395337 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.395312    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db81fda-44bb-4b8d-a215-69c03bf9ec1e-kube-api-access-n5ljb" (OuterVolumeSpecName: "kube-api-access-n5ljb") pod "3db81fda-44bb-4b8d-a215-69c03bf9ec1e" (UID: "3db81fda-44bb-4b8d-a215-69c03bf9ec1e"). InnerVolumeSpecName "kube-api-access-n5ljb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:22:38.494700 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.494654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cngn7\" (UniqueName: \"kubernetes.io/projected/5a3aa3d8-fd6c-4040-a807-c21416304f6c-kube-api-access-cngn7\") pod \"authorino-f99895948-78qbh\" (UID: \"5a3aa3d8-fd6c-4040-a807-c21416304f6c\") " pod="kuadrant-system/authorino-f99895948-78qbh"
Jul 22 15:22:38.494700 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.494706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a3aa3d8-fd6c-4040-a807-c21416304f6c-tls-cert\") pod \"authorino-f99895948-78qbh\" (UID: \"5a3aa3d8-fd6c-4040-a807-c21416304f6c\") " pod="kuadrant-system/authorino-f99895948-78qbh"
Jul 22 15:22:38.494886 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.494736    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5ljb\" (UniqueName: \"kubernetes.io/projected/3db81fda-44bb-4b8d-a215-69c03bf9ec1e-kube-api-access-n5ljb\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:22:38.497031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.497011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a3aa3d8-fd6c-4040-a807-c21416304f6c-tls-cert\") pod \"authorino-f99895948-78qbh\" (UID: \"5a3aa3d8-fd6c-4040-a807-c21416304f6c\") " pod="kuadrant-system/authorino-f99895948-78qbh"
Jul 22 15:22:38.502194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.502176    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cngn7\" (UniqueName: \"kubernetes.io/projected/5a3aa3d8-fd6c-4040-a807-c21416304f6c-kube-api-access-cngn7\") pod \"authorino-f99895948-78qbh\" (UID: \"5a3aa3d8-fd6c-4040-a807-c21416304f6c\") " pod="kuadrant-system/authorino-f99895948-78qbh"
Jul 22 15:22:38.553165 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.553096    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99895948-78qbh"
Jul 22 15:22:38.683895 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:38.683875    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99895948-78qbh"]
Jul 22 15:22:38.689969 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:22:38.689944    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a3aa3d8_fd6c_4040_a807_c21416304f6c.slice/crio-5ddb7337f1cf77fad36710138631fa2b2829592b29f27a213f5c5016a31262b4 WatchSource:0}: Error finding container 5ddb7337f1cf77fad36710138631fa2b2829592b29f27a213f5c5016a31262b4: Status 404 returned error can't find the container with id 5ddb7337f1cf77fad36710138631fa2b2829592b29f27a213f5c5016a31262b4
Jul 22 15:22:39.244705 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.244664    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vvk8g" event={"ID":"5d628f84-6100-48e7-9a4d-0edcc04d17f4","Type":"ContainerStarted","Data":"f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099"}
Jul 22 15:22:39.244705 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.244674    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-vvk8g" podUID="5d628f84-6100-48e7-9a4d-0edcc04d17f4" containerName="authorino" containerID="cri-o://f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099" gracePeriod=30
Jul 22 15:22:39.246225 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.246203    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577bffb948-j297z"
Jul 22 15:22:39.246545 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.246231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99895948-78qbh" event={"ID":"5a3aa3d8-fd6c-4040-a807-c21416304f6c","Type":"ContainerStarted","Data":"676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729"}
Jul 22 15:22:39.246545 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.246272    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99895948-78qbh" event={"ID":"5a3aa3d8-fd6c-4040-a807-c21416304f6c","Type":"ContainerStarted","Data":"5ddb7337f1cf77fad36710138631fa2b2829592b29f27a213f5c5016a31262b4"}
Jul 22 15:22:39.260602 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.260543    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-vvk8g" podStartSLOduration=1.751621326 podStartE2EDuration="2.260529793s" totalImagesPullingTime="508.908467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:22:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:22:39.259081783 +0000 UTC m=+582.922231205" watchObservedRunningTime="2026-07-22 15:22:39.260529793 +0000 UTC m=+582.923679214"
Jul 22 15:22:39.281668 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.281643    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-577bffb948-j297z"]
Jul 22 15:22:39.291027 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.291000    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-577bffb948-j297z"]
Jul 22 15:22:39.303657 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.303611    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f99895948-78qbh" podStartSLOduration=0.919607789 podStartE2EDuration="1.303597569s" totalImagesPullingTime="383.98978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:22:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:22:39.30331834 +0000 UTC m=+582.966467762" watchObservedRunningTime="2026-07-22 15:22:39.303597569 +0000 UTC m=+582.966746989"
Jul 22 15:22:39.329522 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.329496    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4wjg9"]
Jul 22 15:22:39.329708 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.329685    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-4wjg9" podUID="32079289-b899-4001-9f73-49fc1b5909b5" containerName="authorino" containerID="cri-o://2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4" gracePeriod=30
Jul 22 15:22:39.586884 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.586857    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vvk8g"
Jul 22 15:22:39.595456 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.595437    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4wjg9"
Jul 22 15:22:39.705330 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.705302    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2758v\" (UniqueName: \"kubernetes.io/projected/32079289-b899-4001-9f73-49fc1b5909b5-kube-api-access-2758v\") pod \"32079289-b899-4001-9f73-49fc1b5909b5\" (UID: \"32079289-b899-4001-9f73-49fc1b5909b5\") "
Jul 22 15:22:39.705488 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.705446    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dvmw\" (UniqueName: \"kubernetes.io/projected/5d628f84-6100-48e7-9a4d-0edcc04d17f4-kube-api-access-8dvmw\") pod \"5d628f84-6100-48e7-9a4d-0edcc04d17f4\" (UID: \"5d628f84-6100-48e7-9a4d-0edcc04d17f4\") "
Jul 22 15:22:39.708047 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.707993    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d628f84-6100-48e7-9a4d-0edcc04d17f4-kube-api-access-8dvmw" (OuterVolumeSpecName: "kube-api-access-8dvmw") pod "5d628f84-6100-48e7-9a4d-0edcc04d17f4" (UID: "5d628f84-6100-48e7-9a4d-0edcc04d17f4"). InnerVolumeSpecName "kube-api-access-8dvmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:22:39.712231 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.708508    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32079289-b899-4001-9f73-49fc1b5909b5-kube-api-access-2758v" (OuterVolumeSpecName: "kube-api-access-2758v") pod "32079289-b899-4001-9f73-49fc1b5909b5" (UID: "32079289-b899-4001-9f73-49fc1b5909b5"). InnerVolumeSpecName "kube-api-access-2758v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:22:39.806579 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.806509    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2758v\" (UniqueName: \"kubernetes.io/projected/32079289-b899-4001-9f73-49fc1b5909b5-kube-api-access-2758v\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:22:39.806579 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:39.806534    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dvmw\" (UniqueName: \"kubernetes.io/projected/5d628f84-6100-48e7-9a4d-0edcc04d17f4-kube-api-access-8dvmw\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:22:40.251989 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.251950    2580 generic.go:356] "Generic (PLEG): container finished" podID="32079289-b899-4001-9f73-49fc1b5909b5" containerID="2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4" exitCode=0
Jul 22 15:22:40.252466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.252006    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4wjg9"
Jul 22 15:22:40.252466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.252025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4wjg9" event={"ID":"32079289-b899-4001-9f73-49fc1b5909b5","Type":"ContainerDied","Data":"2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4"}
Jul 22 15:22:40.252466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.252068    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4wjg9" event={"ID":"32079289-b899-4001-9f73-49fc1b5909b5","Type":"ContainerDied","Data":"71c9f26f2408c40dd5b829f669726f81cf3785fb9a9a64f9c1416da0f9655271"}
Jul 22 15:22:40.252466 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.252081    2580 scope.go:117] "RemoveContainer" containerID="2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4"
Jul 22 15:22:40.253481 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.253456    2580 generic.go:356] "Generic (PLEG): container finished" podID="5d628f84-6100-48e7-9a4d-0edcc04d17f4" containerID="f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099" exitCode=0
Jul 22 15:22:40.253587 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.253503    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vvk8g"
Jul 22 15:22:40.253587 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.253562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vvk8g" event={"ID":"5d628f84-6100-48e7-9a4d-0edcc04d17f4","Type":"ContainerDied","Data":"f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099"}
Jul 22 15:22:40.253697 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.253591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vvk8g" event={"ID":"5d628f84-6100-48e7-9a4d-0edcc04d17f4","Type":"ContainerDied","Data":"b64e15f2be2e3836c7434da03f07e6be819a61a989688b898ff4ba6e590714e4"}
Jul 22 15:22:40.260933 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.260870    2580 scope.go:117] "RemoveContainer" containerID="2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4"
Jul 22 15:22:40.261204 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:22:40.261181    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4\": container with ID starting with 2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4 not found: ID does not exist" containerID="2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4"
Jul 22 15:22:40.261299 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.261217    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4"} err="failed to get container status \"2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4\": rpc error: code = NotFound desc = could not find container \"2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4\": container with ID starting with 2df4bbca2de5d661d85157ff044e865d0e864c314899a1b201e12262f4f81fa4 not found: ID does not exist"
Jul 22 15:22:40.261299 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.261242    2580 scope.go:117] "RemoveContainer" containerID="f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099"
Jul 22 15:22:40.268955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.268937    2580 scope.go:117] "RemoveContainer" containerID="f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099"
Jul 22 15:22:40.269235 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:22:40.269218    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099\": container with ID starting with f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099 not found: ID does not exist" containerID="f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099"
Jul 22 15:22:40.269277 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.269243    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099"} err="failed to get container status \"f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099\": rpc error: code = NotFound desc = could not find container \"f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099\": container with ID starting with f1850f38abba46a6368bc8505fe202288b022a23b95815cf312f3176b784f099 not found: ID does not exist"
Jul 22 15:22:40.278665 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.278645    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4wjg9"]
Jul 22 15:22:40.281875 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.281857    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4wjg9"]
Jul 22 15:22:40.292152 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.292130    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vvk8g"]
Jul 22 15:22:40.295871 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.295853    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vvk8g"]
Jul 22 15:22:40.780968 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.780939    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32079289-b899-4001-9f73-49fc1b5909b5" path="/var/lib/kubelet/pods/32079289-b899-4001-9f73-49fc1b5909b5/volumes"
Jul 22 15:22:40.781326 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.781312    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3db81fda-44bb-4b8d-a215-69c03bf9ec1e" path="/var/lib/kubelet/pods/3db81fda-44bb-4b8d-a215-69c03bf9ec1e/volumes"
Jul 22 15:22:40.781534 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:40.781521    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d628f84-6100-48e7-9a4d-0edcc04d17f4" path="/var/lib/kubelet/pods/5d628f84-6100-48e7-9a4d-0edcc04d17f4/volumes"
Jul 22 15:22:44.115026 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.114988    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66fb9d8549-jvxfg"]
Jul 22 15:22:44.115609 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.115387    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d628f84-6100-48e7-9a4d-0edcc04d17f4" containerName="authorino"
Jul 22 15:22:44.115609 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.115401    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d628f84-6100-48e7-9a4d-0edcc04d17f4" containerName="authorino"
Jul 22 15:22:44.115609 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.115429    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32079289-b899-4001-9f73-49fc1b5909b5" containerName="authorino"
Jul 22 15:22:44.115609 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.115438    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32079289-b899-4001-9f73-49fc1b5909b5" containerName="authorino"
Jul 22 15:22:44.115609 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.115545    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d628f84-6100-48e7-9a4d-0edcc04d17f4" containerName="authorino"
Jul 22 15:22:44.115609 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.115557    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="32079289-b899-4001-9f73-49fc1b5909b5" containerName="authorino"
Jul 22 15:22:44.344284 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.344247    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66fb9d8549-jvxfg"]
Jul 22 15:22:44.344447 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.344384    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:44.348756 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.348730    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 15:22:44.348904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.348799    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rrvsm\""
Jul 22 15:22:44.348904 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.348743    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 15:22:44.445330 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.445245    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb814812-0cb6-45af-bd9f-0515b699e136-webhook-cert\") pod \"maas-controller-66fb9d8549-jvxfg\" (UID: \"fb814812-0cb6-45af-bd9f-0515b699e136\") " pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:44.445330 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.445314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h542b\" (UniqueName: \"kubernetes.io/projected/fb814812-0cb6-45af-bd9f-0515b699e136-kube-api-access-h542b\") pod \"maas-controller-66fb9d8549-jvxfg\" (UID: \"fb814812-0cb6-45af-bd9f-0515b699e136\") " pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:44.545819 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.545781    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb814812-0cb6-45af-bd9f-0515b699e136-webhook-cert\") pod \"maas-controller-66fb9d8549-jvxfg\" (UID: \"fb814812-0cb6-45af-bd9f-0515b699e136\") " pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:44.545995 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.545828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h542b\" (UniqueName: \"kubernetes.io/projected/fb814812-0cb6-45af-bd9f-0515b699e136-kube-api-access-h542b\") pod \"maas-controller-66fb9d8549-jvxfg\" (UID: \"fb814812-0cb6-45af-bd9f-0515b699e136\") " pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:44.548242 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.548214    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb814812-0cb6-45af-bd9f-0515b699e136-webhook-cert\") pod \"maas-controller-66fb9d8549-jvxfg\" (UID: \"fb814812-0cb6-45af-bd9f-0515b699e136\") " pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:44.554168 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.554130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h542b\" (UniqueName: \"kubernetes.io/projected/fb814812-0cb6-45af-bd9f-0515b699e136-kube-api-access-h542b\") pod \"maas-controller-66fb9d8549-jvxfg\" (UID: \"fb814812-0cb6-45af-bd9f-0515b699e136\") " pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:44.654391 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.654353    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:44.817711 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:44.817688    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66fb9d8549-jvxfg"]
Jul 22 15:22:44.819333 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:22:44.819302    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb814812_0cb6_45af_bd9f_0515b699e136.slice/crio-33b29f7efde18da313c574e420d7d355b5c96da6181ea779ac7aaf708dc55eac WatchSource:0}: Error finding container 33b29f7efde18da313c574e420d7d355b5c96da6181ea779ac7aaf708dc55eac: Status 404 returned error can't find the container with id 33b29f7efde18da313c574e420d7d355b5c96da6181ea779ac7aaf708dc55eac
Jul 22 15:22:45.279006 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:45.278970    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fb9d8549-jvxfg" event={"ID":"fb814812-0cb6-45af-bd9f-0515b699e136","Type":"ContainerStarted","Data":"33b29f7efde18da313c574e420d7d355b5c96da6181ea779ac7aaf708dc55eac"}
Jul 22 15:22:48.295217 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:48.295177    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fb9d8549-jvxfg" event={"ID":"fb814812-0cb6-45af-bd9f-0515b699e136","Type":"ContainerStarted","Data":"673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab"}
Jul 22 15:22:48.295606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:48.295294    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:48.320611 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:48.320556    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66fb9d8549-jvxfg" podStartSLOduration=1.906160609 podStartE2EDuration="4.320540786s" totalImagesPullingTime="2.414380177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:22:48.319281417 +0000 UTC m=+591.982430839" watchObservedRunningTime="2026-07-22 15:22:48.320540786 +0000 UTC m=+591.983690233"
Jul 22 15:22:56.693111 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:56.693085    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:22:56.693589 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:56.693401    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:22:58.974109 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:58.974072    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66fb9d8549-jvxfg"]
Jul 22 15:22:58.974560 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:58.974287    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-66fb9d8549-jvxfg" podUID="fb814812-0cb6-45af-bd9f-0515b699e136" containerName="manager" containerID="cri-o://673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab" gracePeriod=30
Jul 22 15:22:58.976310 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:58.976286    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:59.223992 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.223965    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:59.254953 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.254907    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb814812-0cb6-45af-bd9f-0515b699e136-webhook-cert\") pod \"fb814812-0cb6-45af-bd9f-0515b699e136\" (UID: \"fb814812-0cb6-45af-bd9f-0515b699e136\") "
Jul 22 15:22:59.255112 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.254998    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h542b\" (UniqueName: \"kubernetes.io/projected/fb814812-0cb6-45af-bd9f-0515b699e136-kube-api-access-h542b\") pod \"fb814812-0cb6-45af-bd9f-0515b699e136\" (UID: \"fb814812-0cb6-45af-bd9f-0515b699e136\") "
Jul 22 15:22:59.257130 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.257095    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb814812-0cb6-45af-bd9f-0515b699e136-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fb814812-0cb6-45af-bd9f-0515b699e136" (UID: "fb814812-0cb6-45af-bd9f-0515b699e136"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:22:59.257246 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.257194    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb814812-0cb6-45af-bd9f-0515b699e136-kube-api-access-h542b" (OuterVolumeSpecName: "kube-api-access-h542b") pod "fb814812-0cb6-45af-bd9f-0515b699e136" (UID: "fb814812-0cb6-45af-bd9f-0515b699e136"). InnerVolumeSpecName "kube-api-access-h542b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:22:59.347550 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.347517    2580 generic.go:356] "Generic (PLEG): container finished" podID="fb814812-0cb6-45af-bd9f-0515b699e136" containerID="673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab" exitCode=0
Jul 22 15:22:59.347755 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.347563    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fb9d8549-jvxfg"
Jul 22 15:22:59.347755 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.347591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fb9d8549-jvxfg" event={"ID":"fb814812-0cb6-45af-bd9f-0515b699e136","Type":"ContainerDied","Data":"673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab"}
Jul 22 15:22:59.347755 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.347642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fb9d8549-jvxfg" event={"ID":"fb814812-0cb6-45af-bd9f-0515b699e136","Type":"ContainerDied","Data":"33b29f7efde18da313c574e420d7d355b5c96da6181ea779ac7aaf708dc55eac"}
Jul 22 15:22:59.347755 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.347669    2580 scope.go:117] "RemoveContainer" containerID="673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab"
Jul 22 15:22:59.356596 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.356378    2580 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb814812-0cb6-45af-bd9f-0515b699e136-webhook-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:22:59.356596 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.356404    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h542b\" (UniqueName: \"kubernetes.io/projected/fb814812-0cb6-45af-bd9f-0515b699e136-kube-api-access-h542b\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:22:59.357632 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.357612    2580 scope.go:117] "RemoveContainer" containerID="673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab"
Jul 22 15:22:59.357875 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:22:59.357859    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab\": container with ID starting with 673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab not found: ID does not exist" containerID="673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab"
Jul 22 15:22:59.357942 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.357883    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab"} err="failed to get container status \"673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab\": rpc error: code = NotFound desc = could not find container \"673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab\": container with ID starting with 673b03505e3b8e20132d59255ce95d176f3877a3e66baaf33b72c1170aa5e2ab not found: ID does not exist"
Jul 22 15:22:59.372831 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.372671    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66fb9d8549-jvxfg"]
Jul 22 15:22:59.376427 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:22:59.376389    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66fb9d8549-jvxfg"]
Jul 22 15:23:00.781425 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:00.781389    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb814812-0cb6-45af-bd9f-0515b699e136" path="/var/lib/kubelet/pods/fb814812-0cb6-45af-bd9f-0515b699e136/volumes"
Jul 22 15:23:19.915262 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:19.915169    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"]
Jul 22 15:23:19.915855 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:19.915720    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb814812-0cb6-45af-bd9f-0515b699e136" containerName="manager"
Jul 22 15:23:19.915855 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:19.915742    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb814812-0cb6-45af-bd9f-0515b699e136" containerName="manager"
Jul 22 15:23:19.915855 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:19.915835    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb814812-0cb6-45af-bd9f-0515b699e136" containerName="manager"
Jul 22 15:23:19.924059 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:19.924033    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:19.926651 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:19.926625    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 22 15:23:19.931603 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:19.931578    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"]
Jul 22 15:23:20.042859 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.042826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a59166e-7aed-4fb9-886b-426bbd6faae0-maas-api-tls\") pod \"maas-api-bf77ff4b8-szvjl\" (UID: \"3a59166e-7aed-4fb9-886b-426bbd6faae0\") " pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:20.043078 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.042865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh8t5\" (UniqueName: \"kubernetes.io/projected/3a59166e-7aed-4fb9-886b-426bbd6faae0-kube-api-access-xh8t5\") pod \"maas-api-bf77ff4b8-szvjl\" (UID: \"3a59166e-7aed-4fb9-886b-426bbd6faae0\") " pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:20.043078 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.043041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a59166e-7aed-4fb9-886b-426bbd6faae0-openshift-service-ca\") pod \"maas-api-bf77ff4b8-szvjl\" (UID: \"3a59166e-7aed-4fb9-886b-426bbd6faae0\") " pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:20.143807 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.143771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a59166e-7aed-4fb9-886b-426bbd6faae0-openshift-service-ca\") pod \"maas-api-bf77ff4b8-szvjl\" (UID: \"3a59166e-7aed-4fb9-886b-426bbd6faae0\") " pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:20.144029 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.143814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a59166e-7aed-4fb9-886b-426bbd6faae0-maas-api-tls\") pod \"maas-api-bf77ff4b8-szvjl\" (UID: \"3a59166e-7aed-4fb9-886b-426bbd6faae0\") " pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:20.144029 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.143838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh8t5\" (UniqueName: \"kubernetes.io/projected/3a59166e-7aed-4fb9-886b-426bbd6faae0-kube-api-access-xh8t5\") pod \"maas-api-bf77ff4b8-szvjl\" (UID: \"3a59166e-7aed-4fb9-886b-426bbd6faae0\") " pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:20.144486 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.144460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a59166e-7aed-4fb9-886b-426bbd6faae0-openshift-service-ca\") pod \"maas-api-bf77ff4b8-szvjl\" (UID: \"3a59166e-7aed-4fb9-886b-426bbd6faae0\") " pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:20.146233 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.146213    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a59166e-7aed-4fb9-886b-426bbd6faae0-maas-api-tls\") pod \"maas-api-bf77ff4b8-szvjl\" (UID: \"3a59166e-7aed-4fb9-886b-426bbd6faae0\") " pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:20.152953 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.152905    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh8t5\" (UniqueName: \"kubernetes.io/projected/3a59166e-7aed-4fb9-886b-426bbd6faae0-kube-api-access-xh8t5\") pod \"maas-api-bf77ff4b8-szvjl\" (UID: \"3a59166e-7aed-4fb9-886b-426bbd6faae0\") " pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:20.235476 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.235413    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:20.372708 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.372684    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"]
Jul 22 15:23:20.375038 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:23:20.374999    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a59166e_7aed_4fb9_886b_426bbd6faae0.slice/crio-f5c116fdf6b030c4e922bfdb9d3f942e9f11a1fbf473fca692cbaa6c2ab8bcba WatchSource:0}: Error finding container f5c116fdf6b030c4e922bfdb9d3f942e9f11a1fbf473fca692cbaa6c2ab8bcba: Status 404 returned error can't find the container with id f5c116fdf6b030c4e922bfdb9d3f942e9f11a1fbf473fca692cbaa6c2ab8bcba
Jul 22 15:23:20.446392 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.446356    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl" event={"ID":"3a59166e-7aed-4fb9-886b-426bbd6faae0","Type":"ContainerStarted","Data":"f5c116fdf6b030c4e922bfdb9d3f942e9f11a1fbf473fca692cbaa6c2ab8bcba"}
Jul 22 15:23:20.502764 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.502684    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-mtsmn"]
Jul 22 15:23:20.507842 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.507821    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn"
Jul 22 15:23:20.510401 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.510373    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-f8k6w\""
Jul 22 15:23:20.510527 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.510495    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 15:23:20.521134 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.521109    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-mtsmn"]
Jul 22 15:23:20.648027 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.647991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nvs8\" (UniqueName: \"kubernetes.io/projected/b88d58ec-be4e-4aa0-83d4-e540224819bc-kube-api-access-7nvs8\") pod \"payload-processing-5bf47cd988-mtsmn\" (UID: \"b88d58ec-be4e-4aa0-83d4-e540224819bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn"
Jul 22 15:23:20.648027 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.648032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b88d58ec-be4e-4aa0-83d4-e540224819bc-plugins-config-volume\") pod \"payload-processing-5bf47cd988-mtsmn\" (UID: \"b88d58ec-be4e-4aa0-83d4-e540224819bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn"
Jul 22 15:23:20.749254 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.749222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nvs8\" (UniqueName: \"kubernetes.io/projected/b88d58ec-be4e-4aa0-83d4-e540224819bc-kube-api-access-7nvs8\") pod \"payload-processing-5bf47cd988-mtsmn\" (UID: \"b88d58ec-be4e-4aa0-83d4-e540224819bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn"
Jul 22 15:23:20.749453 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.749262    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b88d58ec-be4e-4aa0-83d4-e540224819bc-plugins-config-volume\") pod \"payload-processing-5bf47cd988-mtsmn\" (UID: \"b88d58ec-be4e-4aa0-83d4-e540224819bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn"
Jul 22 15:23:20.749990 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.749965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b88d58ec-be4e-4aa0-83d4-e540224819bc-plugins-config-volume\") pod \"payload-processing-5bf47cd988-mtsmn\" (UID: \"b88d58ec-be4e-4aa0-83d4-e540224819bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn"
Jul 22 15:23:20.758702 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.758644    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nvs8\" (UniqueName: \"kubernetes.io/projected/b88d58ec-be4e-4aa0-83d4-e540224819bc-kube-api-access-7nvs8\") pod \"payload-processing-5bf47cd988-mtsmn\" (UID: \"b88d58ec-be4e-4aa0-83d4-e540224819bc\") " pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn"
Jul 22 15:23:20.819649 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:20.819613    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn"
Jul 22 15:23:21.178151 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:21.177994    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-mtsmn"]
Jul 22 15:23:21.184206 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:23:21.184155    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88d58ec_be4e_4aa0_83d4_e540224819bc.slice/crio-7abbb7bf786bee612de15d9c3891492e98e8d6ca6d17e1b143c16a6ccb12b6fb WatchSource:0}: Error finding container 7abbb7bf786bee612de15d9c3891492e98e8d6ca6d17e1b143c16a6ccb12b6fb: Status 404 returned error can't find the container with id 7abbb7bf786bee612de15d9c3891492e98e8d6ca6d17e1b143c16a6ccb12b6fb
Jul 22 15:23:21.452572 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:21.452494    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn" event={"ID":"b88d58ec-be4e-4aa0-83d4-e540224819bc","Type":"ContainerStarted","Data":"7abbb7bf786bee612de15d9c3891492e98e8d6ca6d17e1b143c16a6ccb12b6fb"}
Jul 22 15:23:22.487032 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:22.486394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl" event={"ID":"3a59166e-7aed-4fb9-886b-426bbd6faae0","Type":"ContainerStarted","Data":"a4914e8d2c574f9d2db41a93049b53cc170fcfe0d54fd5ccb8c4bdf9ab05135d"}
Jul 22 15:23:22.487032 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:22.486686    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:22.506248 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:22.506167    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl" podStartSLOduration=1.558964456 podStartE2EDuration="3.506150385s" totalImagesPullingTime="1.947185929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:23:22.503714668 +0000 UTC m=+626.166864091" watchObservedRunningTime="2026-07-22 15:23:22.506150385 +0000 UTC m=+626.169299805"
Jul 22 15:23:24.497314 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:24.497280    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn" event={"ID":"b88d58ec-be4e-4aa0-83d4-e540224819bc","Type":"ContainerStarted","Data":"e517cb566efe1e1e42944d54abfcc76b17f957503d3a783fdd239da158cd634c"}
Jul 22 15:23:24.497678 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:24.497398    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn"
Jul 22 15:23:24.513856 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:24.513801    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn" podStartSLOduration=1.6809874630000001 podStartE2EDuration="4.513786407s" totalImagesPullingTime="2.832798944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:23:24.512549321 +0000 UTC m=+628.175698743" watchObservedRunningTime="2026-07-22 15:23:24.513786407 +0000 UTC m=+628.176935827"
Jul 22 15:23:28.496973 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:28.496946    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-bf77ff4b8-szvjl"
Jul 22 15:23:28.520719 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:28.520684    2580 generic.go:356] "Generic (PLEG): container finished" podID="3327f692-983e-4835-9815-3a85f2634d75" containerID="110cffd4ca851098ca760100edaf4d192728519e566535e2b632e2671c27de18" exitCode=0
Jul 22 15:23:28.520867 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:28.520751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb" event={"ID":"3327f692-983e-4835-9815-3a85f2634d75","Type":"ContainerDied","Data":"110cffd4ca851098ca760100edaf4d192728519e566535e2b632e2671c27de18"}
Jul 22 15:23:28.521159 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:28.521143    2580 scope.go:117] "RemoveContainer" containerID="110cffd4ca851098ca760100edaf4d192728519e566535e2b632e2671c27de18"
Jul 22 15:23:28.522056 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:28.522032    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:23:28.522128 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:28.522092    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:23:28.522128 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:28.522123    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:23:29.527334 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:29.527293    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb" event={"ID":"3327f692-983e-4835-9815-3a85f2634d75","Type":"ContainerStarted","Data":"43339d0d6c39d28bbda3161e8ebe76078f11249b414bd96b96fed491f004cef2"}
Jul 22 15:23:29.694190 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:29.694146    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:23:29.695401 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:29.695377    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9nlnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 22 15:23:29.695472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:29.695426    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb" podUID="3327f692-983e-4835-9815-3a85f2634d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 22 15:23:30.694773 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:30.694730    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9nlnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 22 15:23:30.695225 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:30.694790    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb" podUID="3327f692-983e-4835-9815-3a85f2634d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 22 15:23:31.694792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:31.694748    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9nlnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 22 15:23:31.695239 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:31.694809    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb" podUID="3327f692-983e-4835-9815-3a85f2634d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 22 15:23:32.694612 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:32.694572    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-9nlnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 22 15:23:32.694783 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:32.694629    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb" podUID="3327f692-983e-4835-9815-3a85f2634d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 22 15:23:33.698223 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:33.698193    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:23:33.698621 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:33.698563    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:23:33.699244 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:33.699226    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-9nlnb"
Jul 22 15:23:35.505569 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:35.505537    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-mtsmn"
Jul 22 15:23:43.714123 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.714085    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"]
Jul 22 15:23:43.719058 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.719037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.722908 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.722888    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 15:23:43.723039 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.722888    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xftm8\""
Jul 22 15:23:43.723039 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.722969    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 15:23:43.723039 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.722967    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 22 15:23:43.727713 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.727687    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"]
Jul 22 15:23:43.783765 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.783486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.783765 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.783641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e50fa91e-c1be-4ee7-bf87-4cd63703f316-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.783765 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.783679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.783765 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.783717    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.783765 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.783747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdl5x\" (UniqueName: \"kubernetes.io/projected/e50fa91e-c1be-4ee7-bf87-4cd63703f316-kube-api-access-zdl5x\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.784179 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.783794    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.884940 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.884887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e50fa91e-c1be-4ee7-bf87-4cd63703f316-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.885127 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.884957    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.885127 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.884979    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.885127 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.884997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdl5x\" (UniqueName: \"kubernetes.io/projected/e50fa91e-c1be-4ee7-bf87-4cd63703f316-kube-api-access-zdl5x\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.885127 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.885024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.885127 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.885047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.885469 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.885449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.885543 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.885444    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.885543 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.885522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.887251 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.887228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e50fa91e-c1be-4ee7-bf87-4cd63703f316-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.887641 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.887617    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e50fa91e-c1be-4ee7-bf87-4cd63703f316-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:43.892718 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:43.892694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdl5x\" (UniqueName: \"kubernetes.io/projected/e50fa91e-c1be-4ee7-bf87-4cd63703f316-kube-api-access-zdl5x\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x\" (UID: \"e50fa91e-c1be-4ee7-bf87-4cd63703f316\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:44.031263 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:44.031229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:44.179590 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:44.179566    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"]
Jul 22 15:23:44.182949 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:23:44.182900    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50fa91e_c1be_4ee7_bf87_4cd63703f316.slice/crio-8851b7ada6c5b349f217a4045bd5b3ed3fda7c8fea20b9e365f85583dee77eae WatchSource:0}: Error finding container 8851b7ada6c5b349f217a4045bd5b3ed3fda7c8fea20b9e365f85583dee77eae: Status 404 returned error can't find the container with id 8851b7ada6c5b349f217a4045bd5b3ed3fda7c8fea20b9e365f85583dee77eae
Jul 22 15:23:44.607149 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:44.607103    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x" event={"ID":"e50fa91e-c1be-4ee7-bf87-4cd63703f316","Type":"ContainerStarted","Data":"8851b7ada6c5b349f217a4045bd5b3ed3fda7c8fea20b9e365f85583dee77eae"}
Jul 22 15:23:45.613733 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:45.613699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x" event={"ID":"e50fa91e-c1be-4ee7-bf87-4cd63703f316","Type":"ContainerStarted","Data":"bb94e127f441a4730df858f737ec25e99680f412abf9117127dd51a8d22ac147"}
Jul 22 15:23:45.631348 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:45.631296    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x" podStartSLOduration=1.388173091 podStartE2EDuration="2.631279101s" totalImagesPullingTime="1.24310601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:23:45.628957687 +0000 UTC m=+649.292107116" watchObservedRunningTime="2026-07-22 15:23:45.631279101 +0000 UTC m=+649.294428556"
Jul 22 15:23:54.031728 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:54.031689    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:54.032224 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:54.031770    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:54.044321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:54.044299    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:23:54.672135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:23:54.672107    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x"
Jul 22 15:24:22.924357 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:22.924323    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"]
Jul 22 15:24:22.927936 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:22.927895    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:22.930320 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:22.930297    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 22 15:24:22.940384 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:22.940363    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"]
Jul 22 15:24:23.039008 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.038975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.039161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.039011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.039161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.039077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.039161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.039099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm4c2\" (UniqueName: \"kubernetes.io/projected/d9161582-f83f-4a14-bb2a-44e46ede746a-kube-api-access-mm4c2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.039267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.039183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9161582-f83f-4a14-bb2a-44e46ede746a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.039267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.039238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.140289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.140258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.140289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.140292    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.140490 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.140444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.140541 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.140501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm4c2\" (UniqueName: \"kubernetes.io/projected/d9161582-f83f-4a14-bb2a-44e46ede746a-kube-api-access-mm4c2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.140587 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.140575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9161582-f83f-4a14-bb2a-44e46ede746a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.140679 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.140661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.140760 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.140708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.141074 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.141050    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.141185 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.141090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.142425 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.142403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9161582-f83f-4a14-bb2a-44e46ede746a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.142889 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.142867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9161582-f83f-4a14-bb2a-44e46ede746a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.152494 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.152465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm4c2\" (UniqueName: \"kubernetes.io/projected/d9161582-f83f-4a14-bb2a-44e46ede746a-kube-api-access-mm4c2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7\" (UID: \"d9161582-f83f-4a14-bb2a-44e46ede746a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.238286 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.238262    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:23.372290 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.372264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"]
Jul 22 15:24:23.373982 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:24:23.373953    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9161582_f83f_4a14_bb2a_44e46ede746a.slice/crio-edda8b69932fd54f8ffde3fd403ffece66206875f70232e373faf850f11ccefb WatchSource:0}: Error finding container edda8b69932fd54f8ffde3fd403ffece66206875f70232e373faf850f11ccefb: Status 404 returned error can't find the container with id edda8b69932fd54f8ffde3fd403ffece66206875f70232e373faf850f11ccefb
Jul 22 15:24:23.375300 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.375282    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 15:24:23.793321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.793288    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7" event={"ID":"d9161582-f83f-4a14-bb2a-44e46ede746a","Type":"ContainerStarted","Data":"f72172dd9b00f40fad92d9590b59ec0ed0cba5acbf05a373d54734773623bde0"}
Jul 22 15:24:23.793505 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.793336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7" event={"ID":"d9161582-f83f-4a14-bb2a-44e46ede746a","Type":"ContainerStarted","Data":"edda8b69932fd54f8ffde3fd403ffece66206875f70232e373faf850f11ccefb"}
Jul 22 15:24:23.829033 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:23.828926    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7" podStartSLOduration=1.638186758 podStartE2EDuration="1.828900527s" totalImagesPullingTime="190.713769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:24:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:24:23.826866325 +0000 UTC m=+687.490015749" watchObservedRunningTime="2026-07-22 15:24:23.828900527 +0000 UTC m=+687.492049948"
Jul 22 15:24:33.238979 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:33.238934    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:33.239528 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:33.239004    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:33.252235 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:33.252210    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:24:33.850895 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:24:33.850865    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7"
Jul 22 15:26:14.466617 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:14.466582    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f84cfd697-fnjhr"]
Jul 22 15:26:14.470287 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:14.470267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f84cfd697-fnjhr"
Jul 22 15:26:14.476618 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:14.476593    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f84cfd697-fnjhr"]
Jul 22 15:26:14.542883 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:14.542851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h8cs\" (UniqueName: \"kubernetes.io/projected/5114a7b2-2ea7-4a2e-892f-f949ff046a92-kube-api-access-8h8cs\") pod \"authorino-7f84cfd697-fnjhr\" (UID: \"5114a7b2-2ea7-4a2e-892f-f949ff046a92\") " pod="kuadrant-system/authorino-7f84cfd697-fnjhr"
Jul 22 15:26:14.543035 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:14.542990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5114a7b2-2ea7-4a2e-892f-f949ff046a92-tls-cert\") pod \"authorino-7f84cfd697-fnjhr\" (UID: \"5114a7b2-2ea7-4a2e-892f-f949ff046a92\") " pod="kuadrant-system/authorino-7f84cfd697-fnjhr"
Jul 22 15:26:14.643747 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:14.643716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h8cs\" (UniqueName: \"kubernetes.io/projected/5114a7b2-2ea7-4a2e-892f-f949ff046a92-kube-api-access-8h8cs\") pod \"authorino-7f84cfd697-fnjhr\" (UID: \"5114a7b2-2ea7-4a2e-892f-f949ff046a92\") " pod="kuadrant-system/authorino-7f84cfd697-fnjhr"
Jul 22 15:26:14.643893 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:14.643771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5114a7b2-2ea7-4a2e-892f-f949ff046a92-tls-cert\") pod \"authorino-7f84cfd697-fnjhr\" (UID: \"5114a7b2-2ea7-4a2e-892f-f949ff046a92\") " pod="kuadrant-system/authorino-7f84cfd697-fnjhr"
Jul 22 15:26:14.646117 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:14.646090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5114a7b2-2ea7-4a2e-892f-f949ff046a92-tls-cert\") pod \"authorino-7f84cfd697-fnjhr\" (UID: \"5114a7b2-2ea7-4a2e-892f-f949ff046a92\") " pod="kuadrant-system/authorino-7f84cfd697-fnjhr"
Jul 22 15:26:14.651337 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:14.651313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h8cs\" (UniqueName: \"kubernetes.io/projected/5114a7b2-2ea7-4a2e-892f-f949ff046a92-kube-api-access-8h8cs\") pod \"authorino-7f84cfd697-fnjhr\" (UID: \"5114a7b2-2ea7-4a2e-892f-f949ff046a92\") " pod="kuadrant-system/authorino-7f84cfd697-fnjhr"
Jul 22 15:26:14.781192 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:14.781165    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f84cfd697-fnjhr"
Jul 22 15:26:14.910416 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:14.910388    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f84cfd697-fnjhr"]
Jul 22 15:26:14.912201 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:26:14.912172    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5114a7b2_2ea7_4a2e_892f_f949ff046a92.slice/crio-f934c6a9d464cb140ffef851d17928c58d72638fa1027d383e1400177654a241 WatchSource:0}: Error finding container f934c6a9d464cb140ffef851d17928c58d72638fa1027d383e1400177654a241: Status 404 returned error can't find the container with id f934c6a9d464cb140ffef851d17928c58d72638fa1027d383e1400177654a241
Jul 22 15:26:15.315075 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:15.315044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f84cfd697-fnjhr" event={"ID":"5114a7b2-2ea7-4a2e-892f-f949ff046a92","Type":"ContainerStarted","Data":"f934c6a9d464cb140ffef851d17928c58d72638fa1027d383e1400177654a241"}
Jul 22 15:26:16.322223 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:16.322185    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f84cfd697-fnjhr" event={"ID":"5114a7b2-2ea7-4a2e-892f-f949ff046a92","Type":"ContainerStarted","Data":"5c12f58e6a7a04844f20fbd6e3233d762960847b4dc52bf68f1a11d587c003dc"}
Jul 22 15:26:16.339413 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:16.339363    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f84cfd697-fnjhr" podStartSLOduration=1.64135215 podStartE2EDuration="2.339348799s" totalImagesPullingTime="697.996649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:26:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:26:16.337531241 +0000 UTC m=+800.000680663" watchObservedRunningTime="2026-07-22 15:26:16.339348799 +0000 UTC m=+800.002498228"
Jul 22 15:26:16.366163 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:16.366121    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99895948-78qbh"]
Jul 22 15:26:16.367135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:16.367079    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-f99895948-78qbh" podUID="5a3aa3d8-fd6c-4040-a807-c21416304f6c" containerName="authorino" containerID="cri-o://676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729" gracePeriod=30
Jul 22 15:26:16.627838 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:16.627812    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99895948-78qbh"
Jul 22 15:26:16.763358 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:16.763329    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a3aa3d8-fd6c-4040-a807-c21416304f6c-tls-cert\") pod \"5a3aa3d8-fd6c-4040-a807-c21416304f6c\" (UID: \"5a3aa3d8-fd6c-4040-a807-c21416304f6c\") "
Jul 22 15:26:16.763534 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:16.763435    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cngn7\" (UniqueName: \"kubernetes.io/projected/5a3aa3d8-fd6c-4040-a807-c21416304f6c-kube-api-access-cngn7\") pod \"5a3aa3d8-fd6c-4040-a807-c21416304f6c\" (UID: \"5a3aa3d8-fd6c-4040-a807-c21416304f6c\") "
Jul 22 15:26:16.773340 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:16.773300    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a3aa3d8-fd6c-4040-a807-c21416304f6c-kube-api-access-cngn7" (OuterVolumeSpecName: "kube-api-access-cngn7") pod "5a3aa3d8-fd6c-4040-a807-c21416304f6c" (UID: "5a3aa3d8-fd6c-4040-a807-c21416304f6c"). InnerVolumeSpecName "kube-api-access-cngn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:26:16.783623 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:16.783587    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a3aa3d8-fd6c-4040-a807-c21416304f6c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5a3aa3d8-fd6c-4040-a807-c21416304f6c" (UID: "5a3aa3d8-fd6c-4040-a807-c21416304f6c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:26:16.864857 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:16.864768    2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a3aa3d8-fd6c-4040-a807-c21416304f6c-tls-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:26:16.864857 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:16.864812    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cngn7\" (UniqueName: \"kubernetes.io/projected/5a3aa3d8-fd6c-4040-a807-c21416304f6c-kube-api-access-cngn7\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:26:17.329491 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:17.329452    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a3aa3d8-fd6c-4040-a807-c21416304f6c" containerID="676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729" exitCode=0
Jul 22 15:26:17.329955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:17.329530    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99895948-78qbh"
Jul 22 15:26:17.329955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:17.329536    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99895948-78qbh" event={"ID":"5a3aa3d8-fd6c-4040-a807-c21416304f6c","Type":"ContainerDied","Data":"676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729"}
Jul 22 15:26:17.329955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:17.329587    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99895948-78qbh" event={"ID":"5a3aa3d8-fd6c-4040-a807-c21416304f6c","Type":"ContainerDied","Data":"5ddb7337f1cf77fad36710138631fa2b2829592b29f27a213f5c5016a31262b4"}
Jul 22 15:26:17.329955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:17.329618    2580 scope.go:117] "RemoveContainer" containerID="676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729"
Jul 22 15:26:17.339391 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:17.339370    2580 scope.go:117] "RemoveContainer" containerID="676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729"
Jul 22 15:26:17.339719 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:26:17.339688    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729\": container with ID starting with 676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729 not found: ID does not exist" containerID="676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729"
Jul 22 15:26:17.339799 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:17.339727    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729"} err="failed to get container status \"676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729\": rpc error: code = NotFound desc = could not find container \"676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729\": container with ID starting with 676c9b22013bc1cacad5b78cafd5ffa60ed285f06807b69ff7316b18d310f729 not found: ID does not exist"
Jul 22 15:26:17.354637 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:17.354611    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99895948-78qbh"]
Jul 22 15:26:17.356669 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:17.356647    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99895948-78qbh"]
Jul 22 15:26:18.782029 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:26:18.781952    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a3aa3d8-fd6c-4040-a807-c21416304f6c" path="/var/lib/kubelet/pods/5a3aa3d8-fd6c-4040-a807-c21416304f6c/volumes"
Jul 22 15:27:56.720856 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:27:56.720792    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:27:56.721884 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:27:56.721857    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:32:56.755019 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:32:56.754949    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:32:56.757055 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:32:56.757030    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:33:18.229595 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:18.229550    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"]
Jul 22 15:33:18.230110 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:18.229844    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx" podUID="bdfb8048-b047-49e7-ba62-eb36b37e0408" containerName="manager" containerID="cri-o://fb2bfcf2c1fbce2fda5e3e8d38dcd90d8880ac0a3d39619be7b11e8d5408e5fb" gracePeriod=10
Jul 22 15:33:21.338520 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:21.338488    2580 generic.go:356] "Generic (PLEG): container finished" podID="bdfb8048-b047-49e7-ba62-eb36b37e0408" containerID="fb2bfcf2c1fbce2fda5e3e8d38dcd90d8880ac0a3d39619be7b11e8d5408e5fb" exitCode=0
Jul 22 15:33:21.338863 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:21.338565    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx" event={"ID":"bdfb8048-b047-49e7-ba62-eb36b37e0408","Type":"ContainerDied","Data":"fb2bfcf2c1fbce2fda5e3e8d38dcd90d8880ac0a3d39619be7b11e8d5408e5fb"}
Jul 22 15:33:21.878880 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:21.878854    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:33:21.976127 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:21.976096    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr2gt\" (UniqueName: \"kubernetes.io/projected/bdfb8048-b047-49e7-ba62-eb36b37e0408-kube-api-access-xr2gt\") pod \"bdfb8048-b047-49e7-ba62-eb36b37e0408\" (UID: \"bdfb8048-b047-49e7-ba62-eb36b37e0408\") "
Jul 22 15:33:21.976293 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:21.976191    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdfb8048-b047-49e7-ba62-eb36b37e0408-extensions-socket-volume\") pod \"bdfb8048-b047-49e7-ba62-eb36b37e0408\" (UID: \"bdfb8048-b047-49e7-ba62-eb36b37e0408\") "
Jul 22 15:33:21.976596 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:21.976574    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdfb8048-b047-49e7-ba62-eb36b37e0408-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bdfb8048-b047-49e7-ba62-eb36b37e0408" (UID: "bdfb8048-b047-49e7-ba62-eb36b37e0408"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:33:21.978254 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:21.978233    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdfb8048-b047-49e7-ba62-eb36b37e0408-kube-api-access-xr2gt" (OuterVolumeSpecName: "kube-api-access-xr2gt") pod "bdfb8048-b047-49e7-ba62-eb36b37e0408" (UID: "bdfb8048-b047-49e7-ba62-eb36b37e0408"). InnerVolumeSpecName "kube-api-access-xr2gt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:33:22.076934 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:22.076836    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bdfb8048-b047-49e7-ba62-eb36b37e0408-extensions-socket-volume\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:33:22.076934 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:22.076862    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr2gt\" (UniqueName: \"kubernetes.io/projected/bdfb8048-b047-49e7-ba62-eb36b37e0408-kube-api-access-xr2gt\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:33:22.344164 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:22.344078    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"
Jul 22 15:33:22.344164 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:22.344111    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx" event={"ID":"bdfb8048-b047-49e7-ba62-eb36b37e0408","Type":"ContainerDied","Data":"e98baf9b88472c285558db75dd84dc5f9d64769e756f529c4543f39b721aa24f"}
Jul 22 15:33:22.344711 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:22.344173    2580 scope.go:117] "RemoveContainer" containerID="fb2bfcf2c1fbce2fda5e3e8d38dcd90d8880ac0a3d39619be7b11e8d5408e5fb"
Jul 22 15:33:22.368003 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:22.367977    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"]
Jul 22 15:33:22.369541 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:22.369522    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9r5fx"]
Jul 22 15:33:22.781271 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:33:22.781229    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdfb8048-b047-49e7-ba62-eb36b37e0408" path="/var/lib/kubelet/pods/bdfb8048-b047-49e7-ba62-eb36b37e0408/volumes"
Jul 22 15:34:19.349763 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.349725    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"]
Jul 22 15:34:19.350255 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.350110    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdfb8048-b047-49e7-ba62-eb36b37e0408" containerName="manager"
Jul 22 15:34:19.350255 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.350124    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdfb8048-b047-49e7-ba62-eb36b37e0408" containerName="manager"
Jul 22 15:34:19.350255 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.350139    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a3aa3d8-fd6c-4040-a807-c21416304f6c" containerName="authorino"
Jul 22 15:34:19.350255 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.350145    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a3aa3d8-fd6c-4040-a807-c21416304f6c" containerName="authorino"
Jul 22 15:34:19.350255 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.350211    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdfb8048-b047-49e7-ba62-eb36b37e0408" containerName="manager"
Jul 22 15:34:19.350255 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.350221    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a3aa3d8-fd6c-4040-a807-c21416304f6c" containerName="authorino"
Jul 22 15:34:19.354175 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.354159    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"
Jul 22 15:34:19.357260 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.357237    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ps56l\""
Jul 22 15:34:19.364601 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.364571    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"]
Jul 22 15:34:19.471544 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.471500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fzp6\" (UniqueName: \"kubernetes.io/projected/e24e7359-ec6f-459a-b482-8c730d0f92c4-kube-api-access-7fzp6\") pod \"kuadrant-operator-controller-manager-86878c769f-hrkgs\" (UID: \"e24e7359-ec6f-459a-b482-8c730d0f92c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"
Jul 22 15:34:19.471711 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.471610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e24e7359-ec6f-459a-b482-8c730d0f92c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hrkgs\" (UID: \"e24e7359-ec6f-459a-b482-8c730d0f92c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"
Jul 22 15:34:19.572828 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.572791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fzp6\" (UniqueName: \"kubernetes.io/projected/e24e7359-ec6f-459a-b482-8c730d0f92c4-kube-api-access-7fzp6\") pod \"kuadrant-operator-controller-manager-86878c769f-hrkgs\" (UID: \"e24e7359-ec6f-459a-b482-8c730d0f92c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"
Jul 22 15:34:19.573000 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.572880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e24e7359-ec6f-459a-b482-8c730d0f92c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hrkgs\" (UID: \"e24e7359-ec6f-459a-b482-8c730d0f92c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"
Jul 22 15:34:19.573260 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.573241    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e24e7359-ec6f-459a-b482-8c730d0f92c4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hrkgs\" (UID: \"e24e7359-ec6f-459a-b482-8c730d0f92c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"
Jul 22 15:34:19.583944 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.583908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fzp6\" (UniqueName: \"kubernetes.io/projected/e24e7359-ec6f-459a-b482-8c730d0f92c4-kube-api-access-7fzp6\") pod \"kuadrant-operator-controller-manager-86878c769f-hrkgs\" (UID: \"e24e7359-ec6f-459a-b482-8c730d0f92c4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"
Jul 22 15:34:19.665987 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.665891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"
Jul 22 15:34:19.809545 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:19.809454    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"]
Jul 22 15:34:19.811949 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:34:19.811896    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24e7359_ec6f_459a_b482_8c730d0f92c4.slice/crio-b1166ed72a192efa471751de948aba61d215bffa07ea5e03d339ec04612ced2b WatchSource:0}: Error finding container b1166ed72a192efa471751de948aba61d215bffa07ea5e03d339ec04612ced2b: Status 404 returned error can't find the container with id b1166ed72a192efa471751de948aba61d215bffa07ea5e03d339ec04612ced2b
Jul 22 15:34:20.626895 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:20.626856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs" event={"ID":"e24e7359-ec6f-459a-b482-8c730d0f92c4","Type":"ContainerStarted","Data":"6256727c7a92baea18f6b8408ed793341f5029583e876b0b03b5cd06894db1f1"}
Jul 22 15:34:20.627290 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:20.626937    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"
Jul 22 15:34:20.627290 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:20.626957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs" event={"ID":"e24e7359-ec6f-459a-b482-8c730d0f92c4","Type":"ContainerStarted","Data":"b1166ed72a192efa471751de948aba61d215bffa07ea5e03d339ec04612ced2b"}
Jul 22 15:34:20.653164 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:20.653109    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs" podStartSLOduration=1.6530938979999998 podStartE2EDuration="1.653093898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:34:20.650789705 +0000 UTC m=+1284.313939127" watchObservedRunningTime="2026-07-22 15:34:20.653093898 +0000 UTC m=+1284.316243320"
Jul 22 15:34:31.633779 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:34:31.633748    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hrkgs"
Jul 22 15:37:02.528379 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.528300    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"]
Jul 22 15:37:02.531707 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.531687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.534278 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.534260    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-5e94a61f-kserve-self-signed-certs\""
Jul 22 15:37:02.550366 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.550339    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"]
Jul 22 15:37:02.674692 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.674653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-home\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.674692 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.674694    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-dshm\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.674894 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.674735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd656\" (UniqueName: \"kubernetes.io/projected/1a0eaee4-a118-4e3c-9647-f868b8296a3f-kube-api-access-dd656\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.674894 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.674795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-model-cache\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.674894 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.674861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tls-certs\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.674894 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.674878    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tmp-dir\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.776154 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.776114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-model-cache\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.776345 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.776191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tls-certs\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.776345 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.776217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tmp-dir\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.776345 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.776246    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-home\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.776345 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.776273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-dshm\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.776345 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.776311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd656\" (UniqueName: \"kubernetes.io/projected/1a0eaee4-a118-4e3c-9647-f868b8296a3f-kube-api-access-dd656\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.776630 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.776606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-model-cache\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.776692 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.776648    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-home\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.776740 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.776692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tmp-dir\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.778726 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.778658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-dshm\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.778726 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.778708    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tls-certs\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.785211 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.785187    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd656\" (UniqueName: \"kubernetes.io/projected/1a0eaee4-a118-4e3c-9647-f868b8296a3f-kube-api-access-dd656\") pod \"e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") " pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.840676 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.840648    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:02.977302 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:02.977263    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"]
Jul 22 15:37:02.979326 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:37:02.979301    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a0eaee4_a118_4e3c_9647_f868b8296a3f.slice/crio-48eac704b617d3cc005b28eac2e8f716b8be7cfeaf617d1bc4d3c3b3ec03e082 WatchSource:0}: Error finding container 48eac704b617d3cc005b28eac2e8f716b8be7cfeaf617d1bc4d3c3b3ec03e082: Status 404 returned error can't find the container with id 48eac704b617d3cc005b28eac2e8f716b8be7cfeaf617d1bc4d3c3b3ec03e082
Jul 22 15:37:03.413856 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:03.413769    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw" event={"ID":"1a0eaee4-a118-4e3c-9647-f868b8296a3f","Type":"ContainerStarted","Data":"56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5"}
Jul 22 15:37:03.413856 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:03.413822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw" event={"ID":"1a0eaee4-a118-4e3c-9647-f868b8296a3f","Type":"ContainerStarted","Data":"48eac704b617d3cc005b28eac2e8f716b8be7cfeaf617d1bc4d3c3b3ec03e082"}
Jul 22 15:37:03.432779 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:03.432729    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw" podStartSLOduration=1.432713497 podStartE2EDuration="1.432713497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:37:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:37:03.431059217 +0000 UTC m=+1447.094208653" watchObservedRunningTime="2026-07-22 15:37:03.432713497 +0000 UTC m=+1447.095862919"
Jul 22 15:37:12.841102 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:12.841063    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:12.841698 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:12.841119    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:12.853590 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:12.853567    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:13.476634 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:13.476608    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:37:25.522081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.522046    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"]
Jul 22 15:37:25.525824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.525799    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.528571 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.528548    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-5e94a61f-kserve-self-signed-certs\""
Jul 22 15:37:25.535898 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.535872    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"]
Jul 22 15:37:25.584537 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.584501    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-home\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.584537 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.584543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-tmp-dir\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.584773 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.584644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbwk2\" (UniqueName: \"kubernetes.io/projected/d57e86e5-0daa-4183-a20c-6876252763fb-kube-api-access-mbwk2\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.584773 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.584690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57e86e5-0daa-4183-a20c-6876252763fb-tls-certs\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.584773 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.584761    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-dshm\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.584897 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.584797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-model-cache\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.685354 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.685318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbwk2\" (UniqueName: \"kubernetes.io/projected/d57e86e5-0daa-4183-a20c-6876252763fb-kube-api-access-mbwk2\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.685354 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.685361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57e86e5-0daa-4183-a20c-6876252763fb-tls-certs\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.685615 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.685392    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-dshm\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.685615 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.685424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-model-cache\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.685615 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.685505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-home\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.685615 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.685531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-tmp-dir\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.685967 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.685944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-tmp-dir\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.685967 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.685956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-model-cache\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.686109 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.685981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-home\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.690663 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.688609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57e86e5-0daa-4183-a20c-6876252763fb-tls-certs\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.691056 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.691028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-dshm\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.694759 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.694731    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbwk2\" (UniqueName: \"kubernetes.io/projected/d57e86e5-0daa-4183-a20c-6876252763fb-kube-api-access-mbwk2\") pod \"e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") " pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.836693 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.836613    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:25.971718 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:25.971694    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"]
Jul 22 15:37:25.973579 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:37:25.973550    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd57e86e5_0daa_4183_a20c_6876252763fb.slice/crio-01707770f63331227972e3d927d7457e68d19e37d85a50eb378db5975694fc14 WatchSource:0}: Error finding container 01707770f63331227972e3d927d7457e68d19e37d85a50eb378db5975694fc14: Status 404 returned error can't find the container with id 01707770f63331227972e3d927d7457e68d19e37d85a50eb378db5975694fc14
Jul 22 15:37:26.527723 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:26.527688    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz" event={"ID":"d57e86e5-0daa-4183-a20c-6876252763fb","Type":"ContainerStarted","Data":"164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8"}
Jul 22 15:37:26.527723 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:26.527729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz" event={"ID":"d57e86e5-0daa-4183-a20c-6876252763fb","Type":"ContainerStarted","Data":"01707770f63331227972e3d927d7457e68d19e37d85a50eb378db5975694fc14"}
Jul 22 15:37:26.544987 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:26.544942    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz" podStartSLOduration=1.5448917629999999 podStartE2EDuration="1.544891763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:37:26.544504936 +0000 UTC m=+1470.207654349" watchObservedRunningTime="2026-07-22 15:37:26.544891763 +0000 UTC m=+1470.208041184"
Jul 22 15:37:35.837102 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:35.837060    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:35.837597 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:35.837117    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:35.849672 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:35.849650    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:36.586609 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:36.586582    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:37:47.181062 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:47.181026    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"]
Jul 22 15:37:47.823470 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:47.823437    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"]
Jul 22 15:37:56.783933 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:56.783874    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:37:56.787513 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:37:56.787493    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:38:02.201945 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.201869    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw" podUID="1a0eaee4-a118-4e3c-9647-f868b8296a3f" containerName="main" containerID="cri-o://56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5" gracePeriod=45
Jul 22 15:38:02.452689 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.452627    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:38:02.521320 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tls-certs\") pod \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") "
Jul 22 15:38:02.521507 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521329    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-model-cache\") pod \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") "
Jul 22 15:38:02.521507 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-home\") pod \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") "
Jul 22 15:38:02.521507 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521373    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tmp-dir\") pod \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") "
Jul 22 15:38:02.521507 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521391    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-dshm\") pod \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") "
Jul 22 15:38:02.521507 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521440    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd656\" (UniqueName: \"kubernetes.io/projected/1a0eaee4-a118-4e3c-9647-f868b8296a3f-kube-api-access-dd656\") pod \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\" (UID: \"1a0eaee4-a118-4e3c-9647-f868b8296a3f\") "
Jul 22 15:38:02.521751 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521648    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-home" (OuterVolumeSpecName: "home") pod "1a0eaee4-a118-4e3c-9647-f868b8296a3f" (UID: "1a0eaee4-a118-4e3c-9647-f868b8296a3f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:38:02.521751 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521661    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1a0eaee4-a118-4e3c-9647-f868b8296a3f" (UID: "1a0eaee4-a118-4e3c-9647-f868b8296a3f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:38:02.521751 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521672    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-model-cache" (OuterVolumeSpecName: "model-cache") pod "1a0eaee4-a118-4e3c-9647-f868b8296a3f" (UID: "1a0eaee4-a118-4e3c-9647-f868b8296a3f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:38:02.521891 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521774    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-model-cache\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:02.521891 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521788    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-home\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:02.521891 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.521797    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tmp-dir\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:02.523634 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.523607    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1a0eaee4-a118-4e3c-9647-f868b8296a3f" (UID: "1a0eaee4-a118-4e3c-9647-f868b8296a3f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:38:02.523634 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.523624    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a0eaee4-a118-4e3c-9647-f868b8296a3f-kube-api-access-dd656" (OuterVolumeSpecName: "kube-api-access-dd656") pod "1a0eaee4-a118-4e3c-9647-f868b8296a3f" (UID: "1a0eaee4-a118-4e3c-9647-f868b8296a3f"). InnerVolumeSpecName "kube-api-access-dd656". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:38:02.523768 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.523675    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-dshm" (OuterVolumeSpecName: "dshm") pod "1a0eaee4-a118-4e3c-9647-f868b8296a3f" (UID: "1a0eaee4-a118-4e3c-9647-f868b8296a3f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:38:02.622962 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.622906    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a0eaee4-a118-4e3c-9647-f868b8296a3f-tls-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:02.622962 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.622955    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a0eaee4-a118-4e3c-9647-f868b8296a3f-dshm\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:02.622962 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.622965    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd656\" (UniqueName: \"kubernetes.io/projected/1a0eaee4-a118-4e3c-9647-f868b8296a3f-kube-api-access-dd656\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:02.706086 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.705996    2580 generic.go:356] "Generic (PLEG): container finished" podID="1a0eaee4-a118-4e3c-9647-f868b8296a3f" containerID="56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5" exitCode=0
Jul 22 15:38:02.706086 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.706055    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"
Jul 22 15:38:02.706275 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.706095    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw" event={"ID":"1a0eaee4-a118-4e3c-9647-f868b8296a3f","Type":"ContainerDied","Data":"56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5"}
Jul 22 15:38:02.706275 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.706131    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw" event={"ID":"1a0eaee4-a118-4e3c-9647-f868b8296a3f","Type":"ContainerDied","Data":"48eac704b617d3cc005b28eac2e8f716b8be7cfeaf617d1bc4d3c3b3ec03e082"}
Jul 22 15:38:02.706275 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.706149    2580 scope.go:117] "RemoveContainer" containerID="56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5"
Jul 22 15:38:02.716133 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.716117    2580 scope.go:117] "RemoveContainer" containerID="56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5"
Jul 22 15:38:02.716440 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:38:02.716422    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5\": container with ID starting with 56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5 not found: ID does not exist" containerID="56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5"
Jul 22 15:38:02.716496 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.716449    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5"} err="failed to get container status \"56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5\": rpc error: code = NotFound desc = could not find container \"56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5\": container with ID starting with 56a90cb9a80fd326d5ddd0dd6e1f10bb5b8fc7e6dc5251af4ebb767d2f9917c5 not found: ID does not exist"
Jul 22 15:38:02.732818 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.732795    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"]
Jul 22 15:38:02.740143 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.740119    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-5e94a61f-kserve-56fc784555-9fvjw"]
Jul 22 15:38:02.780793 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.780768    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a0eaee4-a118-4e3c-9647-f868b8296a3f" path="/var/lib/kubelet/pods/1a0eaee4-a118-4e3c-9647-f868b8296a3f/volumes"
Jul 22 15:38:02.843468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:02.843432    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz" podUID="d57e86e5-0daa-4183-a20c-6876252763fb" containerName="main" containerID="cri-o://164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8" gracePeriod=45
Jul 22 15:38:03.098086 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.098061    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:38:03.128384 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.128354    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-dshm\") pod \"d57e86e5-0daa-4183-a20c-6876252763fb\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") "
Jul 22 15:38:03.128556 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.128420    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57e86e5-0daa-4183-a20c-6876252763fb-tls-certs\") pod \"d57e86e5-0daa-4183-a20c-6876252763fb\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") "
Jul 22 15:38:03.128556 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.128463    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-tmp-dir\") pod \"d57e86e5-0daa-4183-a20c-6876252763fb\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") "
Jul 22 15:38:03.128556 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.128532    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-home\") pod \"d57e86e5-0daa-4183-a20c-6876252763fb\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") "
Jul 22 15:38:03.128718 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.128557    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbwk2\" (UniqueName: \"kubernetes.io/projected/d57e86e5-0daa-4183-a20c-6876252763fb-kube-api-access-mbwk2\") pod \"d57e86e5-0daa-4183-a20c-6876252763fb\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") "
Jul 22 15:38:03.128718 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.128583    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-model-cache\") pod \"d57e86e5-0daa-4183-a20c-6876252763fb\" (UID: \"d57e86e5-0daa-4183-a20c-6876252763fb\") "
Jul 22 15:38:03.128832 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.128775    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d57e86e5-0daa-4183-a20c-6876252763fb" (UID: "d57e86e5-0daa-4183-a20c-6876252763fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:38:03.128949 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.128898    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-tmp-dir\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:03.129097 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.129009    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-home" (OuterVolumeSpecName: "home") pod "d57e86e5-0daa-4183-a20c-6876252763fb" (UID: "d57e86e5-0daa-4183-a20c-6876252763fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:38:03.129097 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.129025    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-model-cache" (OuterVolumeSpecName: "model-cache") pod "d57e86e5-0daa-4183-a20c-6876252763fb" (UID: "d57e86e5-0daa-4183-a20c-6876252763fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:38:03.130463 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.130433    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-dshm" (OuterVolumeSpecName: "dshm") pod "d57e86e5-0daa-4183-a20c-6876252763fb" (UID: "d57e86e5-0daa-4183-a20c-6876252763fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:38:03.130603 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.130584    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57e86e5-0daa-4183-a20c-6876252763fb-kube-api-access-mbwk2" (OuterVolumeSpecName: "kube-api-access-mbwk2") pod "d57e86e5-0daa-4183-a20c-6876252763fb" (UID: "d57e86e5-0daa-4183-a20c-6876252763fb"). InnerVolumeSpecName "kube-api-access-mbwk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:38:03.130890 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.130873    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d57e86e5-0daa-4183-a20c-6876252763fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d57e86e5-0daa-4183-a20c-6876252763fb" (UID: "d57e86e5-0daa-4183-a20c-6876252763fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:38:03.230034 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.230001    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-dshm\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:03.230034 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.230028    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d57e86e5-0daa-4183-a20c-6876252763fb-tls-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:03.230034 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.230038    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-home\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:03.230438 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.230047    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbwk2\" (UniqueName: \"kubernetes.io/projected/d57e86e5-0daa-4183-a20c-6876252763fb-kube-api-access-mbwk2\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:03.230438 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.230056    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d57e86e5-0daa-4183-a20c-6876252763fb-model-cache\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:38:03.712595 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.712558    2580 generic.go:356] "Generic (PLEG): container finished" podID="d57e86e5-0daa-4183-a20c-6876252763fb" containerID="164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8" exitCode=0
Jul 22 15:38:03.712805 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.712601    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"
Jul 22 15:38:03.712805 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.712644    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz" event={"ID":"d57e86e5-0daa-4183-a20c-6876252763fb","Type":"ContainerDied","Data":"164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8"}
Jul 22 15:38:03.712805 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.712685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz" event={"ID":"d57e86e5-0daa-4183-a20c-6876252763fb","Type":"ContainerDied","Data":"01707770f63331227972e3d927d7457e68d19e37d85a50eb378db5975694fc14"}
Jul 22 15:38:03.712805 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.712705    2580 scope.go:117] "RemoveContainer" containerID="164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8"
Jul 22 15:38:03.725479 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.725456    2580 scope.go:117] "RemoveContainer" containerID="164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8"
Jul 22 15:38:03.725808 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:38:03.725791    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8\": container with ID starting with 164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8 not found: ID does not exist" containerID="164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8"
Jul 22 15:38:03.725877 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.725821    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8"} err="failed to get container status \"164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8\": rpc error: code = NotFound desc = could not find container \"164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8\": container with ID starting with 164de76b2c164f25e9bc4b98726e1d0062859d2bdf7233bbc4de551104fce5a8 not found: ID does not exist"
Jul 22 15:38:03.737176 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.737153    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"]
Jul 22 15:38:03.741366 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:03.741346    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-5e94a61f-kserve-5dcdf79867-6kqzz"]
Jul 22 15:38:04.781584 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:38:04.781547    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d57e86e5-0daa-4183-a20c-6876252763fb" path="/var/lib/kubelet/pods/d57e86e5-0daa-4183-a20c-6876252763fb/volumes"
Jul 22 15:41:38.406832 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.406741    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"]
Jul 22 15:41:38.407444 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.407389    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57e86e5-0daa-4183-a20c-6876252763fb" containerName="main"
Jul 22 15:41:38.407444 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.407413    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57e86e5-0daa-4183-a20c-6876252763fb" containerName="main"
Jul 22 15:41:38.407444 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.407436    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a0eaee4-a118-4e3c-9647-f868b8296a3f" containerName="main"
Jul 22 15:41:38.407444 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.407446    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a0eaee4-a118-4e3c-9647-f868b8296a3f" containerName="main"
Jul 22 15:41:38.407662 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.407521    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a0eaee4-a118-4e3c-9647-f868b8296a3f" containerName="main"
Jul 22 15:41:38.407662 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.407549    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57e86e5-0daa-4183-a20c-6876252763fb" containerName="main"
Jul 22 15:41:38.410723 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.410703    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.413834 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.413811    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-88eef265-openshift-default-dockercfg-czs8h\""
Jul 22 15:41:38.435221 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.435190    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"]
Jul 22 15:41:38.558213 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.558183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rnhl\" (UniqueName: \"kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-kube-api-access-7rnhl\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.558396 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.558220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-certs\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.558396 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.558246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/058bfeff-603d-48c7-93e7-66d969b8f8b8-istiod-ca-cert\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.558396 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.558266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-credential-socket\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.558396 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.558284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-envoy\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.558396 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.558312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-podinfo\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.558578 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.558399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-data\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.558578 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.558462    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-socket\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.558578 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.558531    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-token\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.659964 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.659853    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-socket\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.659964 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.659911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-token\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.660195 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.659969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rnhl\" (UniqueName: \"kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-kube-api-access-7rnhl\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.660195 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.659988    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-certs\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.660195 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.660026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/058bfeff-603d-48c7-93e7-66d969b8f8b8-istiod-ca-cert\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.660195 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.660060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-credential-socket\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.660195 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.660084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-envoy\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.660195 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.660107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-podinfo\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.660195 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.660150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-data\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.660641 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.660313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-socket\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.660641 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.660395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-certs\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.660641 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.660466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-data\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.660641 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.660505    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-credential-socket\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.661031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.661001    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/058bfeff-603d-48c7-93e7-66d969b8f8b8-istiod-ca-cert\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.662498 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.662479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-envoy\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.662707 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.662689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-podinfo\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.668997 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.668975    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-token\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.669647 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.669622    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rnhl\" (UniqueName: \"kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-kube-api-access-7rnhl\") pod \"e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") " pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.721026 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.720995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:38.858750 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.858727    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"]
Jul 22 15:41:38.860719 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:41:38.860680    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058bfeff_603d_48c7_93e7_66d969b8f8b8.slice/crio-7a7413ae38281389f16ee2732a792b82c1b64b9e627b566594b3692d923fbffd WatchSource:0}: Error finding container 7a7413ae38281389f16ee2732a792b82c1b64b9e627b566594b3692d923fbffd: Status 404 returned error can't find the container with id 7a7413ae38281389f16ee2732a792b82c1b64b9e627b566594b3692d923fbffd
Jul 22 15:41:38.863219 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.863170    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:41:38.863331 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.863270    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:41:38.863331 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:38.863315    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:41:39.762094 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:39.762055    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" event={"ID":"058bfeff-603d-48c7-93e7-66d969b8f8b8","Type":"ContainerStarted","Data":"40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5"}
Jul 22 15:41:39.762568 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:39.762117    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" event={"ID":"058bfeff-603d-48c7-93e7-66d969b8f8b8","Type":"ContainerStarted","Data":"7a7413ae38281389f16ee2732a792b82c1b64b9e627b566594b3692d923fbffd"}
Jul 22 15:41:39.783830 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:39.783783    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" podStartSLOduration=1.783767621 podStartE2EDuration="1.783767621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:41:39.782277794 +0000 UTC m=+1723.445427216" watchObservedRunningTime="2026-07-22 15:41:39.783767621 +0000 UTC m=+1723.446917042"
Jul 22 15:41:40.721967 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:40.721911    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:40.727828 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:40.727803    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:40.767694 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:40.767667    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:40.768656 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:40.768635    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:41.222005 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.221969    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"]
Jul 22 15:41:41.226020 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.225999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:41.228982 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.228961    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jgh7j\""
Jul 22 15:41:41.229101 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.228991    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-88eef265-serving-cert\""
Jul 22 15:41:41.234795 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.234768    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"]
Jul 22 15:41:41.385547 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.385510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x7qj\" (UniqueName: \"kubernetes.io/projected/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-kube-api-access-9x7qj\") pod \"maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:41.385547 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.385553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-openshift-service-ca\") pod \"maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:41.385752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.385686    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-maas-api-tls\") pod \"maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:41.487135 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.487109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x7qj\" (UniqueName: \"kubernetes.io/projected/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-kube-api-access-9x7qj\") pod \"maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:41.487286 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.487149    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-openshift-service-ca\") pod \"maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:41.487286 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.487217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-maas-api-tls\") pod \"maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:41.487811 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.487792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-openshift-service-ca\") pod \"maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:41.489693 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.489675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-maas-api-tls\") pod \"maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:41.499479 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.499459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x7qj\" (UniqueName: \"kubernetes.io/projected/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-kube-api-access-9x7qj\") pod \"maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:41.538520 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.538491    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:41.671275 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.671252    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"]
Jul 22 15:41:41.673119 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:41:41.673094    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3946b278_9fb7_4a5f_8e1f_fdefea43e9c1.slice/crio-a3bb458743fbaca1e2c6feab353a642543ecb102bb2d3e5dade465ab4db635e5 WatchSource:0}: Error finding container a3bb458743fbaca1e2c6feab353a642543ecb102bb2d3e5dade465ab4db635e5: Status 404 returned error can't find the container with id a3bb458743fbaca1e2c6feab353a642543ecb102bb2d3e5dade465ab4db635e5
Jul 22 15:41:41.674498 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.674480    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 15:41:41.773592 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:41.773509    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv" event={"ID":"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1","Type":"ContainerStarted","Data":"a3bb458743fbaca1e2c6feab353a642543ecb102bb2d3e5dade465ab4db635e5"}
Jul 22 15:41:42.785959 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:42.785884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv" event={"ID":"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1","Type":"ContainerStarted","Data":"b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc"}
Jul 22 15:41:42.807048 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:42.806998    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv" podStartSLOduration=1.341755701 podStartE2EDuration="1.806984649s" totalImagesPullingTime="465.228948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:41:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:41:42.80535738 +0000 UTC m=+1726.468506802" watchObservedRunningTime="2026-07-22 15:41:42.806984649 +0000 UTC m=+1726.470134070"
Jul 22 15:41:43.790283 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:43.790242    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:49.800678 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:49.800644    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:41:56.102309 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:56.100816    2580 patch_prober.go:28] interesting pod/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": read tcp 10.133.0.2:36756->10.133.0.51:15021: read: connection reset by peer" start-of-body=
Jul 22 15:41:56.102309 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:56.100899    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": read tcp 10.133.0.2:36756->10.133.0.51:15021: read: connection reset by peer"
Jul 22 15:41:56.853209 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:56.853178    2580 generic.go:356] "Generic (PLEG): container finished" podID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerID="40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5" exitCode=0
Jul 22 15:41:56.853374 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:56.853234    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" event={"ID":"058bfeff-603d-48c7-93e7-66d969b8f8b8","Type":"ContainerDied","Data":"40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5"}
Jul 22 15:41:56.853554 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:56.853542    2580 scope.go:117] "RemoveContainer" containerID="40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5"
Jul 22 15:41:56.854559 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:56.854527    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:41:56.854665 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:56.854600    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:41:56.854665 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:56.854633    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:41:57.860912 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:57.860875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" event={"ID":"058bfeff-603d-48c7-93e7-66d969b8f8b8","Type":"ContainerStarted","Data":"a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1"}
Jul 22 15:41:58.721783 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:58.721742    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:41:58.722064 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:58.722040    2580 patch_prober.go:28] interesting pod/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 22 15:41:58.722116 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:58.722090    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 22 15:41:59.721557 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:59.721517    2580 patch_prober.go:28] interesting pod/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 22 15:41:59.721976 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:41:59.721578    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 22 15:42:00.722003 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:00.721969    2580 patch_prober.go:28] interesting pod/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 22 15:42:00.722410 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:00.722028    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 22 15:42:01.721608 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:01.721575    2580 patch_prober.go:28] interesting pod/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 22 15:42:01.721795 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:01.721629    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 22 15:42:02.724947 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:02.724901    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:42:02.725416 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:02.725306    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:42:02.725982 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:02.725963    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:42:17.167882 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.167849    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"]
Jul 22 15:42:17.168350 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.168101    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv" podUID="3946b278-9fb7-4a5f-8e1f-fdefea43e9c1" containerName="maas-api" containerID="cri-o://b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc" gracePeriod=30
Jul 22 15:42:17.423318 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.423259    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:42:17.531084 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.531052    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-maas-api-tls\") pod \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") "
Jul 22 15:42:17.531257 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.531117    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x7qj\" (UniqueName: \"kubernetes.io/projected/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-kube-api-access-9x7qj\") pod \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") "
Jul 22 15:42:17.531257 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.531166    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-openshift-service-ca\") pod \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\" (UID: \"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1\") "
Jul 22 15:42:17.531550 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.531515    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3946b278-9fb7-4a5f-8e1f-fdefea43e9c1" (UID: "3946b278-9fb7-4a5f-8e1f-fdefea43e9c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:42:17.533313 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.533288    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-kube-api-access-9x7qj" (OuterVolumeSpecName: "kube-api-access-9x7qj") pod "3946b278-9fb7-4a5f-8e1f-fdefea43e9c1" (UID: "3946b278-9fb7-4a5f-8e1f-fdefea43e9c1"). InnerVolumeSpecName "kube-api-access-9x7qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:42:17.533415 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.533293    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3946b278-9fb7-4a5f-8e1f-fdefea43e9c1" (UID: "3946b278-9fb7-4a5f-8e1f-fdefea43e9c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:42:17.632253 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.632223    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-maas-api-tls\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:17.632253 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.632252    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x7qj\" (UniqueName: \"kubernetes.io/projected/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-kube-api-access-9x7qj\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:17.632422 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.632263    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1-openshift-service-ca\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:17.965610 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.965568    2580 generic.go:356] "Generic (PLEG): container finished" podID="3946b278-9fb7-4a5f-8e1f-fdefea43e9c1" containerID="b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc" exitCode=0
Jul 22 15:42:17.965798 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.965615    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"
Jul 22 15:42:17.965798 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.965646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv" event={"ID":"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1","Type":"ContainerDied","Data":"b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc"}
Jul 22 15:42:17.965798 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.965704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv" event={"ID":"3946b278-9fb7-4a5f-8e1f-fdefea43e9c1","Type":"ContainerDied","Data":"a3bb458743fbaca1e2c6feab353a642543ecb102bb2d3e5dade465ab4db635e5"}
Jul 22 15:42:17.965798 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.965728    2580 scope.go:117] "RemoveContainer" containerID="b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc"
Jul 22 15:42:17.975505 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.975481    2580 scope.go:117] "RemoveContainer" containerID="b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc"
Jul 22 15:42:17.975781 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:42:17.975761    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc\": container with ID starting with b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc not found: ID does not exist" containerID="b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc"
Jul 22 15:42:17.975849 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.975790    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc"} err="failed to get container status \"b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc\": rpc error: code = NotFound desc = could not find container \"b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc\": container with ID starting with b35a4210172e0356d869cd1c34bb4c46f8dabbc29c4fae866dd6b7e030c76cbc not found: ID does not exist"
Jul 22 15:42:17.987415 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.987391    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"]
Jul 22 15:42:17.992841 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:17.992817    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-88eef265-75d94c46fb-x2pmv"]
Jul 22 15:42:18.781310 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:18.781276    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3946b278-9fb7-4a5f-8e1f-fdefea43e9c1" path="/var/lib/kubelet/pods/3946b278-9fb7-4a5f-8e1f-fdefea43e9c1/volumes"
Jul 22 15:42:21.953189 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:21.953150    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"]
Jul 22 15:42:21.953762 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:21.953477    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy" containerID="cri-o://a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1" gracePeriod=30
Jul 22 15:42:23.015181 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.015148    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"]
Jul 22 15:42:23.015558 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.015515    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3946b278-9fb7-4a5f-8e1f-fdefea43e9c1" containerName="maas-api"
Jul 22 15:42:23.015558 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.015536    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3946b278-9fb7-4a5f-8e1f-fdefea43e9c1" containerName="maas-api"
Jul 22 15:42:23.015635 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.015610    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3946b278-9fb7-4a5f-8e1f-fdefea43e9c1" containerName="maas-api"
Jul 22 15:42:23.019974 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.019956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.022859 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.022838    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e59bf8ff-gw-openshift-default-dockercfg-gmwzr\""
Jul 22 15:42:23.032155 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.032132    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"]
Jul 22 15:42:23.179580 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.179552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istiod-ca-cert\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.179749 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.179614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-data\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.179749 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.179653    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-token\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.179749 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.179680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-certs\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.179749 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.179698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-podinfo\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.179955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.179780    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-socket\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.179955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.179807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-envoy\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.179955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.179832    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx4vr\" (UniqueName: \"kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-kube-api-access-fx4vr\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.179955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.179908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-credential-socket\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.281408 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-data\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.281408 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-token\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.281408 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-certs\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.281696 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281432    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-podinfo\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.281696 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-socket\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.281696 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-envoy\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.281696 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx4vr\" (UniqueName: \"kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-kube-api-access-fx4vr\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.281696 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-credential-socket\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.281696 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istiod-ca-cert\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.282052 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281755    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-data\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.282052 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281854    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-certs\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.282052 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.281939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-socket\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.282219 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.282092    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-credential-socket\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.282398 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.282376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istiod-ca-cert\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.283826 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.283804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-envoy\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.283992 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.283970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-podinfo\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.290087 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.290067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-token\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.290453 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.290433    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx4vr\" (UniqueName: \"kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-kube-api-access-fx4vr\") pod \"e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") " pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.331188 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.331157    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:23.468983 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.468955    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"]
Jul 22 15:42:23.470871 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:42:23.470841    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbce85f_5a65_4f2b_bd9c_46de439d271f.slice/crio-a4060fa925010e1c5dbfff2f9276d4bba788d75c61e15204ee792eb683243c7c WatchSource:0}: Error finding container a4060fa925010e1c5dbfff2f9276d4bba788d75c61e15204ee792eb683243c7c: Status 404 returned error can't find the container with id a4060fa925010e1c5dbfff2f9276d4bba788d75c61e15204ee792eb683243c7c
Jul 22 15:42:23.473435 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.473404    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:42:23.473504 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.473470    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:42:23.473504 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.473498    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:42:23.998005 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.997974    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" event={"ID":"ecbce85f-5a65-4f2b-bd9c-46de439d271f","Type":"ContainerStarted","Data":"5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec"}
Jul 22 15:42:23.998187 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:23.998034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" event={"ID":"ecbce85f-5a65-4f2b-bd9c-46de439d271f","Type":"ContainerStarted","Data":"a4060fa925010e1c5dbfff2f9276d4bba788d75c61e15204ee792eb683243c7c"}
Jul 22 15:42:24.020770 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:24.020725    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" podStartSLOduration=2.020710397 podStartE2EDuration="2.020710397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:42:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:42:24.018761165 +0000 UTC m=+1767.681910586" watchObservedRunningTime="2026-07-22 15:42:24.020710397 +0000 UTC m=+1767.683859818"
Jul 22 15:42:24.332003 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:24.331902    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:24.336549 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:24.336525    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:25.002961 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:25.002930    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:25.004087 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:25.004066    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:27.212788 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.212759    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:42:27.323488 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.323454    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-token\") pod \"058bfeff-603d-48c7-93e7-66d969b8f8b8\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") "
Jul 22 15:42:27.323692 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.323497    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-envoy\") pod \"058bfeff-603d-48c7-93e7-66d969b8f8b8\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") "
Jul 22 15:42:27.323692 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.323522    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-socket\") pod \"058bfeff-603d-48c7-93e7-66d969b8f8b8\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") "
Jul 22 15:42:27.323692 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.323553    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-credential-socket\") pod \"058bfeff-603d-48c7-93e7-66d969b8f8b8\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") "
Jul 22 15:42:27.323692 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.323613    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-data\") pod \"058bfeff-603d-48c7-93e7-66d969b8f8b8\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") "
Jul 22 15:42:27.323692 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.323668    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-certs\") pod \"058bfeff-603d-48c7-93e7-66d969b8f8b8\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") "
Jul 22 15:42:27.323976 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.323707    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-podinfo\") pod \"058bfeff-603d-48c7-93e7-66d969b8f8b8\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") "
Jul 22 15:42:27.323976 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.323735    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rnhl\" (UniqueName: \"kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-kube-api-access-7rnhl\") pod \"058bfeff-603d-48c7-93e7-66d969b8f8b8\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") "
Jul 22 15:42:27.323976 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.323829    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/058bfeff-603d-48c7-93e7-66d969b8f8b8-istiod-ca-cert\") pod \"058bfeff-603d-48c7-93e7-66d969b8f8b8\" (UID: \"058bfeff-603d-48c7-93e7-66d969b8f8b8\") "
Jul 22 15:42:27.323976 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.323848    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "058bfeff-603d-48c7-93e7-66d969b8f8b8" (UID: "058bfeff-603d-48c7-93e7-66d969b8f8b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:42:27.323976 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.323878    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "058bfeff-603d-48c7-93e7-66d969b8f8b8" (UID: "058bfeff-603d-48c7-93e7-66d969b8f8b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:42:27.324240 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.324194    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:27.324240 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.324215    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:27.324347 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.324233    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/058bfeff-603d-48c7-93e7-66d969b8f8b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "058bfeff-603d-48c7-93e7-66d969b8f8b8" (UID: "058bfeff-603d-48c7-93e7-66d969b8f8b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:42:27.324347 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.324300    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "058bfeff-603d-48c7-93e7-66d969b8f8b8" (UID: "058bfeff-603d-48c7-93e7-66d969b8f8b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:42:27.324725 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.324696    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "058bfeff-603d-48c7-93e7-66d969b8f8b8" (UID: "058bfeff-603d-48c7-93e7-66d969b8f8b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:42:27.325949 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.325905    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "058bfeff-603d-48c7-93e7-66d969b8f8b8" (UID: "058bfeff-603d-48c7-93e7-66d969b8f8b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 15:42:27.326065 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.326036    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "058bfeff-603d-48c7-93e7-66d969b8f8b8" (UID: "058bfeff-603d-48c7-93e7-66d969b8f8b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:42:27.326173 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.326124    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "058bfeff-603d-48c7-93e7-66d969b8f8b8" (UID: "058bfeff-603d-48c7-93e7-66d969b8f8b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:42:27.326244 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.326219    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-kube-api-access-7rnhl" (OuterVolumeSpecName: "kube-api-access-7rnhl") pod "058bfeff-603d-48c7-93e7-66d969b8f8b8" (UID: "058bfeff-603d-48c7-93e7-66d969b8f8b8"). InnerVolumeSpecName "kube-api-access-7rnhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:42:27.425079 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.425043    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:27.425079 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.425073    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:27.425079 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.425083    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:27.425315 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.425091    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rnhl\" (UniqueName: \"kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-kube-api-access-7rnhl\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:27.425315 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.425102    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/058bfeff-603d-48c7-93e7-66d969b8f8b8-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:27.425315 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.425110    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:27.425315 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:27.425117    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/058bfeff-603d-48c7-93e7-66d969b8f8b8-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:42:28.023926 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.023883    2580 generic.go:356] "Generic (PLEG): container finished" podID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerID="a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1" exitCode=0
Jul 22 15:42:28.024102 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.023950    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"
Jul 22 15:42:28.024102 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.023966    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" event={"ID":"058bfeff-603d-48c7-93e7-66d969b8f8b8","Type":"ContainerDied","Data":"a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1"}
Jul 22 15:42:28.024102 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.024021    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz" event={"ID":"058bfeff-603d-48c7-93e7-66d969b8f8b8","Type":"ContainerDied","Data":"7a7413ae38281389f16ee2732a792b82c1b64b9e627b566594b3692d923fbffd"}
Jul 22 15:42:28.024102 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.024046    2580 scope.go:117] "RemoveContainer" containerID="a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1"
Jul 22 15:42:28.033289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.033271    2580 scope.go:117] "RemoveContainer" containerID="40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5"
Jul 22 15:42:28.040912 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.040897    2580 scope.go:117] "RemoveContainer" containerID="a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1"
Jul 22 15:42:28.041180 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:42:28.041161    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1\": container with ID starting with a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1 not found: ID does not exist" containerID="a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1"
Jul 22 15:42:28.041246 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.041188    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1"} err="failed to get container status \"a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1\": rpc error: code = NotFound desc = could not find container \"a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1\": container with ID starting with a4349dbf94db3c0d40a8df8e0bf3948ff3c91d32b8fe94e727ee481d65e3fec1 not found: ID does not exist"
Jul 22 15:42:28.041246 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.041203    2580 scope.go:117] "RemoveContainer" containerID="40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5"
Jul 22 15:42:28.041427 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:42:28.041410    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5\": container with ID starting with 40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5 not found: ID does not exist" containerID="40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5"
Jul 22 15:42:28.041464 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.041434    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5"} err="failed to get container status \"40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5\": rpc error: code = NotFound desc = could not find container \"40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5\": container with ID starting with 40efe90188b6810e8a474eec7a08db8026f294e02981ac8e369deb224c5b85f5 not found: ID does not exist"
Jul 22 15:42:28.046172 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.046149    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"]
Jul 22 15:42:28.049491 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.049471    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-88eef265-openshift-default-79f597dbd5-zjpsz"]
Jul 22 15:42:28.781460 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:28.781428    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" path="/var/lib/kubelet/pods/058bfeff-603d-48c7-93e7-66d969b8f8b8/volumes"
Jul 22 15:42:40.004494 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:40.004452    2580 patch_prober.go:28] interesting pod/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 22 15:42:40.005013 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:40.004539    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 22 15:42:40.085264 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:40.085232    2580 generic.go:356] "Generic (PLEG): container finished" podID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerID="5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec" exitCode=0
Jul 22 15:42:40.085444 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:40.085312    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" event={"ID":"ecbce85f-5a65-4f2b-bd9c-46de439d271f","Type":"ContainerDied","Data":"5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec"}
Jul 22 15:42:40.085725 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:40.085711    2580 scope.go:117] "RemoveContainer" containerID="5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec"
Jul 22 15:42:40.086826 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:40.086797    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:42:40.086899 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:40.086880    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:42:40.086965 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:40.086941    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:42:41.092736 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:41.092702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" event={"ID":"ecbce85f-5a65-4f2b-bd9c-46de439d271f","Type":"ContainerStarted","Data":"f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e"}
Jul 22 15:42:41.331731 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:41.331693    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:41.332024 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:41.332002    2580 patch_prober.go:28] interesting pod/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 22 15:42:41.332097 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:41.332050    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 22 15:42:42.331522 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:42.331480    2580 patch_prober.go:28] interesting pod/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 22 15:42:42.332021 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:42.331560    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 22 15:42:43.332005 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:43.331969    2580 patch_prober.go:28] interesting pod/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 22 15:42:43.332377 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:43.332025    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 22 15:42:44.331552 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:44.331507    2580 patch_prober.go:28] interesting pod/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 22 15:42:44.331735 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:44.331573    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 22 15:42:45.335258 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:45.335226    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:45.335649 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:45.335511    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:45.336154 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:45.336138    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:42:56.811385 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:56.811357    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:42:56.817848 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:42:56.817828    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:43:05.689289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:05.689253    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"]
Jul 22 15:43:05.689762 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:05.689499    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy" containerID="cri-o://f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e" gracePeriod=30
Jul 22 15:43:06.454299 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.454268    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"]
Jul 22 15:43:06.454764 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.454735    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy"
Jul 22 15:43:06.454764 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.454760    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy"
Jul 22 15:43:06.455032 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.454777    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy"
Jul 22 15:43:06.455032 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.454877    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy"
Jul 22 15:43:06.455178 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.455112    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy"
Jul 22 15:43:06.455178 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.455146    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="058bfeff-603d-48c7-93e7-66d969b8f8b8" containerName="istio-proxy"
Jul 22 15:43:06.458330 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.458311    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.461054 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.461030    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e6514ea7-openshift-default-dockercfg-684dx\""
Jul 22 15:43:06.470972 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.470876    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"]
Jul 22 15:43:06.595292 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.595255    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-token\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.595292 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.595291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fba61b53-191b-411b-815c-64a41fd6b9ae-istiod-ca-cert\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.595504 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.595323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2279t\" (UniqueName: \"kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-kube-api-access-2279t\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.595504 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.595396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-certs\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.595504 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.595429    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-podinfo\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.595504 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.595454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-credential-socket\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.595504 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.595474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-data\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.595682 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.595520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-envoy\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.595682 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.595569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-socket\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.696205 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.696174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2279t\" (UniqueName: \"kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-kube-api-access-2279t\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.696645 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.696225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-certs\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.696645 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.696255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-podinfo\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.696645 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.696278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-credential-socket\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.696645 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.696294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-data\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.696645 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.696534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-envoy\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.696645 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.696614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-socket\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.696982 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.696666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-token\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.696982 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.696691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fba61b53-191b-411b-815c-64a41fd6b9ae-istiod-ca-cert\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.696982 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.696694    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-data\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.696982 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.696773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-credential-socket\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.697154 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.697010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-certs\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.697154 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.697095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-socket\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.697489 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.697462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fba61b53-191b-411b-815c-64a41fd6b9ae-istiod-ca-cert\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.698901 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.698875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-envoy\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.699084 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.699065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-podinfo\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.704855 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.704793    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-token\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.705372 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.705351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2279t\" (UniqueName: \"kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-kube-api-access-2279t\") pod \"e2e-ait-e6514ea7-openshift-default-65645649f-966gw\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") " pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.771168 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.771139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:06.915084 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.915056    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"]
Jul 22 15:43:06.916102 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:43:06.916070    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba61b53_191b_411b_815c_64a41fd6b9ae.slice/crio-a31c861b0eec6fbce2b9b0ab312e95a86a39d1017989476e78b69343911c8c02 WatchSource:0}: Error finding container a31c861b0eec6fbce2b9b0ab312e95a86a39d1017989476e78b69343911c8c02: Status 404 returned error can't find the container with id a31c861b0eec6fbce2b9b0ab312e95a86a39d1017989476e78b69343911c8c02
Jul 22 15:43:06.918278 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.918241    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:43:06.918387 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.918308    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:43:06.918387 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:06.918336    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:43:07.217668 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:07.217567    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" event={"ID":"fba61b53-191b-411b-815c-64a41fd6b9ae","Type":"ContainerStarted","Data":"b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd"}
Jul 22 15:43:07.217668 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:07.217647    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" event={"ID":"fba61b53-191b-411b-815c-64a41fd6b9ae","Type":"ContainerStarted","Data":"a31c861b0eec6fbce2b9b0ab312e95a86a39d1017989476e78b69343911c8c02"}
Jul 22 15:43:07.239116 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:07.239047    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" podStartSLOduration=1.239026189 podStartE2EDuration="1.239026189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:43:07.238089659 +0000 UTC m=+1810.901239083" watchObservedRunningTime="2026-07-22 15:43:07.239026189 +0000 UTC m=+1810.902175611"
Jul 22 15:43:07.771307 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:07.771270    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:07.776523 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:07.776496    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:08.222726 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:08.222637    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:08.229662 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:08.229619    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:10.935882 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:10.935858    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:43:11.037847 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.037810    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-data\") pod \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") "
Jul 22 15:43:11.038081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.037860    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-envoy\") pod \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") "
Jul 22 15:43:11.038081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.037945    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-socket\") pod \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") "
Jul 22 15:43:11.038081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.037988    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-certs\") pod \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") "
Jul 22 15:43:11.038081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038027    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-podinfo\") pod \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") "
Jul 22 15:43:11.038081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038066    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-token\") pod \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") "
Jul 22 15:43:11.038358 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038096    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx4vr\" (UniqueName: \"kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-kube-api-access-fx4vr\") pod \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") "
Jul 22 15:43:11.038358 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038129    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-credential-socket\") pod \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") "
Jul 22 15:43:11.038358 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038224    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istiod-ca-cert\") pod \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\" (UID: \"ecbce85f-5a65-4f2b-bd9c-46de439d271f\") "
Jul 22 15:43:11.038358 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038269    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ecbce85f-5a65-4f2b-bd9c-46de439d271f" (UID: "ecbce85f-5a65-4f2b-bd9c-46de439d271f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:43:11.038358 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038292    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ecbce85f-5a65-4f2b-bd9c-46de439d271f" (UID: "ecbce85f-5a65-4f2b-bd9c-46de439d271f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:43:11.038623 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038496    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ecbce85f-5a65-4f2b-bd9c-46de439d271f" (UID: "ecbce85f-5a65-4f2b-bd9c-46de439d271f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:43:11.038623 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038603    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:11.038623 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038619    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:11.038756 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038632    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:11.038756 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.038668    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ecbce85f-5a65-4f2b-bd9c-46de439d271f" (UID: "ecbce85f-5a65-4f2b-bd9c-46de439d271f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:43:11.039309 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.039284    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-data" (OuterVolumeSpecName: "istio-data") pod "ecbce85f-5a65-4f2b-bd9c-46de439d271f" (UID: "ecbce85f-5a65-4f2b-bd9c-46de439d271f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:43:11.040306 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.040285    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-token" (OuterVolumeSpecName: "istio-token") pod "ecbce85f-5a65-4f2b-bd9c-46de439d271f" (UID: "ecbce85f-5a65-4f2b-bd9c-46de439d271f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:43:11.040406 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.040383    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-kube-api-access-fx4vr" (OuterVolumeSpecName: "kube-api-access-fx4vr") pod "ecbce85f-5a65-4f2b-bd9c-46de439d271f" (UID: "ecbce85f-5a65-4f2b-bd9c-46de439d271f"). InnerVolumeSpecName "kube-api-access-fx4vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:43:11.040521 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.040500    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ecbce85f-5a65-4f2b-bd9c-46de439d271f" (UID: "ecbce85f-5a65-4f2b-bd9c-46de439d271f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:43:11.040521 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.040508    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ecbce85f-5a65-4f2b-bd9c-46de439d271f" (UID: "ecbce85f-5a65-4f2b-bd9c-46de439d271f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 15:43:11.139463 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.139431    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:11.139463 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.139457    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:11.139463 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.139466    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:11.139463 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.139474    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:11.139728 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.139482    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:11.139728 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.139491    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx4vr\" (UniqueName: \"kubernetes.io/projected/ecbce85f-5a65-4f2b-bd9c-46de439d271f-kube-api-access-fx4vr\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:11.237728 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.237694    2580 generic.go:356] "Generic (PLEG): container finished" podID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerID="f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e" exitCode=0
Jul 22 15:43:11.237890 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.237758    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"
Jul 22 15:43:11.237890 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.237783    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" event={"ID":"ecbce85f-5a65-4f2b-bd9c-46de439d271f","Type":"ContainerDied","Data":"f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e"}
Jul 22 15:43:11.237890 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.237837    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf" event={"ID":"ecbce85f-5a65-4f2b-bd9c-46de439d271f","Type":"ContainerDied","Data":"a4060fa925010e1c5dbfff2f9276d4bba788d75c61e15204ee792eb683243c7c"}
Jul 22 15:43:11.237890 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.237859    2580 scope.go:117] "RemoveContainer" containerID="f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e"
Jul 22 15:43:11.249426 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.249350    2580 scope.go:117] "RemoveContainer" containerID="5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec"
Jul 22 15:43:11.257640 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.257622    2580 scope.go:117] "RemoveContainer" containerID="f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e"
Jul 22 15:43:11.257875 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:43:11.257859    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e\": container with ID starting with f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e not found: ID does not exist" containerID="f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e"
Jul 22 15:43:11.257940 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.257882    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e"} err="failed to get container status \"f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e\": rpc error: code = NotFound desc = could not find container \"f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e\": container with ID starting with f276b76b06fbbb04b8afafc6323a23614e4ab1d210a3ae261764f7de6eb72a7e not found: ID does not exist"
Jul 22 15:43:11.257940 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.257897    2580 scope.go:117] "RemoveContainer" containerID="5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec"
Jul 22 15:43:11.258157 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:43:11.258137    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec\": container with ID starting with 5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec not found: ID does not exist" containerID="5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec"
Jul 22 15:43:11.258201 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.258164    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec"} err="failed to get container status \"5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec\": rpc error: code = NotFound desc = could not find container \"5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec\": container with ID starting with 5e139bfd59428691c7652c25cfb1bcad01373f8af2983d38cd5399a68bff04ec not found: ID does not exist"
Jul 22 15:43:11.262508 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.262486    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"]
Jul 22 15:43:11.266517 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:11.266497    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e59bf8ff-gw-openshift-default-84498d8fdc-tncgf"]
Jul 22 15:43:12.780814 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:12.780775    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" path="/var/lib/kubelet/pods/ecbce85f-5a65-4f2b-bd9c-46de439d271f/volumes"
Jul 22 15:43:23.731258 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:23.729768    2580 patch_prober.go:28] interesting pod/e2e-ait-e6514ea7-openshift-default-65645649f-966gw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:39044->10.133.0.54:15021: read: connection reset by peer" start-of-body=
Jul 22 15:43:23.731258 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:23.729846    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": read tcp 10.133.0.2:39044->10.133.0.54:15021: read: connection reset by peer"
Jul 22 15:43:24.310484 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:24.310448    2580 generic.go:356] "Generic (PLEG): container finished" podID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerID="b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd" exitCode=0
Jul 22 15:43:24.310664 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:24.310521    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" event={"ID":"fba61b53-191b-411b-815c-64a41fd6b9ae","Type":"ContainerDied","Data":"b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd"}
Jul 22 15:43:24.311041 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:24.311022    2580 scope.go:117] "RemoveContainer" containerID="b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd"
Jul 22 15:43:24.312083 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:24.312049    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:43:24.312202 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:24.312141    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:43:24.312267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:24.312201    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:43:25.317480 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:25.317448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" event={"ID":"fba61b53-191b-411b-815c-64a41fd6b9ae","Type":"ContainerStarted","Data":"bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829"}
Jul 22 15:43:25.772440 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:25.772403    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:25.773365 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:25.772733    2580 patch_prober.go:28] interesting pod/e2e-ait-e6514ea7-openshift-default-65645649f-966gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 22 15:43:25.773573 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:25.773550    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 22 15:43:26.771508 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:26.771472    2580 patch_prober.go:28] interesting pod/e2e-ait-e6514ea7-openshift-default-65645649f-966gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 22 15:43:26.772103 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:26.772070    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 22 15:43:27.772039 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:27.771991    2580 patch_prober.go:28] interesting pod/e2e-ait-e6514ea7-openshift-default-65645649f-966gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 22 15:43:27.772573 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:27.772062    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 22 15:43:28.771998 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:28.771957    2580 patch_prober.go:28] interesting pod/e2e-ait-e6514ea7-openshift-default-65645649f-966gw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 22 15:43:28.772214 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:28.772030    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 22 15:43:29.775585 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:29.775544    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:29.775982 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:29.775808    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:29.776447 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:29.776429    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:50.654732 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:50.654699    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"]
Jul 22 15:43:50.655341 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:50.654960    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy" containerID="cri-o://bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829" gracePeriod=30
Jul 22 15:43:51.432392 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.432358    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"]
Jul 22 15:43:51.432752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.432741    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy"
Jul 22 15:43:51.432796 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.432754    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy"
Jul 22 15:43:51.432843 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.432834    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy"
Jul 22 15:43:51.432879 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.432844    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy"
Jul 22 15:43:51.436222 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.436198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.439739 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.439718    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-37d7a1f9-openshift-default-dockercfg-cs52z\""
Jul 22 15:43:51.449357 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.449335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"]
Jul 22 15:43:51.511294 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.511252    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istiod-ca-cert\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.511294 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.511300    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94dj9\" (UniqueName: \"kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-kube-api-access-94dj9\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.511551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.511335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-credential-socket\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.511551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.511373    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-podinfo\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.511551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.511413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-data\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.511551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.511449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-socket\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.511551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.511510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-certs\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.511551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.511527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-envoy\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.511551 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.511553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-token\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.612626 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.612592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-certs\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.612626 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.612631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-envoy\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.612888 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.612652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-token\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.612888 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.612697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istiod-ca-cert\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.612888 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.612715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94dj9\" (UniqueName: \"kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-kube-api-access-94dj9\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.612888 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.612748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-credential-socket\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.612888 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.612782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-podinfo\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.612888 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.612838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-data\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.612888 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.612872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-socket\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.613306 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.613115    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-certs\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.613306 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.613255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-socket\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.613411 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.613387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-data\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.613486 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.613462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-credential-socket\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.613606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.613493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istiod-ca-cert\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.615068 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.615042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-envoy\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.615509 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.615490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-podinfo\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.621738 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.621711    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-token\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.622108 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.622090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94dj9\" (UniqueName: \"kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-kube-api-access-94dj9\") pod \"e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") " pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.749053 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.749011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:51.901289 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.901264    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"]
Jul 22 15:43:51.903357 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:43:51.903330    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed568cf_36d3_46b1_bcc0_4a679b64ec44.slice/crio-121cf7caf671b5c307d6b395f35fe1afd0b2dd9b093b6b5fbd6991b2115bd367 WatchSource:0}: Error finding container 121cf7caf671b5c307d6b395f35fe1afd0b2dd9b093b6b5fbd6991b2115bd367: Status 404 returned error can't find the container with id 121cf7caf671b5c307d6b395f35fe1afd0b2dd9b093b6b5fbd6991b2115bd367
Jul 22 15:43:51.905615 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.905579    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:43:51.905708 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.905648    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:43:51.905708 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:51.905677    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:43:52.449244 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:52.449209    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" event={"ID":"5ed568cf-36d3-46b1-bcc0-4a679b64ec44","Type":"ContainerStarted","Data":"240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e"}
Jul 22 15:43:52.449425 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:52.449266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" event={"ID":"5ed568cf-36d3-46b1-bcc0-4a679b64ec44","Type":"ContainerStarted","Data":"121cf7caf671b5c307d6b395f35fe1afd0b2dd9b093b6b5fbd6991b2115bd367"}
Jul 22 15:43:52.470951 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:52.470876    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" podStartSLOduration=1.470856323 podStartE2EDuration="1.470856323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:43:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:43:52.46969129 +0000 UTC m=+1856.132840712" watchObservedRunningTime="2026-07-22 15:43:52.470856323 +0000 UTC m=+1856.134005832"
Jul 22 15:43:52.749740 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:52.749698    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:52.754776 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:52.754753    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:53.454655 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:53.454613    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:53.455452 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:53.455431    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:43:55.900140 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:55.900114    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:56.055629 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.055600    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-envoy\") pod \"fba61b53-191b-411b-815c-64a41fd6b9ae\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") "
Jul 22 15:43:56.055803 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.055639    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-token\") pod \"fba61b53-191b-411b-815c-64a41fd6b9ae\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") "
Jul 22 15:43:56.055803 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.055689    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fba61b53-191b-411b-815c-64a41fd6b9ae-istiod-ca-cert\") pod \"fba61b53-191b-411b-815c-64a41fd6b9ae\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") "
Jul 22 15:43:56.055803 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.055717    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-credential-socket\") pod \"fba61b53-191b-411b-815c-64a41fd6b9ae\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") "
Jul 22 15:43:56.055803 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.055746    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-certs\") pod \"fba61b53-191b-411b-815c-64a41fd6b9ae\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") "
Jul 22 15:43:56.056032 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.055814    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2279t\" (UniqueName: \"kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-kube-api-access-2279t\") pod \"fba61b53-191b-411b-815c-64a41fd6b9ae\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") "
Jul 22 15:43:56.056032 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.055875    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-podinfo\") pod \"fba61b53-191b-411b-815c-64a41fd6b9ae\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") "
Jul 22 15:43:56.056134 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.056040    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fba61b53-191b-411b-815c-64a41fd6b9ae" (UID: "fba61b53-191b-411b-815c-64a41fd6b9ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:43:56.056134 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.056101    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fba61b53-191b-411b-815c-64a41fd6b9ae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fba61b53-191b-411b-815c-64a41fd6b9ae" (UID: "fba61b53-191b-411b-815c-64a41fd6b9ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:43:56.056134 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.056128    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-data\") pod \"fba61b53-191b-411b-815c-64a41fd6b9ae\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") "
Jul 22 15:43:56.056301 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.056137    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fba61b53-191b-411b-815c-64a41fd6b9ae" (UID: "fba61b53-191b-411b-815c-64a41fd6b9ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:43:56.056301 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.056159    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-socket\") pod \"fba61b53-191b-411b-815c-64a41fd6b9ae\" (UID: \"fba61b53-191b-411b-815c-64a41fd6b9ae\") "
Jul 22 15:43:56.056671 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.056426    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fba61b53-191b-411b-815c-64a41fd6b9ae" (UID: "fba61b53-191b-411b-815c-64a41fd6b9ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:43:56.056671 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.056550    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fba61b53-191b-411b-815c-64a41fd6b9ae-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:56.056671 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.056571    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:56.056671 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.056587    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:56.056671 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.056602    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:56.057099 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.056762    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-data" (OuterVolumeSpecName: "istio-data") pod "fba61b53-191b-411b-815c-64a41fd6b9ae" (UID: "fba61b53-191b-411b-815c-64a41fd6b9ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:43:56.057802 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.057783    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fba61b53-191b-411b-815c-64a41fd6b9ae" (UID: "fba61b53-191b-411b-815c-64a41fd6b9ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:43:56.058120 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.058097    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fba61b53-191b-411b-815c-64a41fd6b9ae" (UID: "fba61b53-191b-411b-815c-64a41fd6b9ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 15:43:56.058254 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.058232    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-kube-api-access-2279t" (OuterVolumeSpecName: "kube-api-access-2279t") pod "fba61b53-191b-411b-815c-64a41fd6b9ae" (UID: "fba61b53-191b-411b-815c-64a41fd6b9ae"). InnerVolumeSpecName "kube-api-access-2279t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:43:56.058319 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.058261    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-token" (OuterVolumeSpecName: "istio-token") pod "fba61b53-191b-411b-815c-64a41fd6b9ae" (UID: "fba61b53-191b-411b-815c-64a41fd6b9ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:43:56.157223 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.157186    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2279t\" (UniqueName: \"kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-kube-api-access-2279t\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:56.157223 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.157217    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:56.157223 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.157227    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:56.157223 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.157236    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:56.157500 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.157244    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fba61b53-191b-411b-815c-64a41fd6b9ae-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:43:56.470907 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.470820    2580 generic.go:356] "Generic (PLEG): container finished" podID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerID="bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829" exitCode=0
Jul 22 15:43:56.470907 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.470869    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"
Jul 22 15:43:56.471117 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.470898    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" event={"ID":"fba61b53-191b-411b-815c-64a41fd6b9ae","Type":"ContainerDied","Data":"bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829"}
Jul 22 15:43:56.471117 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.470965    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw" event={"ID":"fba61b53-191b-411b-815c-64a41fd6b9ae","Type":"ContainerDied","Data":"a31c861b0eec6fbce2b9b0ab312e95a86a39d1017989476e78b69343911c8c02"}
Jul 22 15:43:56.471117 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.470986    2580 scope.go:117] "RemoveContainer" containerID="bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829"
Jul 22 15:43:56.480608 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.480591    2580 scope.go:117] "RemoveContainer" containerID="b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd"
Jul 22 15:43:56.488483 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.488466    2580 scope.go:117] "RemoveContainer" containerID="bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829"
Jul 22 15:43:56.488760 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:43:56.488738    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829\": container with ID starting with bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829 not found: ID does not exist" containerID="bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829"
Jul 22 15:43:56.488807 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.488768    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829"} err="failed to get container status \"bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829\": rpc error: code = NotFound desc = could not find container \"bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829\": container with ID starting with bbbb988f9ca78d45e3ca87a6a5ff7fb0eb044a5166d5986256712a7f17f79829 not found: ID does not exist"
Jul 22 15:43:56.488807 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.488787    2580 scope.go:117] "RemoveContainer" containerID="b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd"
Jul 22 15:43:56.489101 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:43:56.489081    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd\": container with ID starting with b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd not found: ID does not exist" containerID="b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd"
Jul 22 15:43:56.489173 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.489107    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd"} err="failed to get container status \"b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd\": rpc error: code = NotFound desc = could not find container \"b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd\": container with ID starting with b3be461dad0a9f66b8e97faf62fc640f0077c2d2ebd402256c93efdcdd942bdd not found: ID does not exist"
Jul 22 15:43:56.493183 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.493151    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"]
Jul 22 15:43:56.498934 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.498899    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e6514ea7-openshift-default-65645649f-966gw"]
Jul 22 15:43:56.782683 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:43:56.782645    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" path="/var/lib/kubelet/pods/fba61b53-191b-411b-815c-64a41fd6b9ae/volumes"
Jul 22 15:44:07.526877 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:07.526838    2580 generic.go:356] "Generic (PLEG): container finished" podID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerID="240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e" exitCode=0
Jul 22 15:44:07.527389 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:07.526936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" event={"ID":"5ed568cf-36d3-46b1-bcc0-4a679b64ec44","Type":"ContainerDied","Data":"240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e"}
Jul 22 15:44:07.527389 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:07.527352    2580 scope.go:117] "RemoveContainer" containerID="240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e"
Jul 22 15:44:07.528345 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:07.528319    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:44:07.528406 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:07.528387    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:44:07.528461 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:07.528419    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:44:08.454883 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:08.454847    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:44:08.533316 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:08.533278    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" event={"ID":"5ed568cf-36d3-46b1-bcc0-4a679b64ec44","Type":"ContainerStarted","Data":"7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924"}
Jul 22 15:44:08.749884 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:08.749844    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:44:08.751081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:08.751051    2580 patch_prober.go:28] interesting pod/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 22 15:44:08.751207 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:08.751107    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 22 15:44:09.750198 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:09.750159    2580 patch_prober.go:28] interesting pod/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 22 15:44:09.750668 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:09.750217    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 22 15:44:10.749728 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:10.749685    2580 patch_prober.go:28] interesting pod/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 22 15:44:10.749949 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:10.749746    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 22 15:44:11.750189 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:11.750150    2580 patch_prober.go:28] interesting pod/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 22 15:44:11.750585 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:11.750212    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 22 15:44:12.754317 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:12.754288    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:44:12.754692 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:12.754553    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:44:12.755327 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:12.755311    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:44:33.928059 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:33.927974    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"]
Jul 22 15:44:33.928567 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:33.928194    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerName="istio-proxy" containerID="cri-o://7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924" gracePeriod=30
Jul 22 15:44:39.176619 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.176595    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:44:39.258370 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258333    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-certs\") pod \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") "
Jul 22 15:44:39.258370 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258374    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-credential-socket\") pod \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") "
Jul 22 15:44:39.258640 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258438    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-envoy\") pod \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") "
Jul 22 15:44:39.258640 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258462    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istiod-ca-cert\") pod \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") "
Jul 22 15:44:39.258640 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258489    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94dj9\" (UniqueName: \"kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-kube-api-access-94dj9\") pod \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") "
Jul 22 15:44:39.258640 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258514    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-podinfo\") pod \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") "
Jul 22 15:44:39.258640 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258572    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-socket\") pod \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") "
Jul 22 15:44:39.258640 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258624    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-token\") pod \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") "
Jul 22 15:44:39.259004 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258658    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-data\") pod \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\" (UID: \"5ed568cf-36d3-46b1-bcc0-4a679b64ec44\") "
Jul 22 15:44:39.259004 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258680    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ed568cf-36d3-46b1-bcc0-4a679b64ec44" (UID: "5ed568cf-36d3-46b1-bcc0-4a679b64ec44"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:44:39.259004 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258764    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ed568cf-36d3-46b1-bcc0-4a679b64ec44" (UID: "5ed568cf-36d3-46b1-bcc0-4a679b64ec44"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:44:39.259004 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258871    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ed568cf-36d3-46b1-bcc0-4a679b64ec44" (UID: "5ed568cf-36d3-46b1-bcc0-4a679b64ec44"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:44:39.259004 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.258905    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ed568cf-36d3-46b1-bcc0-4a679b64ec44" (UID: "5ed568cf-36d3-46b1-bcc0-4a679b64ec44"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:44:39.259278 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.259041    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:44:39.259278 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.259061    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:44:39.259278 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.259080    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:44:39.259278 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.259099    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:44:39.259911 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.259881    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ed568cf-36d3-46b1-bcc0-4a679b64ec44" (UID: "5ed568cf-36d3-46b1-bcc0-4a679b64ec44"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:44:39.261084 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.261037    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ed568cf-36d3-46b1-bcc0-4a679b64ec44" (UID: "5ed568cf-36d3-46b1-bcc0-4a679b64ec44"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 15:44:39.261317 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.261264    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-kube-api-access-94dj9" (OuterVolumeSpecName: "kube-api-access-94dj9") pod "5ed568cf-36d3-46b1-bcc0-4a679b64ec44" (UID: "5ed568cf-36d3-46b1-bcc0-4a679b64ec44"). InnerVolumeSpecName "kube-api-access-94dj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:44:39.261428 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.261349    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ed568cf-36d3-46b1-bcc0-4a679b64ec44" (UID: "5ed568cf-36d3-46b1-bcc0-4a679b64ec44"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:44:39.261494 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.261448    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ed568cf-36d3-46b1-bcc0-4a679b64ec44" (UID: "5ed568cf-36d3-46b1-bcc0-4a679b64ec44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:44:39.372644 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.372606    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:44:39.372644 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.372647    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94dj9\" (UniqueName: \"kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-kube-api-access-94dj9\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:44:39.372860 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.372662    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:44:39.372860 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.372674    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:44:39.372860 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.372686    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ed568cf-36d3-46b1-bcc0-4a679b64ec44-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:44:39.681292 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.681201    2580 generic.go:356] "Generic (PLEG): container finished" podID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerID="7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924" exitCode=0
Jul 22 15:44:39.681292 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.681257    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"
Jul 22 15:44:39.681529 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.681286    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" event={"ID":"5ed568cf-36d3-46b1-bcc0-4a679b64ec44","Type":"ContainerDied","Data":"7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924"}
Jul 22 15:44:39.681529 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.681351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq" event={"ID":"5ed568cf-36d3-46b1-bcc0-4a679b64ec44","Type":"ContainerDied","Data":"121cf7caf671b5c307d6b395f35fe1afd0b2dd9b093b6b5fbd6991b2115bd367"}
Jul 22 15:44:39.681529 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.681381    2580 scope.go:117] "RemoveContainer" containerID="7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924"
Jul 22 15:44:39.697391 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.697369    2580 scope.go:117] "RemoveContainer" containerID="240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e"
Jul 22 15:44:39.705083 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.705064    2580 scope.go:117] "RemoveContainer" containerID="7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924"
Jul 22 15:44:39.705350 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:44:39.705331    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924\": container with ID starting with 7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924 not found: ID does not exist" containerID="7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924"
Jul 22 15:44:39.705407 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.705356    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924"} err="failed to get container status \"7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924\": rpc error: code = NotFound desc = could not find container \"7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924\": container with ID starting with 7934d0de87ce775a6a315d42e891f344bb1cf58665cc6999c3b4ba776a548924 not found: ID does not exist"
Jul 22 15:44:39.705407 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.705372    2580 scope.go:117] "RemoveContainer" containerID="240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e"
Jul 22 15:44:39.705610 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:44:39.705591    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e\": container with ID starting with 240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e not found: ID does not exist" containerID="240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e"
Jul 22 15:44:39.705664 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.705619    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e"} err="failed to get container status \"240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e\": rpc error: code = NotFound desc = could not find container \"240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e\": container with ID starting with 240649d482e24df4628a5a65110f863f3c88eec166d6cab5b3d1b29003708f5e not found: ID does not exist"
Jul 22 15:44:39.708223 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.708202    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"]
Jul 22 15:44:39.712492 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:39.712474    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-37d7a1f9-openshift-default-798f55b6b7-8t2lq"]
Jul 22 15:44:40.780807 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:44:40.780766    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" path="/var/lib/kubelet/pods/5ed568cf-36d3-46b1-bcc0-4a679b64ec44/volumes"
Jul 22 15:46:11.763415 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.763378    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"]
Jul 22 15:46:11.764018 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.763999    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy"
Jul 22 15:46:11.764092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.764020    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbce85f-5a65-4f2b-bd9c-46de439d271f" containerName="istio-proxy"
Jul 22 15:46:11.764092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.764033    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerName="istio-proxy"
Jul 22 15:46:11.764092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.764041    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerName="istio-proxy"
Jul 22 15:46:11.764092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.764055    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy"
Jul 22 15:46:11.764092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.764063    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy"
Jul 22 15:46:11.764092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.764085    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy"
Jul 22 15:46:11.764092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.764094    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy"
Jul 22 15:46:11.764425 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.764184    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy"
Jul 22 15:46:11.764425 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.764198    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerName="istio-proxy"
Jul 22 15:46:11.767537 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.767516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:11.770272 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.770246    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-97d19d49-openshift-default-dockercfg-s6drf\""
Jul 22 15:46:11.784100 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.784075    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"]
Jul 22 15:46:11.903305 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.903271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-certs\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:11.903305 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.903306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-credential-socket\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:11.903532 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.903349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-envoy\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:11.903532 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.903436    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a6a5b87-e5da-429d-a3ab-ad5909851798-istiod-ca-cert\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:11.903532 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.903475    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-podinfo\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:11.903532 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.903497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-socket\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:11.903532 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.903514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnh97\" (UniqueName: \"kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-kube-api-access-tnh97\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:11.903722 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.903553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-data\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:11.903722 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:11.903573    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-token\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.004877 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.004822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-certs\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.004877 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.004861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-credential-socket\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005191 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.004911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-envoy\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005191 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.004948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a6a5b87-e5da-429d-a3ab-ad5909851798-istiod-ca-cert\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005191 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.004984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-podinfo\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005191 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.005014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-socket\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005191 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.005037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnh97\" (UniqueName: \"kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-kube-api-access-tnh97\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005191 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.005081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-data\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005191 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.005111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-token\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005563 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.005346    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-credential-socket\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005563 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.005353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-certs\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005675 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.005584    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-data\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005800 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.005773    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-socket\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.005995 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.005977    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a6a5b87-e5da-429d-a3ab-ad5909851798-istiod-ca-cert\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.007402 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.007376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-envoy\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.007515 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.007498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-podinfo\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.013180 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.013157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-token\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.013316 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.013297    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnh97\" (UniqueName: \"kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-kube-api-access-tnh97\") pod \"e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") " pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.078661 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.078583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:12.219727 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.219697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"]
Jul 22 15:46:12.221155 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:46:12.221128    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a6a5b87_e5da_429d_a3ab_ad5909851798.slice/crio-28df3ef0a684a0e7d829e0adfbdc525978deb84ee217fa03ce3b8dfa40df6d8e WatchSource:0}: Error finding container 28df3ef0a684a0e7d829e0adfbdc525978deb84ee217fa03ce3b8dfa40df6d8e: Status 404 returned error can't find the container with id 28df3ef0a684a0e7d829e0adfbdc525978deb84ee217fa03ce3b8dfa40df6d8e
Jul 22 15:46:12.223423 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.223390    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:46:12.223498 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.223456    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:46:12.223498 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:12.223489    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:46:13.128365 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:13.128328    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" event={"ID":"2a6a5b87-e5da-429d-a3ab-ad5909851798","Type":"ContainerStarted","Data":"7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c"}
Jul 22 15:46:13.128759 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:13.128391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" event={"ID":"2a6a5b87-e5da-429d-a3ab-ad5909851798","Type":"ContainerStarted","Data":"28df3ef0a684a0e7d829e0adfbdc525978deb84ee217fa03ce3b8dfa40df6d8e"}
Jul 22 15:46:13.154316 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:13.154265    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" podStartSLOduration=2.154249981 podStartE2EDuration="2.154249981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:46:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:46:13.153709261 +0000 UTC m=+1996.816858684" watchObservedRunningTime="2026-07-22 15:46:13.154249981 +0000 UTC m=+1996.817399403"
Jul 22 15:46:14.079102 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:14.079061    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:14.084191 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:14.084169    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:14.133399 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:14.133373    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:14.134160 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:14.134143    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:15.272462 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.272427    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"]
Jul 22 15:46:15.272839 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.272812    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerName="istio-proxy"
Jul 22 15:46:15.272839 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.272824    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerName="istio-proxy"
Jul 22 15:46:15.272966 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.272894    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fba61b53-191b-411b-815c-64a41fd6b9ae" containerName="istio-proxy"
Jul 22 15:46:15.272966 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.272904    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed568cf-36d3-46b1-bcc0-4a679b64ec44" containerName="istio-proxy"
Jul 22 15:46:15.276085 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.276067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:15.278757 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.278734    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-97d19d49-serving-cert\""
Jul 22 15:46:15.278757 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.278753    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jgh7j\""
Jul 22 15:46:15.286191 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.286166    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"]
Jul 22 15:46:15.437634 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.437592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce54576f-8e12-47c3-9bfb-cf614022d2e0-maas-api-tls\") pod \"maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:15.437838 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.437651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b4qp\" (UniqueName: \"kubernetes.io/projected/ce54576f-8e12-47c3-9bfb-cf614022d2e0-kube-api-access-2b4qp\") pod \"maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:15.437838 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.437698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce54576f-8e12-47c3-9bfb-cf614022d2e0-openshift-service-ca\") pod \"maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:15.538360 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.538275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b4qp\" (UniqueName: \"kubernetes.io/projected/ce54576f-8e12-47c3-9bfb-cf614022d2e0-kube-api-access-2b4qp\") pod \"maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:15.538360 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.538312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce54576f-8e12-47c3-9bfb-cf614022d2e0-openshift-service-ca\") pod \"maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:15.538536 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.538389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce54576f-8e12-47c3-9bfb-cf614022d2e0-maas-api-tls\") pod \"maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:15.539033 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.539014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce54576f-8e12-47c3-9bfb-cf614022d2e0-openshift-service-ca\") pod \"maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:15.541114 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.541097    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce54576f-8e12-47c3-9bfb-cf614022d2e0-maas-api-tls\") pod \"maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:15.547082 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.547061    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b4qp\" (UniqueName: \"kubernetes.io/projected/ce54576f-8e12-47c3-9bfb-cf614022d2e0-kube-api-access-2b4qp\") pod \"maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:15.591113 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.591078    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:15.730259 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:15.730232    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"]
Jul 22 15:46:15.732321 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:46:15.732293    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce54576f_8e12_47c3_9bfb_cf614022d2e0.slice/crio-1810f6b0107dda1475b777f15140953704d176196a82f7ad97a8a1b4da1e47dc WatchSource:0}: Error finding container 1810f6b0107dda1475b777f15140953704d176196a82f7ad97a8a1b4da1e47dc: Status 404 returned error can't find the container with id 1810f6b0107dda1475b777f15140953704d176196a82f7ad97a8a1b4da1e47dc
Jul 22 15:46:16.143187 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:16.143150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c" event={"ID":"ce54576f-8e12-47c3-9bfb-cf614022d2e0","Type":"ContainerStarted","Data":"1810f6b0107dda1475b777f15140953704d176196a82f7ad97a8a1b4da1e47dc"}
Jul 22 15:46:17.155670 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:17.155633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c" event={"ID":"ce54576f-8e12-47c3-9bfb-cf614022d2e0","Type":"ContainerStarted","Data":"edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733"}
Jul 22 15:46:17.156116 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:17.155824    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:17.185175 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:17.185125    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c" podStartSLOduration=1.642566284 podStartE2EDuration="2.185107311s" totalImagesPullingTime="542.541027ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:46:17.183512087 +0000 UTC m=+2000.846661507" watchObservedRunningTime="2026-07-22 15:46:17.185107311 +0000 UTC m=+2000.848256785"
Jul 22 15:46:23.190888 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:23.190852    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:29.808620 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:29.807379    2580 patch_prober.go:28] interesting pod/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:45010->10.133.0.56:15021: read: connection reset by peer" start-of-body=
Jul 22 15:46:29.808620 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:29.807465    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:45010->10.133.0.56:15021: read: connection reset by peer"
Jul 22 15:46:30.221841 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:30.221756    2580 generic.go:356] "Generic (PLEG): container finished" podID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerID="7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c" exitCode=0
Jul 22 15:46:30.221841 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:30.221802    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" event={"ID":"2a6a5b87-e5da-429d-a3ab-ad5909851798","Type":"ContainerDied","Data":"7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c"}
Jul 22 15:46:30.222216 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:30.222200    2580 scope.go:117] "RemoveContainer" containerID="7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c"
Jul 22 15:46:30.223270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:30.223240    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:46:30.223323 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:30.223312    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:46:30.223359 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:30.223345    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:46:31.227996 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:31.227959    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" event={"ID":"2a6a5b87-e5da-429d-a3ab-ad5909851798","Type":"ContainerStarted","Data":"4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8"}
Jul 22 15:46:32.079599 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:32.079499    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:32.079971 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:32.079943    2580 patch_prober.go:28] interesting pod/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 22 15:46:32.080181 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:32.080155    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 22 15:46:33.079027 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:33.078990    2580 patch_prober.go:28] interesting pod/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 22 15:46:33.079633 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:33.079593    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 22 15:46:34.079522 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:34.079474    2580 patch_prober.go:28] interesting pod/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 22 15:46:34.080061 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:34.079556    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 22 15:46:35.079872 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:35.079375    2580 patch_prober.go:28] interesting pod/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 22 15:46:35.079872 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:35.079460    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 22 15:46:36.082481 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:36.082454    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:36.082863 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:36.082704    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:36.083360 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:36.083345    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:37.350544 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.350514    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"]
Jul 22 15:46:37.351169 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.350758    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c" podUID="ce54576f-8e12-47c3-9bfb-cf614022d2e0" containerName="maas-api" containerID="cri-o://edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733" gracePeriod=30
Jul 22 15:46:37.598638 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.598617    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:37.642021 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.641945    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce54576f-8e12-47c3-9bfb-cf614022d2e0-openshift-service-ca\") pod \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") "
Jul 22 15:46:37.642021 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.641987    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce54576f-8e12-47c3-9bfb-cf614022d2e0-maas-api-tls\") pod \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") "
Jul 22 15:46:37.642215 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.642042    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b4qp\" (UniqueName: \"kubernetes.io/projected/ce54576f-8e12-47c3-9bfb-cf614022d2e0-kube-api-access-2b4qp\") pod \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\" (UID: \"ce54576f-8e12-47c3-9bfb-cf614022d2e0\") "
Jul 22 15:46:37.642287 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.642264    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce54576f-8e12-47c3-9bfb-cf614022d2e0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce54576f-8e12-47c3-9bfb-cf614022d2e0" (UID: "ce54576f-8e12-47c3-9bfb-cf614022d2e0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:46:37.644155 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.644124    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce54576f-8e12-47c3-9bfb-cf614022d2e0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce54576f-8e12-47c3-9bfb-cf614022d2e0" (UID: "ce54576f-8e12-47c3-9bfb-cf614022d2e0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:46:37.644267 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.644195    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce54576f-8e12-47c3-9bfb-cf614022d2e0-kube-api-access-2b4qp" (OuterVolumeSpecName: "kube-api-access-2b4qp") pod "ce54576f-8e12-47c3-9bfb-cf614022d2e0" (UID: "ce54576f-8e12-47c3-9bfb-cf614022d2e0"). InnerVolumeSpecName "kube-api-access-2b4qp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:46:37.743472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.743434    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce54576f-8e12-47c3-9bfb-cf614022d2e0-openshift-service-ca\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:37.743472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.743467    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce54576f-8e12-47c3-9bfb-cf614022d2e0-maas-api-tls\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:37.743472 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:37.743477    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b4qp\" (UniqueName: \"kubernetes.io/projected/ce54576f-8e12-47c3-9bfb-cf614022d2e0-kube-api-access-2b4qp\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:38.262725 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:38.262687    2580 generic.go:356] "Generic (PLEG): container finished" podID="ce54576f-8e12-47c3-9bfb-cf614022d2e0" containerID="edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733" exitCode=0
Jul 22 15:46:38.262955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:38.262739    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"
Jul 22 15:46:38.262955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:38.262775    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c" event={"ID":"ce54576f-8e12-47c3-9bfb-cf614022d2e0","Type":"ContainerDied","Data":"edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733"}
Jul 22 15:46:38.262955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:38.262842    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c" event={"ID":"ce54576f-8e12-47c3-9bfb-cf614022d2e0","Type":"ContainerDied","Data":"1810f6b0107dda1475b777f15140953704d176196a82f7ad97a8a1b4da1e47dc"}
Jul 22 15:46:38.262955 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:38.262874    2580 scope.go:117] "RemoveContainer" containerID="edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733"
Jul 22 15:46:38.273524 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:38.273507    2580 scope.go:117] "RemoveContainer" containerID="edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733"
Jul 22 15:46:38.274103 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:46:38.274081    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733\": container with ID starting with edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733 not found: ID does not exist" containerID="edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733"
Jul 22 15:46:38.274258 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:38.274204    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733"} err="failed to get container status \"edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733\": rpc error: code = NotFound desc = could not find container \"edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733\": container with ID starting with edc6e2e9066e6bb5b34a634f2eea402692e3362fcb971f05940684986cf9f733 not found: ID does not exist"
Jul 22 15:46:38.284523 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:38.284501    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"]
Jul 22 15:46:38.290321 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:38.290301    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-97d19d49-79ddbc84c-7mp6c"]
Jul 22 15:46:38.780934 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:38.780888    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce54576f-8e12-47c3-9bfb-cf614022d2e0" path="/var/lib/kubelet/pods/ce54576f-8e12-47c3-9bfb-cf614022d2e0/volumes"
Jul 22 15:46:48.684388 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:48.684296    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"]
Jul 22 15:46:48.684823 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:48.684643    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy" containerID="cri-o://4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8" gracePeriod=30
Jul 22 15:46:51.084875 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:51.084841    2580 patch_prober.go:28] interesting pod/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 15:46:51.085293 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:51.084908    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 15:46:53.946284 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:53.946218    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:54.007545 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.007514    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-certs\") pod \"2a6a5b87-e5da-429d-a3ab-ad5909851798\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") "
Jul 22 15:46:54.007720 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.007553    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-credential-socket\") pod \"2a6a5b87-e5da-429d-a3ab-ad5909851798\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") "
Jul 22 15:46:54.007720 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.007585    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-data\") pod \"2a6a5b87-e5da-429d-a3ab-ad5909851798\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") "
Jul 22 15:46:54.007720 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.007624    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnh97\" (UniqueName: \"kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-kube-api-access-tnh97\") pod \"2a6a5b87-e5da-429d-a3ab-ad5909851798\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") "
Jul 22 15:46:54.007720 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.007645    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-token\") pod \"2a6a5b87-e5da-429d-a3ab-ad5909851798\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") "
Jul 22 15:46:54.007720 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.007672    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a6a5b87-e5da-429d-a3ab-ad5909851798-istiod-ca-cert\") pod \"2a6a5b87-e5da-429d-a3ab-ad5909851798\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") "
Jul 22 15:46:54.008023 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.007728    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-socket\") pod \"2a6a5b87-e5da-429d-a3ab-ad5909851798\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") "
Jul 22 15:46:54.008023 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.007805    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-podinfo\") pod \"2a6a5b87-e5da-429d-a3ab-ad5909851798\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") "
Jul 22 15:46:54.008023 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.007836    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-envoy\") pod \"2a6a5b87-e5da-429d-a3ab-ad5909851798\" (UID: \"2a6a5b87-e5da-429d-a3ab-ad5909851798\") "
Jul 22 15:46:54.008023 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.007813    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a6a5b87-e5da-429d-a3ab-ad5909851798" (UID: "2a6a5b87-e5da-429d-a3ab-ad5909851798"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:46:54.008023 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.007882    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a6a5b87-e5da-429d-a3ab-ad5909851798" (UID: "2a6a5b87-e5da-429d-a3ab-ad5909851798"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:46:54.008277 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.008046    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a6a5b87-e5da-429d-a3ab-ad5909851798" (UID: "2a6a5b87-e5da-429d-a3ab-ad5909851798"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:46:54.008277 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.008179    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:54.008277 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.008196    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:54.008277 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.008193    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a6a5b87-e5da-429d-a3ab-ad5909851798-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a6a5b87-e5da-429d-a3ab-ad5909851798" (UID: "2a6a5b87-e5da-429d-a3ab-ad5909851798"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:46:54.008277 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.008210    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:54.008696 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.008670    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a6a5b87-e5da-429d-a3ab-ad5909851798" (UID: "2a6a5b87-e5da-429d-a3ab-ad5909851798"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:46:54.009941 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.009905    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a6a5b87-e5da-429d-a3ab-ad5909851798" (UID: "2a6a5b87-e5da-429d-a3ab-ad5909851798"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:46:54.010077 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.010062    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-kube-api-access-tnh97" (OuterVolumeSpecName: "kube-api-access-tnh97") pod "2a6a5b87-e5da-429d-a3ab-ad5909851798" (UID: "2a6a5b87-e5da-429d-a3ab-ad5909851798"). InnerVolumeSpecName "kube-api-access-tnh97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:46:54.010445 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.010418    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a6a5b87-e5da-429d-a3ab-ad5909851798" (UID: "2a6a5b87-e5da-429d-a3ab-ad5909851798"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 15:46:54.010445 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.010429    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a6a5b87-e5da-429d-a3ab-ad5909851798" (UID: "2a6a5b87-e5da-429d-a3ab-ad5909851798"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:46:54.109249 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.109218    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:54.109249 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.109242    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a6a5b87-e5da-429d-a3ab-ad5909851798-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:54.109249 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.109252    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:54.109469 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.109260    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:54.109469 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.109268    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a6a5b87-e5da-429d-a3ab-ad5909851798-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:54.109469 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.109276    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnh97\" (UniqueName: \"kubernetes.io/projected/2a6a5b87-e5da-429d-a3ab-ad5909851798-kube-api-access-tnh97\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:46:54.336533 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.336496    2580 generic.go:356] "Generic (PLEG): container finished" podID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerID="4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8" exitCode=0
Jul 22 15:46:54.336778 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.336555    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"
Jul 22 15:46:54.336778 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.336559    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" event={"ID":"2a6a5b87-e5da-429d-a3ab-ad5909851798","Type":"ContainerDied","Data":"4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8"}
Jul 22 15:46:54.336778 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.336614    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s" event={"ID":"2a6a5b87-e5da-429d-a3ab-ad5909851798","Type":"ContainerDied","Data":"28df3ef0a684a0e7d829e0adfbdc525978deb84ee217fa03ce3b8dfa40df6d8e"}
Jul 22 15:46:54.336778 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.336645    2580 scope.go:117] "RemoveContainer" containerID="4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8"
Jul 22 15:46:54.345531 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.345512    2580 scope.go:117] "RemoveContainer" containerID="7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c"
Jul 22 15:46:54.353250 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.353230    2580 scope.go:117] "RemoveContainer" containerID="4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8"
Jul 22 15:46:54.353507 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:46:54.353488    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8\": container with ID starting with 4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8 not found: ID does not exist" containerID="4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8"
Jul 22 15:46:54.353572 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.353515    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8"} err="failed to get container status \"4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8\": rpc error: code = NotFound desc = could not find container \"4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8\": container with ID starting with 4bff47d311d7682448b3eede1bebd6e9e840840b05ac6ae21a6aabfc410bd5b8 not found: ID does not exist"
Jul 22 15:46:54.353572 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.353533    2580 scope.go:117] "RemoveContainer" containerID="7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c"
Jul 22 15:46:54.353745 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:46:54.353728    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c\": container with ID starting with 7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c not found: ID does not exist" containerID="7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c"
Jul 22 15:46:54.353790 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.353749    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c"} err="failed to get container status \"7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c\": rpc error: code = NotFound desc = could not find container \"7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c\": container with ID starting with 7acc0f272519ca03b1329f2b32decdae9310d1812826e53972172d993114562c not found: ID does not exist"
Jul 22 15:46:54.359378 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.359352    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"]
Jul 22 15:46:54.364015 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.363993    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-97d19d49-openshift-default-697bd87c9-dwh5s"]
Jul 22 15:46:54.782188 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:46:54.782146    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" path="/var/lib/kubelet/pods/2a6a5b87-e5da-429d-a3ab-ad5909851798/volumes"
Jul 22 15:47:08.586148 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.586109    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"]
Jul 22 15:47:08.586644 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.586630    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy"
Jul 22 15:47:08.586689 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.586646    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy"
Jul 22 15:47:08.586689 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.586664    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce54576f-8e12-47c3-9bfb-cf614022d2e0" containerName="maas-api"
Jul 22 15:47:08.586689 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.586673    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce54576f-8e12-47c3-9bfb-cf614022d2e0" containerName="maas-api"
Jul 22 15:47:08.586781 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.586697    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy"
Jul 22 15:47:08.586781 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.586705    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy"
Jul 22 15:47:08.586846 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.586783    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy"
Jul 22 15:47:08.586846 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.586795    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce54576f-8e12-47c3-9bfb-cf614022d2e0" containerName="maas-api"
Jul 22 15:47:08.590167 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.590149    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.593318 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.593300    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b432cbd3-openshift-default-dockercfg-jz2np\""
Jul 22 15:47:08.604833 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.604810    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"]
Jul 22 15:47:08.738374 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.738338    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-podinfo\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.738548 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.738382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istiod-ca-cert\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.738548 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.738401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-envoy\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.738548 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.738423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-socket\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.738548 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.738526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-token\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.738686 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.738580    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-credential-socket\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.738686 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.738643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kw67\" (UniqueName: \"kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-kube-api-access-5kw67\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.738686 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.738675    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-certs\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.738778 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.738735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-data\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.839614 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.839529    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kw67\" (UniqueName: \"kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-kube-api-access-5kw67\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.839614 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.839565    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-certs\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.839614 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.839601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-data\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.839886 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.839636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-podinfo\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.839886 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.839661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istiod-ca-cert\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.839886 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.839679    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-envoy\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.839886 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.839706    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-socket\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.839886 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.839740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-token\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.840179 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.840028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-certs\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.840179 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.839770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-credential-socket\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.840179 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.840145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-data\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.840403 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.840383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-socket\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.840477 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.840415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-credential-socket\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.840477 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.840427    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istiod-ca-cert\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.842127 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.842102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-podinfo\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.842323 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.842307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-envoy\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.848615 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.848592    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kw67\" (UniqueName: \"kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-kube-api-access-5kw67\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.848900 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.848875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-token\") pod \"e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") " pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:08.900395 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:08.900363    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:09.064185 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:09.064127    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"]
Jul 22 15:47:09.068722 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:47:09.068695    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb167e0_db02_4e8c_afe1_08fa71473ae0.slice/crio-e780d42868f8850b5780c18da74d669fac06e86d32d6411ba0c8cc4766e5dcf4 WatchSource:0}: Error finding container e780d42868f8850b5780c18da74d669fac06e86d32d6411ba0c8cc4766e5dcf4: Status 404 returned error can't find the container with id e780d42868f8850b5780c18da74d669fac06e86d32d6411ba0c8cc4766e5dcf4
Jul 22 15:47:09.071297 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:09.071262    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:47:09.071378 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:09.071329    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:47:09.071378 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:09.071361    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:47:09.412874 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:09.412793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" event={"ID":"5bb167e0-db02-4e8c-afe1-08fa71473ae0","Type":"ContainerStarted","Data":"5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a"}
Jul 22 15:47:09.413051 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:09.412889    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" event={"ID":"5bb167e0-db02-4e8c-afe1-08fa71473ae0","Type":"ContainerStarted","Data":"e780d42868f8850b5780c18da74d669fac06e86d32d6411ba0c8cc4766e5dcf4"}
Jul 22 15:47:09.441684 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:09.441636    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" podStartSLOduration=1.4416194820000001 podStartE2EDuration="1.441619482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:47:09.43964006 +0000 UTC m=+2053.102789481" watchObservedRunningTime="2026-07-22 15:47:09.441619482 +0000 UTC m=+2053.104768902"
Jul 22 15:47:09.901197 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:09.901152    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:10.906175 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:10.906143    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:11.422984 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:11.422948    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:11.423872 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:11.423850    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:26.424940 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:26.424888    2580 patch_prober.go:28] interesting pod/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 22 15:47:26.425462 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:26.424983    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 22 15:47:26.503843 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:26.503810    2580 generic.go:356] "Generic (PLEG): container finished" podID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerID="5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a" exitCode=0
Jul 22 15:47:26.504044 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:26.503858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" event={"ID":"5bb167e0-db02-4e8c-afe1-08fa71473ae0","Type":"ContainerDied","Data":"5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a"}
Jul 22 15:47:26.504308 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:26.504290    2580 scope.go:117] "RemoveContainer" containerID="5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a"
Jul 22 15:47:26.505344 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:26.505313    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:47:26.505400 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:26.505379    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:47:26.505442 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:26.505422    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:47:27.510407 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:27.510371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" event={"ID":"5bb167e0-db02-4e8c-afe1-08fa71473ae0","Type":"ContainerStarted","Data":"db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b"}
Jul 22 15:47:27.900791 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:27.900702    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:27.900995 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:27.900968    2580 patch_prober.go:28] interesting pod/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 22 15:47:27.901087 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:27.901028    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 22 15:47:28.901354 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:28.901310    2580 patch_prober.go:28] interesting pod/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 22 15:47:28.901862 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:28.901380    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 22 15:47:29.901279 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:29.901241    2580 patch_prober.go:28] interesting pod/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 22 15:47:29.901459 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:29.901297    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 22 15:47:30.901464 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:30.901421    2580 patch_prober.go:28] interesting pod/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 22 15:47:30.901980 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:30.901487    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 22 15:47:31.905522 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:31.905492    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:31.905943 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:31.905870    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:31.906652 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:31.906633    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:47:56.839867 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:56.839838    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:47:56.845489 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:47:56.845469    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:48:59.979080 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:48:59.979000    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"]
Jul 22 15:48:59.979704 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:48:59.979269    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy" containerID="cri-o://db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b" gracePeriod=30
Jul 22 15:49:01.908262 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:01.908225    2580 patch_prober.go:28] interesting pod/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 15:49:01.908631 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:01.908291    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 15:49:05.236293 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.236264    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:49:05.291332 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291240    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-token\") pod \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") "
Jul 22 15:49:05.291332 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291285    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kw67\" (UniqueName: \"kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-kube-api-access-5kw67\") pod \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") "
Jul 22 15:49:05.291332 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291315    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-credential-socket\") pod \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") "
Jul 22 15:49:05.291634 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291340    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-socket\") pod \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") "
Jul 22 15:49:05.291634 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291364    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-certs\") pod \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") "
Jul 22 15:49:05.291634 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291422    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-envoy\") pod \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") "
Jul 22 15:49:05.291634 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291445    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istiod-ca-cert\") pod \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") "
Jul 22 15:49:05.291634 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291522    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-podinfo\") pod \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") "
Jul 22 15:49:05.291634 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291576    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-data\") pod \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\" (UID: \"5bb167e0-db02-4e8c-afe1-08fa71473ae0\") "
Jul 22 15:49:05.291998 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291643    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5bb167e0-db02-4e8c-afe1-08fa71473ae0" (UID: "5bb167e0-db02-4e8c-afe1-08fa71473ae0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:49:05.291998 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291724    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5bb167e0-db02-4e8c-afe1-08fa71473ae0" (UID: "5bb167e0-db02-4e8c-afe1-08fa71473ae0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:49:05.291998 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291850    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5bb167e0-db02-4e8c-afe1-08fa71473ae0" (UID: "5bb167e0-db02-4e8c-afe1-08fa71473ae0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:49:05.291998 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291890    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:49:05.291998 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.291909    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:49:05.292263 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.292229    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5bb167e0-db02-4e8c-afe1-08fa71473ae0" (UID: "5bb167e0-db02-4e8c-afe1-08fa71473ae0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:49:05.292683 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.292654    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-data" (OuterVolumeSpecName: "istio-data") pod "5bb167e0-db02-4e8c-afe1-08fa71473ae0" (UID: "5bb167e0-db02-4e8c-afe1-08fa71473ae0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:49:05.294322 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.294285    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5bb167e0-db02-4e8c-afe1-08fa71473ae0" (UID: "5bb167e0-db02-4e8c-afe1-08fa71473ae0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 15:49:05.294583 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.294455    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-kube-api-access-5kw67" (OuterVolumeSpecName: "kube-api-access-5kw67") pod "5bb167e0-db02-4e8c-afe1-08fa71473ae0" (UID: "5bb167e0-db02-4e8c-afe1-08fa71473ae0"). InnerVolumeSpecName "kube-api-access-5kw67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:49:05.294669 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.294623    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5bb167e0-db02-4e8c-afe1-08fa71473ae0" (UID: "5bb167e0-db02-4e8c-afe1-08fa71473ae0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:49:05.295626 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.295597    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-token" (OuterVolumeSpecName: "istio-token") pod "5bb167e0-db02-4e8c-afe1-08fa71473ae0" (UID: "5bb167e0-db02-4e8c-afe1-08fa71473ae0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:49:05.393187 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.393141    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:49:05.393187 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.393181    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kw67\" (UniqueName: \"kubernetes.io/projected/5bb167e0-db02-4e8c-afe1-08fa71473ae0-kube-api-access-5kw67\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:49:05.393431 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.393198    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:49:05.393431 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.393213    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:49:05.393431 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.393226    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:49:05.393431 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.393239    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:49:05.393431 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.393252    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bb167e0-db02-4e8c-afe1-08fa71473ae0-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:49:05.984583 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.984539    2580 generic.go:356] "Generic (PLEG): container finished" podID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerID="db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b" exitCode=0
Jul 22 15:49:05.984746 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.984627    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" event={"ID":"5bb167e0-db02-4e8c-afe1-08fa71473ae0","Type":"ContainerDied","Data":"db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b"}
Jul 22 15:49:05.984746 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.984640    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"
Jul 22 15:49:05.984746 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.984693    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9" event={"ID":"5bb167e0-db02-4e8c-afe1-08fa71473ae0","Type":"ContainerDied","Data":"e780d42868f8850b5780c18da74d669fac06e86d32d6411ba0c8cc4766e5dcf4"}
Jul 22 15:49:05.984746 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.984729    2580 scope.go:117] "RemoveContainer" containerID="db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b"
Jul 22 15:49:05.995190 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:05.995169    2580 scope.go:117] "RemoveContainer" containerID="5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a"
Jul 22 15:49:06.003097 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:06.003079    2580 scope.go:117] "RemoveContainer" containerID="db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b"
Jul 22 15:49:06.003382 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:49:06.003352    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b\": container with ID starting with db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b not found: ID does not exist" containerID="db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b"
Jul 22 15:49:06.003437 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:06.003382    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b"} err="failed to get container status \"db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b\": rpc error: code = NotFound desc = could not find container \"db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b\": container with ID starting with db1f5d287d1f9de6a4860b60d0e84712d544861630e621f26b2d4bb61040d34b not found: ID does not exist"
Jul 22 15:49:06.003437 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:06.003401    2580 scope.go:117] "RemoveContainer" containerID="5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a"
Jul 22 15:49:06.003703 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:49:06.003685    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a\": container with ID starting with 5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a not found: ID does not exist" containerID="5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a"
Jul 22 15:49:06.003761 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:06.003708    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a"} err="failed to get container status \"5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a\": rpc error: code = NotFound desc = could not find container \"5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a\": container with ID starting with 5643e2eaf6c8312a8092df29863085367299d9a955a8114d07f1f95fee89ae3a not found: ID does not exist"
Jul 22 15:49:06.011251 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:06.011230    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"]
Jul 22 15:49:06.016228 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:06.016203    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b432cbd3-openshift-default-5f965b7987-jwbq9"]
Jul 22 15:49:06.781231 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:06.781199    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" path="/var/lib/kubelet/pods/5bb167e0-db02-4e8c-afe1-08fa71473ae0/volumes"
Jul 22 15:49:55.958807 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:55.958774    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"]
Jul 22 15:49:55.959375 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:55.959351    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy"
Jul 22 15:49:55.959375 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:55.959373    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy"
Jul 22 15:49:55.959564 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:55.959386    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy"
Jul 22 15:49:55.959564 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:55.959395    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy"
Jul 22 15:49:55.959564 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:55.959473    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a6a5b87-e5da-429d-a3ab-ad5909851798" containerName="istio-proxy"
Jul 22 15:49:55.959564 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:55.959486    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy"
Jul 22 15:49:55.962421 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:55.962396    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:55.965694 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:55.965668    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c24af7-openshift-default-dockercfg-fjbhz\""
Jul 22 15:49:55.976541 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:55.975718    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"]
Jul 22 15:49:56.048308 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.048268    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-token\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.048507 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.048335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-credential-socket\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.048507 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.048419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-certs\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.048507 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.048461    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-data\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.048686 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.048505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453a87d7-1d41-40f8-8e79-96a8f1e48517-istiod-ca-cert\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.048686 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.048580    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-envoy\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.048686 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.048636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxnkm\" (UniqueName: \"kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-kube-api-access-bxnkm\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.048686 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.048666    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-socket\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.048896 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.048697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-podinfo\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.149363 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149330    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-socket\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.149363 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-podinfo\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.149611 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-token\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.149611 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149432    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-credential-socket\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.149611 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-certs\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.149611 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-data\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.149611 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453a87d7-1d41-40f8-8e79-96a8f1e48517-istiod-ca-cert\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.149611 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-envoy\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.149611 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxnkm\" (UniqueName: \"kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-kube-api-access-bxnkm\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.150004 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-socket\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.150004 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149781    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-credential-socket\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.150004 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.149859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-data\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.150158 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.150003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-certs\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.150313 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.150286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453a87d7-1d41-40f8-8e79-96a8f1e48517-istiod-ca-cert\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.151866 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.151848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-envoy\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.152152 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.152135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-podinfo\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.158771 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.158739    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-token\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.158895 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.158810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxnkm\" (UniqueName: \"kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-kube-api-access-bxnkm\") pod \"e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") " pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.277131 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.277093    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:56.442108 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:49:56.442065    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453a87d7_1d41_40f8_8e79_96a8f1e48517.slice/crio-c560541cbbcf99b2662e8f37899ad985215b9f98de81daae201bbc38bb11caea WatchSource:0}: Error finding container c560541cbbcf99b2662e8f37899ad985215b9f98de81daae201bbc38bb11caea: Status 404 returned error can't find the container with id c560541cbbcf99b2662e8f37899ad985215b9f98de81daae201bbc38bb11caea
Jul 22 15:49:56.443147 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.443122    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"]
Jul 22 15:49:56.444455 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.444420    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:49:56.444555 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.444489    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:49:56.444555 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:56.444521    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:49:57.229844 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:57.229752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" event={"ID":"453a87d7-1d41-40f8-8e79-96a8f1e48517","Type":"ContainerStarted","Data":"50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f"}
Jul 22 15:49:57.229844 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:57.229819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" event={"ID":"453a87d7-1d41-40f8-8e79-96a8f1e48517","Type":"ContainerStarted","Data":"c560541cbbcf99b2662e8f37899ad985215b9f98de81daae201bbc38bb11caea"}
Jul 22 15:49:57.251422 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:57.251376    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" podStartSLOduration=2.251357976 podStartE2EDuration="2.251357976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:49:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:49:57.250454029 +0000 UTC m=+2220.913603451" watchObservedRunningTime="2026-07-22 15:49:57.251357976 +0000 UTC m=+2220.914507398"
Jul 22 15:49:57.277236 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:57.277203    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:57.283330 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:57.283306    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:58.235533 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:58.235505    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:49:58.236605 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:49:58.236582    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:50:04.347552 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.347513    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"]
Jul 22 15:50:04.348216 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.348199    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bb167e0-db02-4e8c-afe1-08fa71473ae0" containerName="istio-proxy"
Jul 22 15:50:04.351616 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.351591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.355013 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.354990    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-cdfa08-openshift-default-dockercfg-729cf\""
Jul 22 15:50:04.362414 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.362340    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"]
Jul 22 15:50:04.429055 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.429018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-envoy\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.429266 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.429086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-socket\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.429266 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.429175    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-podinfo\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.429266 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.429203    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6w6q\" (UniqueName: \"kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-kube-api-access-q6w6q\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.429266 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.429228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-token\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.429440 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.429308    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-certs\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.429440 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.429358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-credential-socket\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.429440 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.429382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5664c837-effa-442f-9a3c-cf5b6f68e298-istiod-ca-cert\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.429440 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.429404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-data\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.530867 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.530833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-podinfo\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.530867 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.530875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6w6q\" (UniqueName: \"kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-kube-api-access-q6w6q\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531149 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.530894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-token\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531149 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.530952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-certs\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531149 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.530978    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-credential-socket\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531149 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.531003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5664c837-effa-442f-9a3c-cf5b6f68e298-istiod-ca-cert\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531149 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.531025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-data\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531149 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.531066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-envoy\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531149 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.531122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-socket\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531509 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.531446    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-certs\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531571 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.531511    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-credential-socket\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531571 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.531547    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-data\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531650 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.531578    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-socket\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.531971 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.531953    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5664c837-effa-442f-9a3c-cf5b6f68e298-istiod-ca-cert\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.533346 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.533317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-envoy\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.533449 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.533433    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-podinfo\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.539271 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.539248    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-token\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.539429 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.539410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6w6q\" (UniqueName: \"kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-kube-api-access-q6w6q\") pod \"e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") " pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.665774 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.665678    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:04.806780 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.806754    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"]
Jul 22 15:50:04.808217 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:50:04.808196    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5664c837_effa_442f_9a3c_cf5b6f68e298.slice/crio-7c94fb4e8d6a5dec23b3410b8bb49105c2429a2f1b040ad597cc1a3563589552 WatchSource:0}: Error finding container 7c94fb4e8d6a5dec23b3410b8bb49105c2429a2f1b040ad597cc1a3563589552: Status 404 returned error can't find the container with id 7c94fb4e8d6a5dec23b3410b8bb49105c2429a2f1b040ad597cc1a3563589552
Jul 22 15:50:04.810693 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.810660    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:50:04.810792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.810738    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:50:04.810792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:04.810782    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:50:05.270966 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:05.270935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" event={"ID":"5664c837-effa-442f-9a3c-cf5b6f68e298","Type":"ContainerStarted","Data":"4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190"}
Jul 22 15:50:05.271136 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:05.270986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" event={"ID":"5664c837-effa-442f-9a3c-cf5b6f68e298","Type":"ContainerStarted","Data":"7c94fb4e8d6a5dec23b3410b8bb49105c2429a2f1b040ad597cc1a3563589552"}
Jul 22 15:50:05.322886 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:05.322832    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" podStartSLOduration=1.32281679 podStartE2EDuration="1.32281679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:50:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:50:05.320279442 +0000 UTC m=+2228.983428862" watchObservedRunningTime="2026-07-22 15:50:05.32281679 +0000 UTC m=+2228.985966211"
Jul 22 15:50:05.666746 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:05.666639    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:05.672068 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:05.672044    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:06.275729 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:06.275693    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:06.276675 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:06.276657    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:13.617370 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:13.616010    2580 patch_prober.go:28] interesting pod/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:42478->10.133.0.59:15021: read: connection reset by peer" start-of-body=
Jul 22 15:50:13.617370 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:13.616071    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:42478->10.133.0.59:15021: read: connection reset by peer"
Jul 22 15:50:14.319558 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:14.319524    2580 generic.go:356] "Generic (PLEG): container finished" podID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerID="50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f" exitCode=0
Jul 22 15:50:14.319758 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:14.319608    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" event={"ID":"453a87d7-1d41-40f8-8e79-96a8f1e48517","Type":"ContainerDied","Data":"50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f"}
Jul 22 15:50:14.320051 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:14.320034    2580 scope.go:117] "RemoveContainer" containerID="50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f"
Jul 22 15:50:14.321046 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:14.321019    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:50:14.321122 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:14.321087    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:50:14.321159 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:14.321125    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:50:15.326177 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:15.326146    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" event={"ID":"453a87d7-1d41-40f8-8e79-96a8f1e48517","Type":"ContainerStarted","Data":"e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7"}
Jul 22 15:50:16.278050 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:16.277559    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:50:16.278050 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:16.277695    2580 patch_prober.go:28] interesting pod/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 22 15:50:16.278050 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:16.277745    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 22 15:50:17.278175 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:17.278120    2580 patch_prober.go:28] interesting pod/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 22 15:50:17.278666 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:17.278216    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 22 15:50:18.278352 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:18.278303    2580 patch_prober.go:28] interesting pod/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 22 15:50:18.278866 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:18.278395    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 22 15:50:19.277868 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:19.277772    2580 patch_prober.go:28] interesting pod/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 22 15:50:19.278202 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:19.278173    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 22 15:50:20.280754 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:20.280726    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:50:20.283120 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:20.281038    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:50:20.283120 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:20.281886    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:50:20.350872 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:20.350850    2580 generic.go:356] "Generic (PLEG): container finished" podID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerID="4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190" exitCode=0
Jul 22 15:50:20.350990 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:20.350940    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" event={"ID":"5664c837-effa-442f-9a3c-cf5b6f68e298","Type":"ContainerDied","Data":"4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190"}
Jul 22 15:50:20.351378 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:20.351360    2580 scope.go:117] "RemoveContainer" containerID="4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190"
Jul 22 15:50:20.352344 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:20.352313    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:50:20.352436 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:20.352376    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:50:20.352436 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:20.352404    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:50:21.275889 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:21.275787    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:21.357243 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:21.357204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" event={"ID":"5664c837-effa-442f-9a3c-cf5b6f68e298","Type":"ContainerStarted","Data":"16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4"}
Jul 22 15:50:21.667942 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:21.667823    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:21.668126 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:21.667982    2580 patch_prober.go:28] interesting pod/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 22 15:50:21.668126 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:21.668048    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 22 15:50:22.666930 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:22.666862    2580 patch_prober.go:28] interesting pod/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 22 15:50:22.667443 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:22.666977    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 22 15:50:23.666621 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:23.666581    2580 patch_prober.go:28] interesting pod/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 22 15:50:23.666940 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:23.666892    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 22 15:50:24.667537 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:24.667061    2580 patch_prober.go:28] interesting pod/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 22 15:50:24.667537 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:24.667126    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 22 15:50:25.670113 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:25.670082    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:25.670568 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:25.670485    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:25.671319 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:25.671298    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:50:49.928932 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:49.928889    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"]
Jul 22 15:50:49.932522 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:49.932501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:49.936595 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:49.936575    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cdfa08\"/\"default-dockercfg-wszwq\""
Jul 22 15:50:49.936721 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:49.936576    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cdfa08\"/\"openshift-service-ca.crt\""
Jul 22 15:50:49.936787 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:49.936720    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cdfa08\"/\"kube-root-ca.crt\""
Jul 22 15:50:49.936787 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:49.936744    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cdfa08\"/\"test-model-cdfa08-kserve-self-signed-certs\""
Jul 22 15:50:49.943476 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:49.943453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"]
Jul 22 15:50:50.072159 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.072106    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-model-cache\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.072347 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.072172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-tmp-dir\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.072347 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.072228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-home\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.072347 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.072293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc686e7-b28b-4779-a2cf-75f450d8de25-tls-certs\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.072347 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.072320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7jhj\" (UniqueName: \"kubernetes.io/projected/7dc686e7-b28b-4779-a2cf-75f450d8de25-kube-api-access-s7jhj\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.072587 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.072469    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-dshm\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.173984 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.173944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-dshm\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.174161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.173998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-model-cache\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.174161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.174032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-tmp-dir\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.174161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.174069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-home\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.174161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.174129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc686e7-b28b-4779-a2cf-75f450d8de25-tls-certs\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.174161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.174157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7jhj\" (UniqueName: \"kubernetes.io/projected/7dc686e7-b28b-4779-a2cf-75f450d8de25-kube-api-access-s7jhj\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.174495 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.174468    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-tmp-dir\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.174495 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.174486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-model-cache\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.174622 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.174519    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-home\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.176252 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.176229    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-dshm\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.176667 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.176647    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc686e7-b28b-4779-a2cf-75f450d8de25-tls-certs\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.183000 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.182948    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7jhj\" (UniqueName: \"kubernetes.io/projected/7dc686e7-b28b-4779-a2cf-75f450d8de25-kube-api-access-s7jhj\") pod \"test-model-cdfa08-kserve-7bbd46cf89-62dvk\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") " pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.243190 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.243161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:50:50.383522 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.383498    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"]
Jul 22 15:50:50.386084 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:50:50.386044    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7dc686e7_b28b_4779_a2cf_75f450d8de25.slice/crio-e614e49eb804293877e4abf80e5c9b2cb2760707b4f90c85515bc27c74d31bda WatchSource:0}: Error finding container e614e49eb804293877e4abf80e5c9b2cb2760707b4f90c85515bc27c74d31bda: Status 404 returned error can't find the container with id e614e49eb804293877e4abf80e5c9b2cb2760707b4f90c85515bc27c74d31bda
Jul 22 15:50:50.504874 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.504828    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk" event={"ID":"7dc686e7-b28b-4779-a2cf-75f450d8de25","Type":"ContainerStarted","Data":"84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189"}
Jul 22 15:50:50.504874 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.504874    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk" event={"ID":"7dc686e7-b28b-4779-a2cf-75f450d8de25","Type":"ContainerStarted","Data":"e614e49eb804293877e4abf80e5c9b2cb2760707b4f90c85515bc27c74d31bda"}
Jul 22 15:50:50.524856 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:50:50.524802    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk" podStartSLOduration=1.524784408 podStartE2EDuration="1.524784408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:50:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:50:50.524265141 +0000 UTC m=+2274.187414562" watchObservedRunningTime="2026-07-22 15:50:50.524784408 +0000 UTC m=+2274.187933835"
Jul 22 15:51:00.243417 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:00.243386    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:51:00.243417 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:00.243430    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:51:00.256030 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:00.256001    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:51:00.572247 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:00.572154    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:51:32.474715 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:32.474669    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"]
Jul 22 15:51:47.495559 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.495499    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk" podUID="7dc686e7-b28b-4779-a2cf-75f450d8de25" containerName="main" containerID="cri-o://84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189" gracePeriod=45
Jul 22 15:51:47.754467 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.754402    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:51:47.800988 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.800955    2580 generic.go:356] "Generic (PLEG): container finished" podID="7dc686e7-b28b-4779-a2cf-75f450d8de25" containerID="84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189" exitCode=0
Jul 22 15:51:47.801132 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.801008    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk" event={"ID":"7dc686e7-b28b-4779-a2cf-75f450d8de25","Type":"ContainerDied","Data":"84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189"}
Jul 22 15:51:47.801132 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.801043    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk" event={"ID":"7dc686e7-b28b-4779-a2cf-75f450d8de25","Type":"ContainerDied","Data":"e614e49eb804293877e4abf80e5c9b2cb2760707b4f90c85515bc27c74d31bda"}
Jul 22 15:51:47.801132 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.801056    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"
Jul 22 15:51:47.801234 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.801059    2580 scope.go:117] "RemoveContainer" containerID="84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189"
Jul 22 15:51:47.810200 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.810182    2580 scope.go:117] "RemoveContainer" containerID="84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189"
Jul 22 15:51:47.810451 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:51:47.810431    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189\": container with ID starting with 84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189 not found: ID does not exist" containerID="84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189"
Jul 22 15:51:47.810505 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.810460    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189"} err="failed to get container status \"84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189\": rpc error: code = NotFound desc = could not find container \"84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189\": container with ID starting with 84a9cd11debc7a1757c81dd9e5e4eae7eacc7153479efff1fba52dead2ef7189 not found: ID does not exist"
Jul 22 15:51:47.812780 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.812763    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc686e7-b28b-4779-a2cf-75f450d8de25-tls-certs\") pod \"7dc686e7-b28b-4779-a2cf-75f450d8de25\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") "
Jul 22 15:51:47.812841 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.812800    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7jhj\" (UniqueName: \"kubernetes.io/projected/7dc686e7-b28b-4779-a2cf-75f450d8de25-kube-api-access-s7jhj\") pod \"7dc686e7-b28b-4779-a2cf-75f450d8de25\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") "
Jul 22 15:51:47.812841 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.812817    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-tmp-dir\") pod \"7dc686e7-b28b-4779-a2cf-75f450d8de25\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") "
Jul 22 15:51:47.812968 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.812848    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-dshm\") pod \"7dc686e7-b28b-4779-a2cf-75f450d8de25\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") "
Jul 22 15:51:47.812968 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.812890    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-home\") pod \"7dc686e7-b28b-4779-a2cf-75f450d8de25\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") "
Jul 22 15:51:47.813110 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.812969    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-model-cache\") pod \"7dc686e7-b28b-4779-a2cf-75f450d8de25\" (UID: \"7dc686e7-b28b-4779-a2cf-75f450d8de25\") "
Jul 22 15:51:47.813172 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.813106    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7dc686e7-b28b-4779-a2cf-75f450d8de25" (UID: "7dc686e7-b28b-4779-a2cf-75f450d8de25"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:51:47.813278 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.813252    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-home" (OuterVolumeSpecName: "home") pod "7dc686e7-b28b-4779-a2cf-75f450d8de25" (UID: "7dc686e7-b28b-4779-a2cf-75f450d8de25"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:51:47.813378 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.813351    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-model-cache" (OuterVolumeSpecName: "model-cache") pod "7dc686e7-b28b-4779-a2cf-75f450d8de25" (UID: "7dc686e7-b28b-4779-a2cf-75f450d8de25"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:51:47.813444 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.813382    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-tmp-dir\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:47.813444 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.813402    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-home\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:47.814989 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.814970    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dc686e7-b28b-4779-a2cf-75f450d8de25-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7dc686e7-b28b-4779-a2cf-75f450d8de25" (UID: "7dc686e7-b28b-4779-a2cf-75f450d8de25"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:51:47.815331 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.815304    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-dshm" (OuterVolumeSpecName: "dshm") pod "7dc686e7-b28b-4779-a2cf-75f450d8de25" (UID: "7dc686e7-b28b-4779-a2cf-75f450d8de25"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:51:47.815438 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.815374    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dc686e7-b28b-4779-a2cf-75f450d8de25-kube-api-access-s7jhj" (OuterVolumeSpecName: "kube-api-access-s7jhj") pod "7dc686e7-b28b-4779-a2cf-75f450d8de25" (UID: "7dc686e7-b28b-4779-a2cf-75f450d8de25"). InnerVolumeSpecName "kube-api-access-s7jhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:51:47.914074 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.914027    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7jhj\" (UniqueName: \"kubernetes.io/projected/7dc686e7-b28b-4779-a2cf-75f450d8de25-kube-api-access-s7jhj\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:47.914074 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.914064    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-dshm\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:47.914074 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.914080    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7dc686e7-b28b-4779-a2cf-75f450d8de25-model-cache\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:47.914319 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:47.914096    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7dc686e7-b28b-4779-a2cf-75f450d8de25-tls-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:48.132407 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:48.132375    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"]
Jul 22 15:51:48.147461 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:48.147434    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-cdfa08/test-model-cdfa08-kserve-7bbd46cf89-62dvk"]
Jul 22 15:51:48.782314 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:48.782235    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dc686e7-b28b-4779-a2cf-75f450d8de25" path="/var/lib/kubelet/pods/7dc686e7-b28b-4779-a2cf-75f450d8de25/volumes"
Jul 22 15:51:54.155214 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:54.155179    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"]
Jul 22 15:51:54.155631 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:54.155462    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy" containerID="cri-o://e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7" gracePeriod=30
Jul 22 15:51:59.411736 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.411708    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:51:59.527500 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.527468    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-token\") pod \"453a87d7-1d41-40f8-8e79-96a8f1e48517\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") "
Jul 22 15:51:59.527694 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.527543    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-envoy\") pod \"453a87d7-1d41-40f8-8e79-96a8f1e48517\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") "
Jul 22 15:51:59.527694 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.527568    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-socket\") pod \"453a87d7-1d41-40f8-8e79-96a8f1e48517\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") "
Jul 22 15:51:59.527694 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.527635    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-podinfo\") pod \"453a87d7-1d41-40f8-8e79-96a8f1e48517\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") "
Jul 22 15:51:59.527694 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.527669    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453a87d7-1d41-40f8-8e79-96a8f1e48517-istiod-ca-cert\") pod \"453a87d7-1d41-40f8-8e79-96a8f1e48517\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") "
Jul 22 15:51:59.527947 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.527708    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-credential-socket\") pod \"453a87d7-1d41-40f8-8e79-96a8f1e48517\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") "
Jul 22 15:51:59.527947 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.527738    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-certs\") pod \"453a87d7-1d41-40f8-8e79-96a8f1e48517\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") "
Jul 22 15:51:59.527947 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.527769    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxnkm\" (UniqueName: \"kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-kube-api-access-bxnkm\") pod \"453a87d7-1d41-40f8-8e79-96a8f1e48517\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") "
Jul 22 15:51:59.527947 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.527848    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-data\") pod \"453a87d7-1d41-40f8-8e79-96a8f1e48517\" (UID: \"453a87d7-1d41-40f8-8e79-96a8f1e48517\") "
Jul 22 15:51:59.528161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.528044    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "453a87d7-1d41-40f8-8e79-96a8f1e48517" (UID: "453a87d7-1d41-40f8-8e79-96a8f1e48517"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:51:59.528161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.528059    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "453a87d7-1d41-40f8-8e79-96a8f1e48517" (UID: "453a87d7-1d41-40f8-8e79-96a8f1e48517"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:51:59.528161 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.528147    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "453a87d7-1d41-40f8-8e79-96a8f1e48517" (UID: "453a87d7-1d41-40f8-8e79-96a8f1e48517"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:51:59.528322 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.528181    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/453a87d7-1d41-40f8-8e79-96a8f1e48517-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "453a87d7-1d41-40f8-8e79-96a8f1e48517" (UID: "453a87d7-1d41-40f8-8e79-96a8f1e48517"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:51:59.528322 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.528262    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:59.528322 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.528287    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:59.528725 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.528706    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-data" (OuterVolumeSpecName: "istio-data") pod "453a87d7-1d41-40f8-8e79-96a8f1e48517" (UID: "453a87d7-1d41-40f8-8e79-96a8f1e48517"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:51:59.529979 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.529951    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-token" (OuterVolumeSpecName: "istio-token") pod "453a87d7-1d41-40f8-8e79-96a8f1e48517" (UID: "453a87d7-1d41-40f8-8e79-96a8f1e48517"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:51:59.530100 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.529984    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-kube-api-access-bxnkm" (OuterVolumeSpecName: "kube-api-access-bxnkm") pod "453a87d7-1d41-40f8-8e79-96a8f1e48517" (UID: "453a87d7-1d41-40f8-8e79-96a8f1e48517"). InnerVolumeSpecName "kube-api-access-bxnkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:51:59.530238 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.530221    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "453a87d7-1d41-40f8-8e79-96a8f1e48517" (UID: "453a87d7-1d41-40f8-8e79-96a8f1e48517"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 15:51:59.530284 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.530260    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "453a87d7-1d41-40f8-8e79-96a8f1e48517" (UID: "453a87d7-1d41-40f8-8e79-96a8f1e48517"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:51:59.629042 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.629011    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:59.629042 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.629035    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453a87d7-1d41-40f8-8e79-96a8f1e48517-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:59.629042 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.629045    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:59.629270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.629053    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxnkm\" (UniqueName: \"kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-kube-api-access-bxnkm\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:59.629270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.629065    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:59.629270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.629073    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:59.629270 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.629080    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453a87d7-1d41-40f8-8e79-96a8f1e48517-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:51:59.862990 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.862879    2580 generic.go:356] "Generic (PLEG): container finished" podID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerID="e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7" exitCode=0
Jul 22 15:51:59.862990 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.862940    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"
Jul 22 15:51:59.863234 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.862976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" event={"ID":"453a87d7-1d41-40f8-8e79-96a8f1e48517","Type":"ContainerDied","Data":"e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7"}
Jul 22 15:51:59.863234 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.863047    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96" event={"ID":"453a87d7-1d41-40f8-8e79-96a8f1e48517","Type":"ContainerDied","Data":"c560541cbbcf99b2662e8f37899ad985215b9f98de81daae201bbc38bb11caea"}
Jul 22 15:51:59.863234 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.863081    2580 scope.go:117] "RemoveContainer" containerID="e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7"
Jul 22 15:51:59.872747 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.872727    2580 scope.go:117] "RemoveContainer" containerID="50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f"
Jul 22 15:51:59.881219 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.881201    2580 scope.go:117] "RemoveContainer" containerID="e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7"
Jul 22 15:51:59.881470 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:51:59.881450    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7\": container with ID starting with e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7 not found: ID does not exist" containerID="e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7"
Jul 22 15:51:59.881554 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.881482    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7"} err="failed to get container status \"e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7\": rpc error: code = NotFound desc = could not find container \"e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7\": container with ID starting with e18a45a9c6b62b3ef59855cff0501d552f7d85a786ee4c8468c28ee241d6c3c7 not found: ID does not exist"
Jul 22 15:51:59.881554 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.881506    2580 scope.go:117] "RemoveContainer" containerID="50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f"
Jul 22 15:51:59.881792 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:51:59.881767    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f\": container with ID starting with 50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f not found: ID does not exist" containerID="50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f"
Jul 22 15:51:59.881833 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.881799    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f"} err="failed to get container status \"50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f\": rpc error: code = NotFound desc = could not find container \"50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f\": container with ID starting with 50d9c59d83b6538e5795d70b6b05669502047a8740a221f86274a2c93054588f not found: ID does not exist"
Jul 22 15:51:59.890996 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.890761    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"]
Jul 22 15:51:59.892195 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:51:59.892174    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c24af7-openshift-default-df97d5cf5-x6g96"]
Jul 22 15:52:00.781283 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:00.781238    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" path="/var/lib/kubelet/pods/453a87d7-1d41-40f8-8e79-96a8f1e48517/volumes"
Jul 22 15:52:16.354559 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:16.354529    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"]
Jul 22 15:52:16.355113 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:16.354736    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerName="istio-proxy" containerID="cri-o://16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4" gracePeriod=30
Jul 22 15:52:17.289088 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.289050    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"]
Jul 22 15:52:17.289447 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.289435    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy"
Jul 22 15:52:17.289501 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.289449    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy"
Jul 22 15:52:17.289501 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.289459    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dc686e7-b28b-4779-a2cf-75f450d8de25" containerName="main"
Jul 22 15:52:17.289501 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.289464    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dc686e7-b28b-4779-a2cf-75f450d8de25" containerName="main"
Jul 22 15:52:17.289608 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.289533    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy"
Jul 22 15:52:17.289608 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.289542    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy"
Jul 22 15:52:17.289608 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.289549    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dc686e7-b28b-4779-a2cf-75f450d8de25" containerName="main"
Jul 22 15:52:17.292790 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.292773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.297687 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.297666    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-063391-openshift-default-dockercfg-4fvrn\""
Jul 22 15:52:17.311131 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.311105    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"]
Jul 22 15:52:17.385572 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.385542    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-credential-socket\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.385572 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.385575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istiod-ca-cert\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.386031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.385596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-podinfo\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.386031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.385656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-socket\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.386031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.385672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-certs\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.386031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.385696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-data\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.386031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.385732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-envoy\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.386031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.385750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-token\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.386031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.385777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx6dr\" (UniqueName: \"kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-kube-api-access-xx6dr\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487078 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-credential-socket\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487078 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istiod-ca-cert\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487319 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-podinfo\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487319 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-socket\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487319 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-certs\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487319 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487269    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-data\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487529 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-envoy\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487529 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-token\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487529 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487420    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx6dr\" (UniqueName: \"kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-kube-api-access-xx6dr\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487529 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487510    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-credential-socket\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487529 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-socket\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487800 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-data\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.487800 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.487641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-certs\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.488041 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.488021    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istiod-ca-cert\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.489631 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.489614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-envoy\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.489723 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.489704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-podinfo\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.496519 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.496494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-token\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.496698 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.496675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx6dr\" (UniqueName: \"kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-kube-api-access-xx6dr\") pod \"e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") " pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.603626 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.603546    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:17.745317 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.745288    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"]
Jul 22 15:52:17.747160 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:52:17.747130    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f7b7b94_82b3_482c_991c_f03ec14f67e7.slice/crio-76ceb875bb2400bc182f3765843a7ff040830e45310459e8a08098038f5de39a WatchSource:0}: Error finding container 76ceb875bb2400bc182f3765843a7ff040830e45310459e8a08098038f5de39a: Status 404 returned error can't find the container with id 76ceb875bb2400bc182f3765843a7ff040830e45310459e8a08098038f5de39a
Jul 22 15:52:17.749451 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.749419    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:17.749532 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.749479    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:17.749532 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.749524    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:17.959160 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.959066    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" event={"ID":"0f7b7b94-82b3-482c-991c-f03ec14f67e7","Type":"ContainerStarted","Data":"709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a"}
Jul 22 15:52:17.959160 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.959130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" event={"ID":"0f7b7b94-82b3-482c-991c-f03ec14f67e7","Type":"ContainerStarted","Data":"76ceb875bb2400bc182f3765843a7ff040830e45310459e8a08098038f5de39a"}
Jul 22 15:52:17.981171 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:17.981119    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" podStartSLOduration=0.981103566 podStartE2EDuration="981.103566ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:52:17.979630225 +0000 UTC m=+2361.642779647" watchObservedRunningTime="2026-07-22 15:52:17.981103566 +0000 UTC m=+2361.644252987"
Jul 22 15:52:18.603974 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:18.603939    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:18.609077 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:18.609045    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:18.964394 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:18.964315    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:18.965500 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:18.965477    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:21.614396 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.614342    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:52:21.729046 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729018    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5664c837-effa-442f-9a3c-cf5b6f68e298-istiod-ca-cert\") pod \"5664c837-effa-442f-9a3c-cf5b6f68e298\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") "
Jul 22 15:52:21.729186 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729053    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-socket\") pod \"5664c837-effa-442f-9a3c-cf5b6f68e298\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") "
Jul 22 15:52:21.729186 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729072    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-credential-socket\") pod \"5664c837-effa-442f-9a3c-cf5b6f68e298\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") "
Jul 22 15:52:21.729186 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729091    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6w6q\" (UniqueName: \"kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-kube-api-access-q6w6q\") pod \"5664c837-effa-442f-9a3c-cf5b6f68e298\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") "
Jul 22 15:52:21.729186 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729164    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-envoy\") pod \"5664c837-effa-442f-9a3c-cf5b6f68e298\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") "
Jul 22 15:52:21.729186 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729182    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-podinfo\") pod \"5664c837-effa-442f-9a3c-cf5b6f68e298\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") "
Jul 22 15:52:21.729468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729198    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-data\") pod \"5664c837-effa-442f-9a3c-cf5b6f68e298\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") "
Jul 22 15:52:21.729468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729223    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-certs\") pod \"5664c837-effa-442f-9a3c-cf5b6f68e298\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") "
Jul 22 15:52:21.729468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729282    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-token\") pod \"5664c837-effa-442f-9a3c-cf5b6f68e298\" (UID: \"5664c837-effa-442f-9a3c-cf5b6f68e298\") "
Jul 22 15:52:21.729468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729335    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5664c837-effa-442f-9a3c-cf5b6f68e298" (UID: "5664c837-effa-442f-9a3c-cf5b6f68e298"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:52:21.729468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729348    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5664c837-effa-442f-9a3c-cf5b6f68e298" (UID: "5664c837-effa-442f-9a3c-cf5b6f68e298"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:52:21.729468 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729434    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5664c837-effa-442f-9a3c-cf5b6f68e298-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5664c837-effa-442f-9a3c-cf5b6f68e298" (UID: "5664c837-effa-442f-9a3c-cf5b6f68e298"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:52:21.729774 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729557    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5664c837-effa-442f-9a3c-cf5b6f68e298" (UID: "5664c837-effa-442f-9a3c-cf5b6f68e298"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:52:21.729774 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729641    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:52:21.729774 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729663    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5664c837-effa-442f-9a3c-cf5b6f68e298-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:52:21.729774 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729680    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:52:21.729774 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.729694    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:52:21.730119 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.730094    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-data" (OuterVolumeSpecName: "istio-data") pod "5664c837-effa-442f-9a3c-cf5b6f68e298" (UID: "5664c837-effa-442f-9a3c-cf5b6f68e298"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:52:21.731521 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.731496    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5664c837-effa-442f-9a3c-cf5b6f68e298" (UID: "5664c837-effa-442f-9a3c-cf5b6f68e298"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:52:21.731658 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.731612    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-kube-api-access-q6w6q" (OuterVolumeSpecName: "kube-api-access-q6w6q") pod "5664c837-effa-442f-9a3c-cf5b6f68e298" (UID: "5664c837-effa-442f-9a3c-cf5b6f68e298"). InnerVolumeSpecName "kube-api-access-q6w6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:52:21.731658 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.731640    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-token" (OuterVolumeSpecName: "istio-token") pod "5664c837-effa-442f-9a3c-cf5b6f68e298" (UID: "5664c837-effa-442f-9a3c-cf5b6f68e298"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:52:21.731732 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.731670    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5664c837-effa-442f-9a3c-cf5b6f68e298" (UID: "5664c837-effa-442f-9a3c-cf5b6f68e298"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 15:52:21.830527 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.830498    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:52:21.830527 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.830523    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:52:21.830527 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.830531    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:52:21.830752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.830540    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:52:21.830752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.830548    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6w6q\" (UniqueName: \"kubernetes.io/projected/5664c837-effa-442f-9a3c-cf5b6f68e298-kube-api-access-q6w6q\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:52:21.982873 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.982792    2580 generic.go:356] "Generic (PLEG): container finished" podID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerID="16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4" exitCode=0
Jul 22 15:52:21.982873 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.982842    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"
Jul 22 15:52:21.982873 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.982858    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" event={"ID":"5664c837-effa-442f-9a3c-cf5b6f68e298","Type":"ContainerDied","Data":"16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4"}
Jul 22 15:52:21.983148 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.982901    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl" event={"ID":"5664c837-effa-442f-9a3c-cf5b6f68e298","Type":"ContainerDied","Data":"7c94fb4e8d6a5dec23b3410b8bb49105c2429a2f1b040ad597cc1a3563589552"}
Jul 22 15:52:21.983148 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.982938    2580 scope.go:117] "RemoveContainer" containerID="16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4"
Jul 22 15:52:21.992631 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:21.992612    2580 scope.go:117] "RemoveContainer" containerID="4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190"
Jul 22 15:52:22.000207 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:22.000189    2580 scope.go:117] "RemoveContainer" containerID="16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4"
Jul 22 15:52:22.000461 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:52:22.000440    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4\": container with ID starting with 16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4 not found: ID does not exist" containerID="16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4"
Jul 22 15:52:22.000514 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:22.000475    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4"} err="failed to get container status \"16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4\": rpc error: code = NotFound desc = could not find container \"16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4\": container with ID starting with 16ba1f47b407d7b50706a901084bceb07aa772424a11fac4440d561737198ec4 not found: ID does not exist"
Jul 22 15:52:22.000514 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:22.000499    2580 scope.go:117] "RemoveContainer" containerID="4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190"
Jul 22 15:52:22.000731 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:52:22.000713    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190\": container with ID starting with 4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190 not found: ID does not exist" containerID="4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190"
Jul 22 15:52:22.000778 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:22.000735    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190"} err="failed to get container status \"4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190\": rpc error: code = NotFound desc = could not find container \"4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190\": container with ID starting with 4ea99280a8e8a101fe29efa02d105e68eec2b228e988a5ee5592e8b0adc4b190 not found: ID does not exist"
Jul 22 15:52:22.006367 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:22.006344    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"]
Jul 22 15:52:22.012987 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:22.012963    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-cdfa08-openshift-default-644fd6d57f-4lzfl"]
Jul 22 15:52:22.782064 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:22.782031    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" path="/var/lib/kubelet/pods/5664c837-effa-442f-9a3c-cf5b6f68e298/volumes"
Jul 22 15:52:25.198597 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.198569    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"]
Jul 22 15:52:25.199034 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.199019    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerName="istio-proxy"
Jul 22 15:52:25.199081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.199036    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerName="istio-proxy"
Jul 22 15:52:25.199081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.199046    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy"
Jul 22 15:52:25.199081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.199052    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="453a87d7-1d41-40f8-8e79-96a8f1e48517" containerName="istio-proxy"
Jul 22 15:52:25.199081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.199070    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerName="istio-proxy"
Jul 22 15:52:25.199081 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.199077    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerName="istio-proxy"
Jul 22 15:52:25.199248 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.199138    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerName="istio-proxy"
Jul 22 15:52:25.204012 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.203992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.206669 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.206649    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f08216-openshift-default-dockercfg-c8f74\""
Jul 22 15:52:25.214950 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.214910    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"]
Jul 22 15:52:25.364652 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.364614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-envoy\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.364835 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.364718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-certs\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.364835 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.364746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-token\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.364835 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.364771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-podinfo\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.365078 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.364865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-socket\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.365078 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.364904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-credential-socket\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.365078 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.364976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-data\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.365078 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.365020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4sbc\" (UniqueName: \"kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-kube-api-access-t4sbc\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.365078 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.365055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istiod-ca-cert\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.466516 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.466414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-podinfo\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.466516 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.466476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-socket\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.466752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.466526    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-credential-socket\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.466752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.466564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-data\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.466752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.466610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4sbc\" (UniqueName: \"kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-kube-api-access-t4sbc\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.466752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.466645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istiod-ca-cert\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.466752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.466692    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-envoy\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.466752 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.466749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-certs\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.467121 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.466778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-token\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.467435 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.467391    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-credential-socket\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.467622 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.467462    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-certs\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.467722 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.467696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-data\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.468134 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.468110    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istiod-ca-cert\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.468323 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.468298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-socket\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.471067 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.471042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-envoy\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.471311 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.471283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-podinfo\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.475788 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.475762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-token\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.476234 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.476213    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4sbc\" (UniqueName: \"kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-kube-api-access-t4sbc\") pod \"e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") " pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.514940 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.514908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:25.649793 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.649766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"]
Jul 22 15:52:25.651482 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:52:25.651453    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4b36b4_9c68_4958_a388_a0aa61ec48e8.slice/crio-06975b54aff00dfb09dd83cffc50f960a2292c14cf1aad426860ead05a322114 WatchSource:0}: Error finding container 06975b54aff00dfb09dd83cffc50f960a2292c14cf1aad426860ead05a322114: Status 404 returned error can't find the container with id 06975b54aff00dfb09dd83cffc50f960a2292c14cf1aad426860ead05a322114
Jul 22 15:52:25.653731 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.653702    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:25.653801 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.653759    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:25.653801 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:25.653789    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:26.003414 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:26.003378    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" event={"ID":"6a4b36b4-9c68-4958-a388-a0aa61ec48e8","Type":"ContainerStarted","Data":"2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e"}
Jul 22 15:52:26.003563 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:26.003434    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" event={"ID":"6a4b36b4-9c68-4958-a388-a0aa61ec48e8","Type":"ContainerStarted","Data":"06975b54aff00dfb09dd83cffc50f960a2292c14cf1aad426860ead05a322114"}
Jul 22 15:52:26.515591 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:26.515560    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:26.521141 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:26.521117    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:26.543690 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:26.543640    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" podStartSLOduration=1.543623949 podStartE2EDuration="1.543623949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:52:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:52:26.024434838 +0000 UTC m=+2369.687584259" watchObservedRunningTime="2026-07-22 15:52:26.543623949 +0000 UTC m=+2370.206773434"
Jul 22 15:52:27.008993 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:27.008968    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:27.010002 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:27.009982    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:38.069295 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:38.069264    2580 generic.go:356] "Generic (PLEG): container finished" podID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerID="709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a" exitCode=0
Jul 22 15:52:38.069740 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:38.069342    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" event={"ID":"0f7b7b94-82b3-482c-991c-f03ec14f67e7","Type":"ContainerDied","Data":"709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a"}
Jul 22 15:52:38.069787 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:38.069759    2580 scope.go:117] "RemoveContainer" containerID="709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a"
Jul 22 15:52:38.070882 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:38.070854    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:38.070962 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:38.070938    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:38.071009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:38.070968    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:39.081078 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:39.081034    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" event={"ID":"0f7b7b94-82b3-482c-991c-f03ec14f67e7","Type":"ContainerStarted","Data":"c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086"}
Jul 22 15:52:39.604339 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:39.604296    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:39.604562 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:39.604434    2580 patch_prober.go:28] interesting pod/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 22 15:52:39.604562 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:39.604497    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 22 15:52:40.604690 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:40.604644    2580 patch_prober.go:28] interesting pod/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 22 15:52:40.605211 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:40.604723    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 22 15:52:41.604271 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:41.604233    2580 patch_prober.go:28] interesting pod/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 22 15:52:41.604598 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:41.604565    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 22 15:52:42.604661 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:42.604626    2580 patch_prober.go:28] interesting pod/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 22 15:52:42.605055 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:42.604694    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 22 15:52:43.607999 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:43.607966    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:43.608530 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:43.608513    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:43.609169 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:43.609148    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:52:46.128693 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:46.128664    2580 generic.go:356] "Generic (PLEG): container finished" podID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerID="2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e" exitCode=0
Jul 22 15:52:46.129147 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:46.128738    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" event={"ID":"6a4b36b4-9c68-4958-a388-a0aa61ec48e8","Type":"ContainerDied","Data":"2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e"}
Jul 22 15:52:46.129195 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:46.129168    2580 scope.go:117] "RemoveContainer" containerID="2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e"
Jul 22 15:52:46.130330 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:46.130303    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:46.130391 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:46.130370    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:46.130430 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:46.130403    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:52:47.135737 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:47.135695    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" event={"ID":"6a4b36b4-9c68-4958-a388-a0aa61ec48e8","Type":"ContainerStarted","Data":"13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada"}
Jul 22 15:52:47.516186 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:47.516151    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:47.516501 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:47.516373    2580 patch_prober.go:28] interesting pod/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 22 15:52:47.516501 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:47.516434    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 22 15:52:48.515388 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:48.515343    2580 patch_prober.go:28] interesting pod/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 22 15:52:48.515876 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:48.515412    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 22 15:52:49.516216 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:49.516174    2580 patch_prober.go:28] interesting pod/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 22 15:52:49.516608 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:49.516248    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 22 15:52:50.515437 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:50.515392    2580 patch_prober.go:28] interesting pod/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 22 15:52:50.515636 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:50.515471    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 22 15:52:51.519167 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:51.519128    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:51.519642 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:51.519417    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:51.520110 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:51.520092    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:52:56.870327 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:56.870290    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:52:56.878042 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:52:56.878018    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:53:06.958966 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:06.958903    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"]
Jul 22 15:53:06.959458 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:06.959194    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerName="istio-proxy" containerID="cri-o://c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086" gracePeriod=30
Jul 22 15:53:12.230341 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.230268    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:53:12.267574 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.267539    2580 generic.go:356] "Generic (PLEG): container finished" podID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerID="c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086" exitCode=0
Jul 22 15:53:12.267790 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.267606    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"
Jul 22 15:53:12.267790 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.267610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" event={"ID":"0f7b7b94-82b3-482c-991c-f03ec14f67e7","Type":"ContainerDied","Data":"c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086"}
Jul 22 15:53:12.267790 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.267749    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm" event={"ID":"0f7b7b94-82b3-482c-991c-f03ec14f67e7","Type":"ContainerDied","Data":"76ceb875bb2400bc182f3765843a7ff040830e45310459e8a08098038f5de39a"}
Jul 22 15:53:12.267790 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.267771    2580 scope.go:117] "RemoveContainer" containerID="c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086"
Jul 22 15:53:12.276952 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.276928    2580 scope.go:117] "RemoveContainer" containerID="709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a"
Jul 22 15:53:12.285354 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.285329    2580 scope.go:117] "RemoveContainer" containerID="c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086"
Jul 22 15:53:12.285703 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:53:12.285682    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086\": container with ID starting with c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086 not found: ID does not exist" containerID="c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086"
Jul 22 15:53:12.285790 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.285713    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086"} err="failed to get container status \"c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086\": rpc error: code = NotFound desc = could not find container \"c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086\": container with ID starting with c50a96abf50fae06ddb1621070d079f7fd1e177ecb673b40b210b7ec32d41086 not found: ID does not exist"
Jul 22 15:53:12.285790 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.285733    2580 scope.go:117] "RemoveContainer" containerID="709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a"
Jul 22 15:53:12.286035 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:53:12.286016    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a\": container with ID starting with 709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a not found: ID does not exist" containerID="709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a"
Jul 22 15:53:12.286093 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.286040    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a"} err="failed to get container status \"709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a\": rpc error: code = NotFound desc = could not find container \"709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a\": container with ID starting with 709af12a79bdbcf40b2a21495724d83b1912148ac1edd4acdc19ab4f91a6b55a not found: ID does not exist"
Jul 22 15:53:12.324123 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324085    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istiod-ca-cert\") pod \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") "
Jul 22 15:53:12.324123 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324125    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-envoy\") pod \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") "
Jul 22 15:53:12.324374 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324159    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-credential-socket\") pod \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") "
Jul 22 15:53:12.324374 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-data\") pod \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") "
Jul 22 15:53:12.324374 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324197    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-podinfo\") pod \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") "
Jul 22 15:53:12.324374 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324240    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-certs\") pod \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") "
Jul 22 15:53:12.324374 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324289    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-socket\") pod \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") "
Jul 22 15:53:12.324374 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324334    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx6dr\" (UniqueName: \"kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-kube-api-access-xx6dr\") pod \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") "
Jul 22 15:53:12.324681 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324429    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-token\") pod \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\" (UID: \"0f7b7b94-82b3-482c-991c-f03ec14f67e7\") "
Jul 22 15:53:12.324681 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324492    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f7b7b94-82b3-482c-991c-f03ec14f67e7" (UID: "0f7b7b94-82b3-482c-991c-f03ec14f67e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:53:12.324681 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324613    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f7b7b94-82b3-482c-991c-f03ec14f67e7" (UID: "0f7b7b94-82b3-482c-991c-f03ec14f67e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:53:12.324681 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324665    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f7b7b94-82b3-482c-991c-f03ec14f67e7" (UID: "0f7b7b94-82b3-482c-991c-f03ec14f67e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:53:12.324877 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324759    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:12.324877 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324781    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:12.324877 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324796    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:12.325044 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.324994    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f7b7b94-82b3-482c-991c-f03ec14f67e7" (UID: "0f7b7b94-82b3-482c-991c-f03ec14f67e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:53:12.325198 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.325168    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f7b7b94-82b3-482c-991c-f03ec14f67e7" (UID: "0f7b7b94-82b3-482c-991c-f03ec14f67e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:53:12.326420 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.326398    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f7b7b94-82b3-482c-991c-f03ec14f67e7" (UID: "0f7b7b94-82b3-482c-991c-f03ec14f67e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:53:12.326569 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.326552    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-kube-api-access-xx6dr" (OuterVolumeSpecName: "kube-api-access-xx6dr") pod "0f7b7b94-82b3-482c-991c-f03ec14f67e7" (UID: "0f7b7b94-82b3-482c-991c-f03ec14f67e7"). InnerVolumeSpecName "kube-api-access-xx6dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:53:12.326873 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.326854    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f7b7b94-82b3-482c-991c-f03ec14f67e7" (UID: "0f7b7b94-82b3-482c-991c-f03ec14f67e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 15:53:12.326954 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.326871    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f7b7b94-82b3-482c-991c-f03ec14f67e7" (UID: "0f7b7b94-82b3-482c-991c-f03ec14f67e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:53:12.426126 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.426089    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:12.426126 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.426120    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:12.426126 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.426128    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:12.426126 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.426137    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f7b7b94-82b3-482c-991c-f03ec14f67e7-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:12.426409 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.426145    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f7b7b94-82b3-482c-991c-f03ec14f67e7-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:12.426409 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.426154    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx6dr\" (UniqueName: \"kubernetes.io/projected/0f7b7b94-82b3-482c-991c-f03ec14f67e7-kube-api-access-xx6dr\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:12.591794 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.591759    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"]
Jul 22 15:53:12.595591 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.595565    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-063391-openshift-default-6c4bbf7655-xftzm"]
Jul 22 15:53:12.780751 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:12.780717    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" path="/var/lib/kubelet/pods/0f7b7b94-82b3-482c-991c-f03ec14f67e7/volumes"
Jul 22 15:53:33.744428 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:33.744342    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"]
Jul 22 15:53:33.745010 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:33.744694    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy" containerID="cri-o://13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada" gracePeriod=30
Jul 22 15:53:34.627749 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.627715    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"]
Jul 22 15:53:34.628145 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.628131    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerName="istio-proxy"
Jul 22 15:53:34.628145 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.628146    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerName="istio-proxy"
Jul 22 15:53:34.628281 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.628230    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerName="istio-proxy"
Jul 22 15:53:34.628281 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.628240    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5664c837-effa-442f-9a3c-cf5b6f68e298" containerName="istio-proxy"
Jul 22 15:53:34.628281 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.628246    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerName="istio-proxy"
Jul 22 15:53:34.631375 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.631357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.634064 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.634045    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-290ac7-openshift-default-dockercfg-5t5sr\""
Jul 22 15:53:34.644435 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.644408    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"]
Jul 22 15:53:34.728824 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.728781    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-data\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.729229 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.728885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-podinfo\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.729229 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.728971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-socket\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.729229 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.729013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-envoy\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.729229 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.729045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4b2v\" (UniqueName: \"kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-kube-api-access-z4b2v\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.729229 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.729091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-certs\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.729229 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.729121    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istiod-ca-cert\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.729229 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.729156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-token\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.729229 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.729224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-credential-socket\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.830745 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.830691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-envoy\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.830745 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.830738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4b2v\" (UniqueName: \"kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-kube-api-access-z4b2v\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.831381 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.830785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-certs\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.831381 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.830812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istiod-ca-cert\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.831381 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.830843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-token\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.831381 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.831025    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-credential-socket\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.831381 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.831122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-data\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.831381 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.831160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-podinfo\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.831381 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.831219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-socket\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.831381 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.831229    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-certs\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.831832 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.831444    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-credential-socket\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.831832 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.831566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-socket\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.831832 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.831606    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-data\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.832262 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.832237    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istiod-ca-cert\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.833419 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.833398    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-envoy\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.833699 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.833681    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-podinfo\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.839533 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.839512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-token\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.839826 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.839809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4b2v\" (UniqueName: \"kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-kube-api-access-z4b2v\") pod \"e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") " pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:34.942579 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:34.942487    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:35.082509 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:35.082478    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"]
Jul 22 15:53:35.084706 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:53:35.084680    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2b748a_b59f_46db_b602_3ae6ebd1e82e.slice/crio-f0fb1c42c4ecf8189ba8c7828248cd54a95ac366eaa516dcea3ee192976db481 WatchSource:0}: Error finding container f0fb1c42c4ecf8189ba8c7828248cd54a95ac366eaa516dcea3ee192976db481: Status 404 returned error can't find the container with id f0fb1c42c4ecf8189ba8c7828248cd54a95ac366eaa516dcea3ee192976db481
Jul 22 15:53:35.086887 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:35.086846    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:35.087115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:35.086930    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:35.087115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:35.086979    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:35.387449 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:35.387399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" event={"ID":"4d2b748a-b59f-46db-b602-3ae6ebd1e82e","Type":"ContainerStarted","Data":"89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e"}
Jul 22 15:53:35.387623 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:35.387466    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" event={"ID":"4d2b748a-b59f-46db-b602-3ae6ebd1e82e","Type":"ContainerStarted","Data":"f0fb1c42c4ecf8189ba8c7828248cd54a95ac366eaa516dcea3ee192976db481"}
Jul 22 15:53:35.408879 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:35.408818    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" podStartSLOduration=1.408800515 podStartE2EDuration="1.408800515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:53:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:53:35.407113556 +0000 UTC m=+2439.070262978" watchObservedRunningTime="2026-07-22 15:53:35.408800515 +0000 UTC m=+2439.071949937"
Jul 22 15:53:35.943094 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:35.943060    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:36.521503 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:36.521468    2580 patch_prober.go:28] interesting pod/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 15:53:36.521671 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:36.521523    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 15:53:36.948516 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:36.948438    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:37.403054 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:37.403026    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:37.403877 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:37.403857    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:39.007700 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.007630    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:53:39.175115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175080    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-certs\") pod \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") "
Jul 22 15:53:39.175115 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175114    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istiod-ca-cert\") pod \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") "
Jul 22 15:53:39.175343 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175148    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4sbc\" (UniqueName: \"kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-kube-api-access-t4sbc\") pod \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") "
Jul 22 15:53:39.175343 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175207    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-podinfo\") pod \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") "
Jul 22 15:53:39.175343 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175234    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-token\") pod \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") "
Jul 22 15:53:39.175343 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175265    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-data\") pod \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") "
Jul 22 15:53:39.175343 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175318    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-envoy\") pod \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") "
Jul 22 15:53:39.175608 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175396    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a4b36b4-9c68-4958-a388-a0aa61ec48e8" (UID: "6a4b36b4-9c68-4958-a388-a0aa61ec48e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:53:39.175608 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175441    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-socket\") pod \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") "
Jul 22 15:53:39.175608 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175486    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-credential-socket\") pod \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\" (UID: \"6a4b36b4-9c68-4958-a388-a0aa61ec48e8\") "
Jul 22 15:53:39.175608 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175486    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a4b36b4-9c68-4958-a388-a0aa61ec48e8" (UID: "6a4b36b4-9c68-4958-a388-a0aa61ec48e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 15:53:39.175826 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175658    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a4b36b4-9c68-4958-a388-a0aa61ec48e8" (UID: "6a4b36b4-9c68-4958-a388-a0aa61ec48e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:53:39.175885 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175831    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:39.175885 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175851    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:39.176013 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.175848    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a4b36b4-9c68-4958-a388-a0aa61ec48e8" (UID: "6a4b36b4-9c68-4958-a388-a0aa61ec48e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:53:39.176068 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.176037    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:39.176293 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.176264    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a4b36b4-9c68-4958-a388-a0aa61ec48e8" (UID: "6a4b36b4-9c68-4958-a388-a0aa61ec48e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:53:39.177434 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.177405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a4b36b4-9c68-4958-a388-a0aa61ec48e8" (UID: "6a4b36b4-9c68-4958-a388-a0aa61ec48e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 15:53:39.177525 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.177466    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-kube-api-access-t4sbc" (OuterVolumeSpecName: "kube-api-access-t4sbc") pod "6a4b36b4-9c68-4958-a388-a0aa61ec48e8" (UID: "6a4b36b4-9c68-4958-a388-a0aa61ec48e8"). InnerVolumeSpecName "kube-api-access-t4sbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:53:39.177744 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.177715    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a4b36b4-9c68-4958-a388-a0aa61ec48e8" (UID: "6a4b36b4-9c68-4958-a388-a0aa61ec48e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:53:39.177744 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.177725    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a4b36b4-9c68-4958-a388-a0aa61ec48e8" (UID: "6a4b36b4-9c68-4958-a388-a0aa61ec48e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:53:39.277497 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.277396    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:39.277497 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.277439    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:39.277497 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.277448    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:39.277497 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.277457    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:39.277497 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.277467    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4sbc\" (UniqueName: \"kubernetes.io/projected/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-kube-api-access-t4sbc\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:39.277497 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.277476    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a4b36b4-9c68-4958-a388-a0aa61ec48e8-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:53:39.414710 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.414679    2580 generic.go:356] "Generic (PLEG): container finished" podID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerID="13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada" exitCode=0
Jul 22 15:53:39.414873 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.414726    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"
Jul 22 15:53:39.414873 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.414763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" event={"ID":"6a4b36b4-9c68-4958-a388-a0aa61ec48e8","Type":"ContainerDied","Data":"13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada"}
Jul 22 15:53:39.414873 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.414819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8" event={"ID":"6a4b36b4-9c68-4958-a388-a0aa61ec48e8","Type":"ContainerDied","Data":"06975b54aff00dfb09dd83cffc50f960a2292c14cf1aad426860ead05a322114"}
Jul 22 15:53:39.414873 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.414842    2580 scope.go:117] "RemoveContainer" containerID="13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada"
Jul 22 15:53:39.425107 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.425089    2580 scope.go:117] "RemoveContainer" containerID="2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e"
Jul 22 15:53:39.433025 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.433004    2580 scope.go:117] "RemoveContainer" containerID="13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada"
Jul 22 15:53:39.433289 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:53:39.433265    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada\": container with ID starting with 13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada not found: ID does not exist" containerID="13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada"
Jul 22 15:53:39.433396 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.433297    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada"} err="failed to get container status \"13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada\": rpc error: code = NotFound desc = could not find container \"13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada\": container with ID starting with 13c55342c149abd51f0bc892093fbc9268cdb2f6289c2c6f043aacdde8cd3ada not found: ID does not exist"
Jul 22 15:53:39.433396 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.433317    2580 scope.go:117] "RemoveContainer" containerID="2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e"
Jul 22 15:53:39.433543 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:53:39.433529    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e\": container with ID starting with 2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e not found: ID does not exist" containerID="2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e"
Jul 22 15:53:39.433583 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.433548    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e"} err="failed to get container status \"2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e\": rpc error: code = NotFound desc = could not find container \"2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e\": container with ID starting with 2c14c3573a2d93e881763846e7d3fdc79a250e54cac3d35f874753844c60f61e not found: ID does not exist"
Jul 22 15:53:39.441110 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.441083    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"]
Jul 22 15:53:39.446827 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:39.446804    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f08216-openshift-default-778f4c7cd7-h8qb8"]
Jul 22 15:53:40.787572 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:40.787534    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" path="/var/lib/kubelet/pods/6a4b36b4-9c68-4958-a388-a0aa61ec48e8/volumes"
Jul 22 15:53:42.438436 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.438398    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"]
Jul 22 15:53:42.439063 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.439038    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerName="istio-proxy"
Jul 22 15:53:42.439063 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.439061    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f7b7b94-82b3-482c-991c-f03ec14f67e7" containerName="istio-proxy"
Jul 22 15:53:42.439317 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.439084    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy"
Jul 22 15:53:42.439317 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.439092    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy"
Jul 22 15:53:42.439317 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.439124    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy"
Jul 22 15:53:42.439317 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.439132    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy"
Jul 22 15:53:42.439317 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.439239    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy"
Jul 22 15:53:42.439317 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.439251    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a4b36b4-9c68-4958-a388-a0aa61ec48e8" containerName="istio-proxy"
Jul 22 15:53:42.443953 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.443931    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.446779 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.446759    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-9911b9-openshift-default-dockercfg-kgc2l\""
Jul 22 15:53:42.454958 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.454882    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"]
Jul 22 15:53:42.607159 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.607118    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-envoy\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.607350 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.607183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-podinfo\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.607350 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.607206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istiod-ca-cert\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.607350 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.607251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-certs\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.607350 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.607328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-data\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.607523 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.607357    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hqmv\" (UniqueName: \"kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-kube-api-access-4hqmv\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.607523 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.607388    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-token\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.607523 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.607446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-credential-socket\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.607523 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.607464    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-socket\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708140 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708049    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-data\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708140 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hqmv\" (UniqueName: \"kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-kube-api-access-4hqmv\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708358 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-token\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708358 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-credential-socket\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708358 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-socket\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708358 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-envoy\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708579 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-podinfo\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708579 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istiod-ca-cert\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708579 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-certs\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708579 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-data\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708785 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708628    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-credential-socket\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708785 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708754    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-socket\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.708901 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.708764    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-certs\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.709186 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.709164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istiod-ca-cert\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.710640 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.710622    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-envoy\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.710860 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.710837    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-podinfo\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.716606 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.716579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hqmv\" (UniqueName: \"kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-kube-api-access-4hqmv\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.716702 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.716582    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-token\") pod \"e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") " pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.756313 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.756286    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:42.897831 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.897804    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"]
Jul 22 15:53:42.899654 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:53:42.899624    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d3f926_ace3_46cc_938e_f7ae3c361d3d.slice/crio-01dfc7ab71274f76cd2e3a623034468328b34aea7c204519621967c00f41cc30 WatchSource:0}: Error finding container 01dfc7ab71274f76cd2e3a623034468328b34aea7c204519621967c00f41cc30: Status 404 returned error can't find the container with id 01dfc7ab71274f76cd2e3a623034468328b34aea7c204519621967c00f41cc30
Jul 22 15:53:42.901853 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.901810    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:42.901960 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.901899    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:42.902009 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:42.901966    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:43.438207 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:43.438169    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" event={"ID":"15d3f926-ace3-46cc-938e-f7ae3c361d3d","Type":"ContainerStarted","Data":"894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92"}
Jul 22 15:53:43.438414 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:43.438219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" event={"ID":"15d3f926-ace3-46cc-938e-f7ae3c361d3d","Type":"ContainerStarted","Data":"01dfc7ab71274f76cd2e3a623034468328b34aea7c204519621967c00f41cc30"}
Jul 22 15:53:43.463768 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:43.463702    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" podStartSLOduration=1.463683072 podStartE2EDuration="1.463683072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:53:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:53:43.460933911 +0000 UTC m=+2447.124083330" watchObservedRunningTime="2026-07-22 15:53:43.463683072 +0000 UTC m=+2447.126832493"
Jul 22 15:53:43.756837 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:43.756801    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:43.761580 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:43.761552    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:44.443572 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:44.443541    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:44.444532 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:44.444514    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:51.485655 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:51.485616    2580 generic.go:356] "Generic (PLEG): container finished" podID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerID="89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e" exitCode=0
Jul 22 15:53:51.486193 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:51.485685    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" event={"ID":"4d2b748a-b59f-46db-b602-3ae6ebd1e82e","Type":"ContainerDied","Data":"89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e"}
Jul 22 15:53:51.486258 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:51.486239    2580 scope.go:117] "RemoveContainer" containerID="89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e"
Jul 22 15:53:51.487880 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:51.487838    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:51.488005 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:51.487963    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:51.488075 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:51.488016    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:52.403029 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:52.402992    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:52.492763 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:52.492733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" event={"ID":"4d2b748a-b59f-46db-b602-3ae6ebd1e82e","Type":"ContainerStarted","Data":"37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf"}
Jul 22 15:53:52.943035 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:52.942997    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:52.944098 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:52.944074    2580 patch_prober.go:28] interesting pod/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 22 15:53:52.944224 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:52.944118    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 22 15:53:53.943776 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:53.943736    2580 patch_prober.go:28] interesting pod/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 22 15:53:53.944215 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:53.943790    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 22 15:53:54.942832 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:54.942791    2580 patch_prober.go:28] interesting pod/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 22 15:53:54.943043 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:54.942863    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 22 15:53:55.943368 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:55.943323    2580 patch_prober.go:28] interesting pod/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 22 15:53:55.943792 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:55.943414    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 22 15:53:56.943407 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:56.943365    2580 patch_prober.go:28] interesting pod/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 22 15:53:56.943789 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:56.943441    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 22 15:53:57.947576 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:57.947539    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:57.948076 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:57.947822    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:57.948650 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:57.948629    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 15:53:58.528062 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:58.528028    2580 generic.go:356] "Generic (PLEG): container finished" podID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerID="894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92" exitCode=0
Jul 22 15:53:58.528283 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:58.528102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" event={"ID":"15d3f926-ace3-46cc-938e-f7ae3c361d3d","Type":"ContainerDied","Data":"894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92"}
Jul 22 15:53:58.528624 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:58.528606    2580 scope.go:117] "RemoveContainer" containerID="894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92"
Jul 22 15:53:58.529541 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:58.529515    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:58.529592 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:58.529582    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:58.529633 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:58.529615    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 22 15:53:59.444149 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:59.444114    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:59.534490 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:59.534454    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" event={"ID":"15d3f926-ace3-46cc-938e-f7ae3c361d3d","Type":"ContainerStarted","Data":"7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba"}
Jul 22 15:53:59.756588 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:59.756553    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:53:59.757378 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:59.757345    2580 patch_prober.go:28] interesting pod/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 22 15:53:59.757499 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:53:59.757401    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 22 15:54:00.756827 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:00.756793    2580 patch_prober.go:28] interesting pod/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 22 15:54:00.757231 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:00.756880    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 22 15:54:01.757580 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:01.757545    2580 patch_prober.go:28] interesting pod/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 22 15:54:01.758003 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:01.757601    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 22 15:54:02.756857 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:02.756822    2580 patch_prober.go:28] interesting pod/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 22 15:54:02.757056 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:02.756879    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 22 15:54:03.757288 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:03.757251    2580 patch_prober.go:28] interesting pod/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 22 15:54:03.757699 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:03.757310    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 22 15:54:04.761447 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:04.761411    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:54:04.761931 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:04.761797    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:54:04.762529 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:04.762511    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 15:54:59.944440 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:59.944358    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"]
Jul 22 15:54:59.947969 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:59.947952    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:54:59.951052 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:59.951032    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9911b9\"/\"auth-test-model-9911b9-kserve-self-signed-certs\""
Jul 22 15:54:59.952118 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:59.952091    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9911b9\"/\"kube-root-ca.crt\""
Jul 22 15:54:59.952230 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:59.952128    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-9911b9\"/\"openshift-service-ca.crt\""
Jul 22 15:54:59.952230 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:59.952159    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-9911b9\"/\"default-dockercfg-96mc2\""
Jul 22 15:54:59.958567 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:54:59.958537    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"]
Jul 22 15:55:00.025022 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.024987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tmp-dir\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.025190 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.025073    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-dshm\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.025190 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.025098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-model-cache\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.025190 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.025127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tls-certs\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.025322 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.025192    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkw5k\" (UniqueName: \"kubernetes.io/projected/a6cea3e4-2395-4301-ad5e-94016c9a30f0-kube-api-access-qkw5k\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.025322 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.025252    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-home\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.126491 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.126455    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-home\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.126681 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.126516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tmp-dir\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.126681 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.126561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-dshm\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.126681 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.126580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-model-cache\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.126846 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.126704    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tls-certs\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.126846 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.126746    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkw5k\" (UniqueName: \"kubernetes.io/projected/a6cea3e4-2395-4301-ad5e-94016c9a30f0-kube-api-access-qkw5k\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.126986 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.126845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-home\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.126986 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.126966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tmp-dir\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.127110 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.127083    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-model-cache\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.128745 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.128718    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-dshm\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.129089 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.129073    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tls-certs\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.136316 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.136291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkw5k\" (UniqueName: \"kubernetes.io/projected/a6cea3e4-2395-4301-ad5e-94016c9a30f0-kube-api-access-qkw5k\") pod \"auth-test-model-9911b9-kserve-c698db5f-gq7x7\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") " pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.257106 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.257073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:00.394868 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.394845    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"]
Jul 22 15:55:00.396680 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:55:00.396654    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6cea3e4_2395_4301_ad5e_94016c9a30f0.slice/crio-2045f3dcbe0f69927ed211ecd87242589bf87de40852b1824a67fbefafc52c52 WatchSource:0}: Error finding container 2045f3dcbe0f69927ed211ecd87242589bf87de40852b1824a67fbefafc52c52: Status 404 returned error can't find the container with id 2045f3dcbe0f69927ed211ecd87242589bf87de40852b1824a67fbefafc52c52
Jul 22 15:55:00.833141 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.833105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7" event={"ID":"a6cea3e4-2395-4301-ad5e-94016c9a30f0","Type":"ContainerStarted","Data":"7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d"}
Jul 22 15:55:00.833141 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.833147    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7" event={"ID":"a6cea3e4-2395-4301-ad5e-94016c9a30f0","Type":"ContainerStarted","Data":"2045f3dcbe0f69927ed211ecd87242589bf87de40852b1824a67fbefafc52c52"}
Jul 22 15:55:00.855641 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:00.855592    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7" podStartSLOduration=1.855566415 podStartE2EDuration="1.855566415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:54:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:55:00.853444118 +0000 UTC m=+2524.516593539" watchObservedRunningTime="2026-07-22 15:55:00.855566415 +0000 UTC m=+2524.518715836"
Jul 22 15:55:10.258084 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:10.258044    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:10.258084 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:10.258093    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:10.270677 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:10.270652    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:55:10.901645 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:55:10.901617    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:57:15.081631 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:15.081584    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"]
Jul 22 15:57:30.101580 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.101511    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7" podUID="a6cea3e4-2395-4301-ad5e-94016c9a30f0" containerName="main" containerID="cri-o://7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d" gracePeriod=45
Jul 22 15:57:30.350419 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.350390    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:57:30.432859 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.432781    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tls-certs\") pod \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") "
Jul 22 15:57:30.433031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.432861    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-home\") pod \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") "
Jul 22 15:57:30.433031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.432885    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-dshm\") pod \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") "
Jul 22 15:57:30.433031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.432904    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkw5k\" (UniqueName: \"kubernetes.io/projected/a6cea3e4-2395-4301-ad5e-94016c9a30f0-kube-api-access-qkw5k\") pod \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") "
Jul 22 15:57:30.433031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.432950    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-model-cache\") pod \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") "
Jul 22 15:57:30.433031 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.433027    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tmp-dir\") pod \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\" (UID: \"a6cea3e4-2395-4301-ad5e-94016c9a30f0\") "
Jul 22 15:57:30.433259 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.433096    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-home" (OuterVolumeSpecName: "home") pod "a6cea3e4-2395-4301-ad5e-94016c9a30f0" (UID: "a6cea3e4-2395-4301-ad5e-94016c9a30f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:57:30.433259 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.433246    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a6cea3e4-2395-4301-ad5e-94016c9a30f0" (UID: "a6cea3e4-2395-4301-ad5e-94016c9a30f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:57:30.433370 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.433278    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "a6cea3e4-2395-4301-ad5e-94016c9a30f0" (UID: "a6cea3e4-2395-4301-ad5e-94016c9a30f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:57:30.433423 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.433372    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tmp-dir\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:57:30.433423 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.433391    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-home\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:57:30.433423 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.433405    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-model-cache\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:57:30.435171 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.435143    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-dshm" (OuterVolumeSpecName: "dshm") pod "a6cea3e4-2395-4301-ad5e-94016c9a30f0" (UID: "a6cea3e4-2395-4301-ad5e-94016c9a30f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 15:57:30.435310 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.435230    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6cea3e4-2395-4301-ad5e-94016c9a30f0-kube-api-access-qkw5k" (OuterVolumeSpecName: "kube-api-access-qkw5k") pod "a6cea3e4-2395-4301-ad5e-94016c9a30f0" (UID: "a6cea3e4-2395-4301-ad5e-94016c9a30f0"). InnerVolumeSpecName "kube-api-access-qkw5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 15:57:30.435310 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.435244    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a6cea3e4-2395-4301-ad5e-94016c9a30f0" (UID: "a6cea3e4-2395-4301-ad5e-94016c9a30f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 15:57:30.534627 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.534587    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6cea3e4-2395-4301-ad5e-94016c9a30f0-dshm\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:57:30.534627 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.534622    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkw5k\" (UniqueName: \"kubernetes.io/projected/a6cea3e4-2395-4301-ad5e-94016c9a30f0-kube-api-access-qkw5k\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:57:30.534627 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.534633    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6cea3e4-2395-4301-ad5e-94016c9a30f0-tls-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 15:57:30.591279 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.591248    2580 generic.go:356] "Generic (PLEG): container finished" podID="a6cea3e4-2395-4301-ad5e-94016c9a30f0" containerID="7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d" exitCode=0
Jul 22 15:57:30.591441 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.591296    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"
Jul 22 15:57:30.591441 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.591339    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7" event={"ID":"a6cea3e4-2395-4301-ad5e-94016c9a30f0","Type":"ContainerDied","Data":"7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d"}
Jul 22 15:57:30.591441 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.591383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7" event={"ID":"a6cea3e4-2395-4301-ad5e-94016c9a30f0","Type":"ContainerDied","Data":"2045f3dcbe0f69927ed211ecd87242589bf87de40852b1824a67fbefafc52c52"}
Jul 22 15:57:30.591441 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.591403    2580 scope.go:117] "RemoveContainer" containerID="7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d"
Jul 22 15:57:30.605888 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.605866    2580 scope.go:117] "RemoveContainer" containerID="7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d"
Jul 22 15:57:30.606228 ip-10-0-133-167 kubenswrapper[2580]: E0722 15:57:30.606205    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d\": container with ID starting with 7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d not found: ID does not exist" containerID="7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d"
Jul 22 15:57:30.606304 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.606234    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d"} err="failed to get container status \"7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d\": rpc error: code = NotFound desc = could not find container \"7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d\": container with ID starting with 7035669800f2f344e40aae309a58e9a09c2826ddbb3cbc381664e311076aff4d not found: ID does not exist"
Jul 22 15:57:30.616964 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.616940    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"]
Jul 22 15:57:30.622231 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.622209    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-9911b9/auth-test-model-9911b9-kserve-c698db5f-gq7x7"]
Jul 22 15:57:30.781194 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:30.781159    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6cea3e4-2395-4301-ad5e-94016c9a30f0" path="/var/lib/kubelet/pods/a6cea3e4-2395-4301-ad5e-94016c9a30f0/volumes"
Jul 22 15:57:56.898023 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:56.897943    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:57:56.906910 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:57:56.906887    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m9jb2_1d12912d-1418-477a-ba02-3c04124de36b/ovn-acl-logging/0.log"
Jul 22 15:58:49.834722 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.834685    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"]
Jul 22 15:58:49.835328 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.835109    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cea3e4-2395-4301-ad5e-94016c9a30f0" containerName="main"
Jul 22 15:58:49.835328 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.835121    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cea3e4-2395-4301-ad5e-94016c9a30f0" containerName="main"
Jul 22 15:58:49.835328 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.835209    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6cea3e4-2395-4301-ad5e-94016c9a30f0" containerName="main"
Jul 22 15:58:49.837905 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.837886    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.841025 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.841005    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-290ac7\"/\"kube-root-ca.crt\""
Jul 22 15:58:49.842037 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.842012    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-290ac7\"/\"openshift-service-ca.crt\""
Jul 22 15:58:49.842147 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.842072    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-290ac7\"/\"rate-test-model-290ac7-kserve-self-signed-certs\""
Jul 22 15:58:49.842226 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.842211    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-290ac7\"/\"default-dockercfg-p2ffq\""
Jul 22 15:58:49.846647 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.846626    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"]
Jul 22 15:58:49.883092 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.883058    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-model-cache\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.883237 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.883186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cqhm\" (UniqueName: \"kubernetes.io/projected/70cf3592-16e2-4b36-bed2-180323fc9838-kube-api-access-8cqhm\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.883296 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.883239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-dshm\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.883358 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.883336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-home\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.883469 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.883451    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-tmp-dir\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.883534 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.883509    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70cf3592-16e2-4b36-bed2-180323fc9838-tls-certs\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.984054 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.984016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cqhm\" (UniqueName: \"kubernetes.io/projected/70cf3592-16e2-4b36-bed2-180323fc9838-kube-api-access-8cqhm\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.984054 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.984058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-dshm\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.984304 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.984128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-home\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.984304 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.984165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-tmp-dir\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.984304 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.984209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70cf3592-16e2-4b36-bed2-180323fc9838-tls-certs\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.984304 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.984255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-model-cache\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.984638 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.984614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-home\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.984638 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.984628    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-tmp-dir\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.984750 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.984657    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-model-cache\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.986420 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.986396    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-dshm\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.986694 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.986675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70cf3592-16e2-4b36-bed2-180323fc9838-tls-certs\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:49.994367 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:49.994347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cqhm\" (UniqueName: \"kubernetes.io/projected/70cf3592-16e2-4b36-bed2-180323fc9838-kube-api-access-8cqhm\") pod \"rate-test-model-290ac7-kserve-867c599f95-vl2rs\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") " pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:50.150303 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:50.150206    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:58:50.285659 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:50.285636    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"]
Jul 22 15:58:50.288077 ip-10-0-133-167 kubenswrapper[2580]: W0722 15:58:50.288052    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70cf3592_16e2_4b36_bed2_180323fc9838.slice/crio-56707eb2732027d4ad9e0d00ee1bd1bcae0e50e3d61f210f4440dbb1db7aeb64 WatchSource:0}: Error finding container 56707eb2732027d4ad9e0d00ee1bd1bcae0e50e3d61f210f4440dbb1db7aeb64: Status 404 returned error can't find the container with id 56707eb2732027d4ad9e0d00ee1bd1bcae0e50e3d61f210f4440dbb1db7aeb64
Jul 22 15:58:50.975760 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:50.975726    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs" event={"ID":"70cf3592-16e2-4b36-bed2-180323fc9838","Type":"ContainerStarted","Data":"a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881"}
Jul 22 15:58:50.975760 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:50.975763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs" event={"ID":"70cf3592-16e2-4b36-bed2-180323fc9838","Type":"ContainerStarted","Data":"56707eb2732027d4ad9e0d00ee1bd1bcae0e50e3d61f210f4440dbb1db7aeb64"}
Jul 22 15:58:50.996516 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:58:50.996461    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs" podStartSLOduration=1.99644328 podStartE2EDuration="1.99644328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 15:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 15:58:50.996284941 +0000 UTC m=+2754.659434363" watchObservedRunningTime="2026-07-22 15:58:50.99644328 +0000 UTC m=+2754.659592702"
Jul 22 15:59:00.150540 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:59:00.150498    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:59:00.153094 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:59:00.150554    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:59:00.163408 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:59:00.163383    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:59:01.036222 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:59:01.036192    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 15:59:52.410761 ip-10-0-133-167 kubenswrapper[2580]: I0722 15:59:52.410726    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"]
Jul 22 16:00:07.433116 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.433041    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs" podUID="70cf3592-16e2-4b36-bed2-180323fc9838" containerName="main" containerID="cri-o://a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881" gracePeriod=45
Jul 22 16:00:07.684101 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.684042    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 16:00:07.706939 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.706891    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-model-cache\") pod \"70cf3592-16e2-4b36-bed2-180323fc9838\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") "
Jul 22 16:00:07.707102 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.706965    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70cf3592-16e2-4b36-bed2-180323fc9838-tls-certs\") pod \"70cf3592-16e2-4b36-bed2-180323fc9838\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") "
Jul 22 16:00:07.707102 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.707020    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-tmp-dir\") pod \"70cf3592-16e2-4b36-bed2-180323fc9838\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") "
Jul 22 16:00:07.707228 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.707102    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cqhm\" (UniqueName: \"kubernetes.io/projected/70cf3592-16e2-4b36-bed2-180323fc9838-kube-api-access-8cqhm\") pod \"70cf3592-16e2-4b36-bed2-180323fc9838\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") "
Jul 22 16:00:07.707228 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.707130    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-dshm\") pod \"70cf3592-16e2-4b36-bed2-180323fc9838\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") "
Jul 22 16:00:07.707228 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.707157    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-home\") pod \"70cf3592-16e2-4b36-bed2-180323fc9838\" (UID: \"70cf3592-16e2-4b36-bed2-180323fc9838\") "
Jul 22 16:00:07.707228 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.707160    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-model-cache" (OuterVolumeSpecName: "model-cache") pod "70cf3592-16e2-4b36-bed2-180323fc9838" (UID: "70cf3592-16e2-4b36-bed2-180323fc9838"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:00:07.707434 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.707281    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "70cf3592-16e2-4b36-bed2-180323fc9838" (UID: "70cf3592-16e2-4b36-bed2-180323fc9838"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:00:07.707578 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.707497    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-home" (OuterVolumeSpecName: "home") pod "70cf3592-16e2-4b36-bed2-180323fc9838" (UID: "70cf3592-16e2-4b36-bed2-180323fc9838"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:00:07.707578 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.707522    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-model-cache\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:07.707578 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.707569    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-tmp-dir\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:07.709556 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.709526    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70cf3592-16e2-4b36-bed2-180323fc9838-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "70cf3592-16e2-4b36-bed2-180323fc9838" (UID: "70cf3592-16e2-4b36-bed2-180323fc9838"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 16:00:07.709659 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.709567    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-dshm" (OuterVolumeSpecName: "dshm") pod "70cf3592-16e2-4b36-bed2-180323fc9838" (UID: "70cf3592-16e2-4b36-bed2-180323fc9838"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:00:07.709659 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.709634    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70cf3592-16e2-4b36-bed2-180323fc9838-kube-api-access-8cqhm" (OuterVolumeSpecName: "kube-api-access-8cqhm") pod "70cf3592-16e2-4b36-bed2-180323fc9838" (UID: "70cf3592-16e2-4b36-bed2-180323fc9838"). InnerVolumeSpecName "kube-api-access-8cqhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:00:07.808667 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.808635    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cqhm\" (UniqueName: \"kubernetes.io/projected/70cf3592-16e2-4b36-bed2-180323fc9838-kube-api-access-8cqhm\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:07.808667 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.808663    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-dshm\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:07.808667 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.808672    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70cf3592-16e2-4b36-bed2-180323fc9838-home\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:07.808903 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:07.808681    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70cf3592-16e2-4b36-bed2-180323fc9838-tls-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:08.364839 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:08.364733    2580 generic.go:356] "Generic (PLEG): container finished" podID="70cf3592-16e2-4b36-bed2-180323fc9838" containerID="a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881" exitCode=0
Jul 22 16:00:08.364839 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:08.364783    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"
Jul 22 16:00:08.364839 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:08.364799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs" event={"ID":"70cf3592-16e2-4b36-bed2-180323fc9838","Type":"ContainerDied","Data":"a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881"}
Jul 22 16:00:08.364839 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:08.364841    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs" event={"ID":"70cf3592-16e2-4b36-bed2-180323fc9838","Type":"ContainerDied","Data":"56707eb2732027d4ad9e0d00ee1bd1bcae0e50e3d61f210f4440dbb1db7aeb64"}
Jul 22 16:00:08.365257 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:08.364865    2580 scope.go:117] "RemoveContainer" containerID="a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881"
Jul 22 16:00:08.375055 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:08.375034    2580 scope.go:117] "RemoveContainer" containerID="a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881"
Jul 22 16:00:08.375328 ip-10-0-133-167 kubenswrapper[2580]: E0722 16:00:08.375307    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881\": container with ID starting with a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881 not found: ID does not exist" containerID="a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881"
Jul 22 16:00:08.375377 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:08.375338    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881"} err="failed to get container status \"a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881\": rpc error: code = NotFound desc = could not find container \"a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881\": container with ID starting with a5eaacec49d76a2f8db5db0b5ed8aa3857a98f2fc724bc2c0b877ee2490c2881 not found: ID does not exist"
Jul 22 16:00:08.387409 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:08.387385    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"]
Jul 22 16:00:08.389186 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:08.389166    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-290ac7/rate-test-model-290ac7-kserve-867c599f95-vl2rs"]
Jul 22 16:00:08.781330 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:08.781291    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70cf3592-16e2-4b36-bed2-180323fc9838" path="/var/lib/kubelet/pods/70cf3592-16e2-4b36-bed2-180323fc9838/volumes"
Jul 22 16:00:39.693598 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:39.693556    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"]
Jul 22 16:00:39.694220 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:39.693840    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy" containerID="cri-o://37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf" gracePeriod=30
Jul 22 16:00:42.950442 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:42.950400    2580 patch_prober.go:28] interesting pod/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 16:00:42.950890 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:42.950471    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 16:00:44.949834 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:44.949810    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 16:00:45.056608 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.056576    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-token\") pod \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") "
Jul 22 16:00:45.056789 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.056616    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-podinfo\") pod \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") "
Jul 22 16:00:45.056789 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.056656    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-certs\") pod \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") "
Jul 22 16:00:45.056789 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.056710    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-credential-socket\") pod \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") "
Jul 22 16:00:45.056789 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.056737    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-socket\") pod \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") "
Jul 22 16:00:45.056789 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.056777    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-envoy\") pod \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") "
Jul 22 16:00:45.057099 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.056809    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4b2v\" (UniqueName: \"kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-kube-api-access-z4b2v\") pod \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") "
Jul 22 16:00:45.057099 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.056956    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-data\") pod \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") "
Jul 22 16:00:45.057099 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.056988    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istiod-ca-cert\") pod \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\" (UID: \"4d2b748a-b59f-46db-b602-3ae6ebd1e82e\") "
Jul 22 16:00:45.057099 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.057045    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4d2b748a-b59f-46db-b602-3ae6ebd1e82e" (UID: "4d2b748a-b59f-46db-b602-3ae6ebd1e82e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:00:45.057099 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.057056    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4d2b748a-b59f-46db-b602-3ae6ebd1e82e" (UID: "4d2b748a-b59f-46db-b602-3ae6ebd1e82e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:00:45.057099 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.057083    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4d2b748a-b59f-46db-b602-3ae6ebd1e82e" (UID: "4d2b748a-b59f-46db-b602-3ae6ebd1e82e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:00:45.057418 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.057388    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:45.057418 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.057409    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:45.057526 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.057423    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:45.057526 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.057423    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4d2b748a-b59f-46db-b602-3ae6ebd1e82e" (UID: "4d2b748a-b59f-46db-b602-3ae6ebd1e82e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:00:45.057791 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.057762    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-data" (OuterVolumeSpecName: "istio-data") pod "4d2b748a-b59f-46db-b602-3ae6ebd1e82e" (UID: "4d2b748a-b59f-46db-b602-3ae6ebd1e82e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:00:45.059337 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.059310    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-token" (OuterVolumeSpecName: "istio-token") pod "4d2b748a-b59f-46db-b602-3ae6ebd1e82e" (UID: "4d2b748a-b59f-46db-b602-3ae6ebd1e82e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:00:45.059465 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.059334    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4d2b748a-b59f-46db-b602-3ae6ebd1e82e" (UID: "4d2b748a-b59f-46db-b602-3ae6ebd1e82e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 16:00:45.059465 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.059334    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-kube-api-access-z4b2v" (OuterVolumeSpecName: "kube-api-access-z4b2v") pod "4d2b748a-b59f-46db-b602-3ae6ebd1e82e" (UID: "4d2b748a-b59f-46db-b602-3ae6ebd1e82e"). InnerVolumeSpecName "kube-api-access-z4b2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:00:45.059575 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.059460    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4d2b748a-b59f-46db-b602-3ae6ebd1e82e" (UID: "4d2b748a-b59f-46db-b602-3ae6ebd1e82e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:00:45.158749 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.158711    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:45.158749 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.158741    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:45.158749 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.158751    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:45.158749 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.158760    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4b2v\" (UniqueName: \"kubernetes.io/projected/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-kube-api-access-z4b2v\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:45.159056 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.158771    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:45.159056 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.158780    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d2b748a-b59f-46db-b602-3ae6ebd1e82e-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:00:45.555257 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.555222    2580 generic.go:356] "Generic (PLEG): container finished" podID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerID="37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf" exitCode=0
Jul 22 16:00:45.555466 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.555279    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"
Jul 22 16:00:45.555466 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.555308    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" event={"ID":"4d2b748a-b59f-46db-b602-3ae6ebd1e82e","Type":"ContainerDied","Data":"37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf"}
Jul 22 16:00:45.555466 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.555372    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7" event={"ID":"4d2b748a-b59f-46db-b602-3ae6ebd1e82e","Type":"ContainerDied","Data":"f0fb1c42c4ecf8189ba8c7828248cd54a95ac366eaa516dcea3ee192976db481"}
Jul 22 16:00:45.555466 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.555397    2580 scope.go:117] "RemoveContainer" containerID="37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf"
Jul 22 16:00:45.565315 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.565299    2580 scope.go:117] "RemoveContainer" containerID="89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e"
Jul 22 16:00:45.573224 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.573205    2580 scope.go:117] "RemoveContainer" containerID="37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf"
Jul 22 16:00:45.573497 ip-10-0-133-167 kubenswrapper[2580]: E0722 16:00:45.573480    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf\": container with ID starting with 37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf not found: ID does not exist" containerID="37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf"
Jul 22 16:00:45.573551 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.573506    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf"} err="failed to get container status \"37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf\": rpc error: code = NotFound desc = could not find container \"37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf\": container with ID starting with 37229f3c87f7504771cec4ff4cc8f9525b9de976eec2f249407a9fc9b10ab4bf not found: ID does not exist"
Jul 22 16:00:45.573551 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.573523    2580 scope.go:117] "RemoveContainer" containerID="89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e"
Jul 22 16:00:45.573722 ip-10-0-133-167 kubenswrapper[2580]: E0722 16:00:45.573708    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e\": container with ID starting with 89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e not found: ID does not exist" containerID="89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e"
Jul 22 16:00:45.573758 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.573727    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e"} err="failed to get container status \"89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e\": rpc error: code = NotFound desc = could not find container \"89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e\": container with ID starting with 89be805a2dc5a132aa6b301a4b1af31a5a48e53b0ff751f243c1318e296f956e not found: ID does not exist"
Jul 22 16:00:45.587758 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.581754    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"]
Jul 22 16:00:45.590385 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:45.590362    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-290ac7-openshift-default-645b6b4dcf-wthr7"]
Jul 22 16:00:46.781155 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:00:46.781120    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" path="/var/lib/kubelet/pods/4d2b748a-b59f-46db-b602-3ae6ebd1e82e/volumes"
Jul 22 16:01:02.043743 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:02.043705    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"]
Jul 22 16:01:02.044193 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:02.043974    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy" containerID="cri-o://7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba" gracePeriod=30
Jul 22 16:01:02.739368 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:02.739325    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f84cfd697-fnjhr_5114a7b2-2ea7-4a2e-892f-f949ff046a92/authorino/0.log"
Jul 22 16:01:04.764450 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:04.764413    2580 patch_prober.go:28] interesting pod/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 16:01:04.764853 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:04.764495    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 16:01:07.299263 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.299238    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 16:01:07.466252 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466163    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hqmv\" (UniqueName: \"kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-kube-api-access-4hqmv\") pod \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") "
Jul 22 16:01:07.466252 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466202    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-socket\") pod \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") "
Jul 22 16:01:07.466252 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466242    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-token\") pod \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") "
Jul 22 16:01:07.466549 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466325    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-envoy\") pod \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") "
Jul 22 16:01:07.466549 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466344    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istiod-ca-cert\") pod \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") "
Jul 22 16:01:07.466549 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466361    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-credential-socket\") pod \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") "
Jul 22 16:01:07.466549 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466385    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-certs\") pod \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") "
Jul 22 16:01:07.466549 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466409    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-data\") pod \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") "
Jul 22 16:01:07.466549 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466490    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-podinfo\") pod \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\" (UID: \"15d3f926-ace3-46cc-938e-f7ae3c361d3d\") "
Jul 22 16:01:07.466549 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466527    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15d3f926-ace3-46cc-938e-f7ae3c361d3d" (UID: "15d3f926-ace3-46cc-938e-f7ae3c361d3d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:01:07.466981 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466624    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15d3f926-ace3-46cc-938e-f7ae3c361d3d" (UID: "15d3f926-ace3-46cc-938e-f7ae3c361d3d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:01:07.466981 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466857    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-credential-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:01:07.466981 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466877    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-socket\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:01:07.467155 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.466980    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15d3f926-ace3-46cc-938e-f7ae3c361d3d" (UID: "15d3f926-ace3-46cc-938e-f7ae3c361d3d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 16:01:07.467155 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.467068    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15d3f926-ace3-46cc-938e-f7ae3c361d3d" (UID: "15d3f926-ace3-46cc-938e-f7ae3c361d3d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:01:07.467526 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.467415    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-data" (OuterVolumeSpecName: "istio-data") pod "15d3f926-ace3-46cc-938e-f7ae3c361d3d" (UID: "15d3f926-ace3-46cc-938e-f7ae3c361d3d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:01:07.468950 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.468894    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-kube-api-access-4hqmv" (OuterVolumeSpecName: "kube-api-access-4hqmv") pod "15d3f926-ace3-46cc-938e-f7ae3c361d3d" (UID: "15d3f926-ace3-46cc-938e-f7ae3c361d3d"). InnerVolumeSpecName "kube-api-access-4hqmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:01:07.468950 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.468929    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-token" (OuterVolumeSpecName: "istio-token") pod "15d3f926-ace3-46cc-938e-f7ae3c361d3d" (UID: "15d3f926-ace3-46cc-938e-f7ae3c361d3d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 16:01:07.468950 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.468940    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15d3f926-ace3-46cc-938e-f7ae3c361d3d" (UID: "15d3f926-ace3-46cc-938e-f7ae3c361d3d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 16:01:07.469123 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.469030    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15d3f926-ace3-46cc-938e-f7ae3c361d3d" (UID: "15d3f926-ace3-46cc-938e-f7ae3c361d3d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 22 16:01:07.568253 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.568217    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-envoy\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:01:07.568253 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.568247    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istiod-ca-cert\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:01:07.568253 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.568258    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-workload-certs\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:01:07.568498 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.568271    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-data\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:01:07.568498 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.568285    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-podinfo\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:01:07.568498 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.568301    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hqmv\" (UniqueName: \"kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-kube-api-access-4hqmv\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:01:07.568498 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.568313    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15d3f926-ace3-46cc-938e-f7ae3c361d3d-istio-token\") on node \"ip-10-0-133-167.ec2.internal\" DevicePath \"\""
Jul 22 16:01:07.669885 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.669849    2580 generic.go:356] "Generic (PLEG): container finished" podID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerID="7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba" exitCode=0
Jul 22 16:01:07.670095 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.669901    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"
Jul 22 16:01:07.670095 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.669955    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" event={"ID":"15d3f926-ace3-46cc-938e-f7ae3c361d3d","Type":"ContainerDied","Data":"7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba"}
Jul 22 16:01:07.670095 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.670014    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8" event={"ID":"15d3f926-ace3-46cc-938e-f7ae3c361d3d","Type":"ContainerDied","Data":"01dfc7ab71274f76cd2e3a623034468328b34aea7c204519621967c00f41cc30"}
Jul 22 16:01:07.670095 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.670040    2580 scope.go:117] "RemoveContainer" containerID="7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba"
Jul 22 16:01:07.685832 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.679946    2580 scope.go:117] "RemoveContainer" containerID="894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92"
Jul 22 16:01:07.692721 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.692702    2580 scope.go:117] "RemoveContainer" containerID="7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba"
Jul 22 16:01:07.693021 ip-10-0-133-167 kubenswrapper[2580]: E0722 16:01:07.693002    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba\": container with ID starting with 7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba not found: ID does not exist" containerID="7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba"
Jul 22 16:01:07.693078 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.693030    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba"} err="failed to get container status \"7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba\": rpc error: code = NotFound desc = could not find container \"7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba\": container with ID starting with 7ecbf30e4c19af266cb802460d2f6ba737062b1fdf848c805166010a391df7ba not found: ID does not exist"
Jul 22 16:01:07.693078 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.693047    2580 scope.go:117] "RemoveContainer" containerID="894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92"
Jul 22 16:01:07.693279 ip-10-0-133-167 kubenswrapper[2580]: E0722 16:01:07.693261    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92\": container with ID starting with 894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92 not found: ID does not exist" containerID="894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92"
Jul 22 16:01:07.693329 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.693283    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92"} err="failed to get container status \"894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92\": rpc error: code = NotFound desc = could not find container \"894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92\": container with ID starting with 894dd9638e9d055253f73afc7a881a8f414ae5c2e955c1426061f434be1d6d92 not found: ID does not exist"
Jul 22 16:01:07.697335 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.697306    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"]
Jul 22 16:01:07.701598 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:07.701578    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-9911b9-openshift-default-69b874d56c-drlv8"]
Jul 22 16:01:08.087901 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:08.087868    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-thkz4_39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee/manager/0.log"
Jul 22 16:01:08.214024 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:08.213993    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dbsjk_0c8f3a91-005b-486c-9ff3-4bd72c02cd82/manager/0.log"
Jul 22 16:01:08.450959 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:08.450863    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tz68s_779a049c-0fcf-4a91-a1ed-fa00de2ee539/server/0.log"
Jul 22 16:01:08.580425 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:08.580391    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fbmrr_73ac20fd-0264-4798-8ad7-e295dc8378be/manager/0.log"
Jul 22 16:01:08.780893 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:08.780861    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" path="/var/lib/kubelet/pods/15d3f926-ace3-46cc-938e-f7ae3c361d3d/volumes"
Jul 22 16:01:08.807614 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:08.807584    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6f74d59b-rctlm_ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1/copy-manifests/0.log"
Jul 22 16:01:08.815097 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:08.815076    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6f74d59b-rctlm_ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1/manager/0.log"
Jul 22 16:01:09.299279 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:09.299254    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-bf77ff4b8-szvjl_3a59166e-7aed-4fb9-886b-426bbd6faae0/maas-api/0.log"
Jul 22 16:01:09.745185 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:09.745157    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-qsp94_3e65b68e-bc23-436b-93cd-98fe2ca2532f/postgres/0.log"
Jul 22 16:01:11.046796 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:11.046765    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f84cfd697-fnjhr_5114a7b2-2ea7-4a2e-892f-f949ff046a92/authorino/0.log"
Jul 22 16:01:11.165335 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:11.165302    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mc898_3adb4a3e-7f25-48a6-a4c7-340d46a17bd1/manager/0.log"
Jul 22 16:01:11.276606 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:11.276572    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c8p6h_0b61a989-397a-468c-a84e-d03d280e635a/manager/0.log"
Jul 22 16:01:11.496688 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:11.496662    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pd8rt_f84ac639-9452-455d-9d4a-803fefd54c8b/registry-server/0.log"
Jul 22 16:01:11.621080 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:11.621046    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hrkgs_e24e7359-ec6f-459a-b482-8c730d0f92c4/manager/0.log"
Jul 22 16:01:12.211125 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:12.211099    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hdd5b_9359a32a-6055-4731-a19e-3736631fbf12/istio-proxy/0.log"
Jul 22 16:01:12.459991 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:12.459959    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6764d75874-v9qdg_1ba07b96-f346-4210-8073-004ca3232972/kube-auth-proxy/0.log"
Jul 22 16:01:12.694272 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:12.694241    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9nlnb_3327f692-983e-4835-9815-3a85f2634d75/istio-proxy/1.log"
Jul 22 16:01:12.949800 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:12.949706    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-mtsmn_b88d58ec-be4e-4aa0-83d4-e540224819bc/payload-processing/0.log"
Jul 22 16:01:13.400060 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:13.400022    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-dqf4x_e50fa91e-c1be-4ee7-bf87-4cd63703f316/main/0.log"
Jul 22 16:01:13.742364 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:13.742308    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmds7_d9161582-f83f-4a14-bb2a-44e46ede746a/main/0.log"
Jul 22 16:01:19.263852 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.263813    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zkc2l/must-gather-xh6gb"]
Jul 22 16:01:19.264391 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264372    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy"
Jul 22 16:01:19.264473 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264394    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy"
Jul 22 16:01:19.264473 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264411    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy"
Jul 22 16:01:19.264473 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264419    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy"
Jul 22 16:01:19.264473 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264441    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cf3592-16e2-4b36-bed2-180323fc9838" containerName="main"
Jul 22 16:01:19.264473 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264450    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cf3592-16e2-4b36-bed2-180323fc9838" containerName="main"
Jul 22 16:01:19.264473 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264464    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy"
Jul 22 16:01:19.264473 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264472    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy"
Jul 22 16:01:19.264820 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264574    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy"
Jul 22 16:01:19.264820 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264587    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="70cf3592-16e2-4b36-bed2-180323fc9838" containerName="main"
Jul 22 16:01:19.264820 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264599    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy"
Jul 22 16:01:19.264820 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264610    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy"
Jul 22 16:01:19.264820 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264693    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy"
Jul 22 16:01:19.264820 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264703    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2b748a-b59f-46db-b602-3ae6ebd1e82e" containerName="istio-proxy"
Jul 22 16:01:19.264820 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.264801    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="15d3f926-ace3-46cc-938e-f7ae3c361d3d" containerName="istio-proxy"
Jul 22 16:01:19.269343 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.269321    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zkc2l/must-gather-xh6gb"
Jul 22 16:01:19.271998 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.271976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a72eb3b-f27c-41e5-99a8-05149dfe0798-must-gather-output\") pod \"must-gather-xh6gb\" (UID: \"4a72eb3b-f27c-41e5-99a8-05149dfe0798\") " pod="openshift-must-gather-zkc2l/must-gather-xh6gb"
Jul 22 16:01:19.272107 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.272012    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zkc2l\"/\"default-dockercfg-c4rpr\""
Jul 22 16:01:19.272107 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.272014    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p8hz\" (UniqueName: \"kubernetes.io/projected/4a72eb3b-f27c-41e5-99a8-05149dfe0798-kube-api-access-6p8hz\") pod \"must-gather-xh6gb\" (UID: \"4a72eb3b-f27c-41e5-99a8-05149dfe0798\") " pod="openshift-must-gather-zkc2l/must-gather-xh6gb"
Jul 22 16:01:19.272234 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.272214    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zkc2l\"/\"openshift-service-ca.crt\""
Jul 22 16:01:19.273136 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.273120    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zkc2l\"/\"kube-root-ca.crt\""
Jul 22 16:01:19.278692 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.278665    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zkc2l/must-gather-xh6gb"]
Jul 22 16:01:19.372736 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.372695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a72eb3b-f27c-41e5-99a8-05149dfe0798-must-gather-output\") pod \"must-gather-xh6gb\" (UID: \"4a72eb3b-f27c-41e5-99a8-05149dfe0798\") " pod="openshift-must-gather-zkc2l/must-gather-xh6gb"
Jul 22 16:01:19.372988 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.372749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p8hz\" (UniqueName: \"kubernetes.io/projected/4a72eb3b-f27c-41e5-99a8-05149dfe0798-kube-api-access-6p8hz\") pod \"must-gather-xh6gb\" (UID: \"4a72eb3b-f27c-41e5-99a8-05149dfe0798\") " pod="openshift-must-gather-zkc2l/must-gather-xh6gb"
Jul 22 16:01:19.373123 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.373101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a72eb3b-f27c-41e5-99a8-05149dfe0798-must-gather-output\") pod \"must-gather-xh6gb\" (UID: \"4a72eb3b-f27c-41e5-99a8-05149dfe0798\") " pod="openshift-must-gather-zkc2l/must-gather-xh6gb"
Jul 22 16:01:19.382220 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.382197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p8hz\" (UniqueName: \"kubernetes.io/projected/4a72eb3b-f27c-41e5-99a8-05149dfe0798-kube-api-access-6p8hz\") pod \"must-gather-xh6gb\" (UID: \"4a72eb3b-f27c-41e5-99a8-05149dfe0798\") " pod="openshift-must-gather-zkc2l/must-gather-xh6gb"
Jul 22 16:01:19.579814 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.579728    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zkc2l/must-gather-xh6gb"
Jul 22 16:01:19.727486 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.727457    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zkc2l/must-gather-xh6gb"]
Jul 22 16:01:19.739140 ip-10-0-133-167 kubenswrapper[2580]: W0722 16:01:19.739114    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a72eb3b_f27c_41e5_99a8_05149dfe0798.slice/crio-5e5efacd4da222a775bff609b404da4777879a434c400a31652e237baedbcf0c WatchSource:0}: Error finding container 5e5efacd4da222a775bff609b404da4777879a434c400a31652e237baedbcf0c: Status 404 returned error can't find the container with id 5e5efacd4da222a775bff609b404da4777879a434c400a31652e237baedbcf0c
Jul 22 16:01:19.740880 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:19.740865    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 16:01:20.732873 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:20.732840    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zkc2l/must-gather-xh6gb" event={"ID":"4a72eb3b-f27c-41e5-99a8-05149dfe0798","Type":"ContainerStarted","Data":"5e5efacd4da222a775bff609b404da4777879a434c400a31652e237baedbcf0c"}
Jul 22 16:01:21.740526 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:21.740482    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zkc2l/must-gather-xh6gb" event={"ID":"4a72eb3b-f27c-41e5-99a8-05149dfe0798","Type":"ContainerStarted","Data":"c1ee0ecaab5e8c1c2f0ffe4b60437862e434b8dfe4a3a27d15b105386702355a"}
Jul 22 16:01:21.741054 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:21.740544    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zkc2l/must-gather-xh6gb" event={"ID":"4a72eb3b-f27c-41e5-99a8-05149dfe0798","Type":"ContainerStarted","Data":"3500d8c4bc7b0c69c1a0b80b6cb1140df3a8255794c5f1c8985f752bba279e46"}
Jul 22 16:01:21.762169 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:21.762097    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zkc2l/must-gather-xh6gb" podStartSLOduration=1.736873925 podStartE2EDuration="2.762074964s" totalImagesPullingTime="1.025201039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 16:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:01:21.757975671 +0000 UTC m=+2905.421125093" watchObservedRunningTime="2026-07-22 16:01:21.762074964 +0000 UTC m=+2905.425224387"
Jul 22 16:01:22.376027 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:22.375992    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jcnvm_a41a8d0a-1214-44b7-9032-97d7eb4905c9/global-pull-secret-syncer/0.log"
Jul 22 16:01:22.558743 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:22.558700    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rmxwh_bfac16a9-fa38-4567-b6bd-b897037d8562/konnectivity-agent/0.log"
Jul 22 16:01:22.582697 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:22.582664    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-167.ec2.internal_b304257d6d5f2082aa669ba1dc8a104b/haproxy/0.log"
Jul 22 16:01:28.129882 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:28.129841    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f84cfd697-fnjhr_5114a7b2-2ea7-4a2e-892f-f949ff046a92/authorino/0.log"
Jul 22 16:01:28.168572 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:28.168533    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mc898_3adb4a3e-7f25-48a6-a4c7-340d46a17bd1/manager/0.log"
Jul 22 16:01:28.208249 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:28.208222    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-c8p6h_0b61a989-397a-468c-a84e-d03d280e635a/manager/0.log"
Jul 22 16:01:28.313487 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:28.311138    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pd8rt_f84ac639-9452-455d-9d4a-803fefd54c8b/registry-server/0.log"
Jul 22 16:01:28.576211 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:28.576060    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hrkgs_e24e7359-ec6f-459a-b482-8c730d0f92c4/manager/0.log"
Jul 22 16:01:30.771545 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:30.771510    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mkx2m_a92ffbae-de73-4519-be6e-39fe01d0b88e/node-exporter/0.log"
Jul 22 16:01:30.813131 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:30.813081    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mkx2m_a92ffbae-de73-4519-be6e-39fe01d0b88e/kube-rbac-proxy/0.log"
Jul 22 16:01:30.837055 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:30.837023    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mkx2m_a92ffbae-de73-4519-be6e-39fe01d0b88e/init-textfile/0.log"
Jul 22 16:01:32.765502 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.765453    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"]
Jul 22 16:01:32.772183 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.772157    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.777754 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.777718    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"]
Jul 22 16:01:32.835887 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.835849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-lib-modules\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.836184 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.836151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-proc\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.836312 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.836213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-sys\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.836312 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.836244    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-podres\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.836428 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.836392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lch9k\" (UniqueName: \"kubernetes.io/projected/5d80f028-e2e6-4cd6-927d-047256e0757f-kube-api-access-lch9k\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.937495 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.937456    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lch9k\" (UniqueName: \"kubernetes.io/projected/5d80f028-e2e6-4cd6-927d-047256e0757f-kube-api-access-lch9k\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.937792 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.937773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-lib-modules\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.937951 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.937935    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-proc\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.938137 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.938123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-sys\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.938258 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.938222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-proc\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.938452 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.938183    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-sys\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.938581 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.938243    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-podres\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.938750 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.938372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-podres\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.938856 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.938124    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d80f028-e2e6-4cd6-927d-047256e0757f-lib-modules\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:32.948605 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:32.948577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lch9k\" (UniqueName: \"kubernetes.io/projected/5d80f028-e2e6-4cd6-927d-047256e0757f-kube-api-access-lch9k\") pod \"perf-node-gather-daemonset-pkkmz\" (UID: \"5d80f028-e2e6-4cd6-927d-047256e0757f\") " pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:33.089989 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:33.089882    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:33.283733 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:33.283656    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"]
Jul 22 16:01:33.338610 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:33.338583    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-sd5px_11089543-48bb-49e3-aa7d-868e981fcf95/console-operator/0.log"
Jul 22 16:01:33.833117 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:33.833063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz" event={"ID":"5d80f028-e2e6-4cd6-927d-047256e0757f","Type":"ContainerStarted","Data":"e5dc9d5e5d61d1b5922796cfef25ee1117fed8a20b5956a6390a8cf156981720"}
Jul 22 16:01:33.833679 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:33.833141    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:33.833679 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:33.833159    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz" event={"ID":"5d80f028-e2e6-4cd6-927d-047256e0757f","Type":"ContainerStarted","Data":"5d071ea1003e76d668d3123fa02a5c8d7d0c53c58252778350bdf49574b37020"}
Jul 22 16:01:33.848996 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:33.848902    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz" podStartSLOduration=1.848882304 podStartE2EDuration="1.848882304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 16:01:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 16:01:33.848295444 +0000 UTC m=+2917.511444865" watchObservedRunningTime="2026-07-22 16:01:33.848882304 +0000 UTC m=+2917.512031726"
Jul 22 16:01:34.470150 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:34.470127    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-qhfnq_12be4ae9-0c50-4133-90eb-fab987f6e69f/volume-data-source-validator/0.log"
Jul 22 16:01:35.530145 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:35.530113    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g8268_2392c191-3855-4341-ae6f-419a932d2858/dns/0.log"
Jul 22 16:01:35.554218 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:35.554183    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g8268_2392c191-3855-4341-ae6f-419a932d2858/kube-rbac-proxy/0.log"
Jul 22 16:01:35.676201 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:35.676177    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6qnvg_550273c2-01c3-49ae-b33e-5d045e936d4a/dns-node-resolver/0.log"
Jul 22 16:01:36.256435 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:36.256394    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bbd7754f9-8vjn4_ab538f0a-bd4a-4bf3-925d-d4cad90d82d2/registry/0.log"
Jul 22 16:01:36.339752 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:36.339724    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zjwvp_245ec562-e06c-408f-a8bf-b129ec5e006a/node-ca/0.log"
Jul 22 16:01:37.280157 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:37.280121    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hdd5b_9359a32a-6055-4731-a19e-3736631fbf12/istio-proxy/0.log"
Jul 22 16:01:37.543908 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:37.543830    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6764d75874-v9qdg_1ba07b96-f346-4210-8073-004ca3232972/kube-auth-proxy/0.log"
Jul 22 16:01:37.601301 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:37.601273    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9nlnb_3327f692-983e-4835-9815-3a85f2634d75/istio-proxy/0.log"
Jul 22 16:01:37.664562 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:37.664523    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9nlnb_3327f692-983e-4835-9815-3a85f2634d75/istio-proxy/1.log"
Jul 22 16:01:37.750334 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:37.750304    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-mtsmn_b88d58ec-be4e-4aa0-83d4-e540224819bc/payload-processing/0.log"
Jul 22 16:01:38.504592 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:38.504561    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s62lx_791de7a1-68b3-407a-a121-e9bdabd68202/serve-healthcheck-canary/0.log"
Jul 22 16:01:39.087008 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:39.086967    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4xqx6_61d7923b-f01b-4510-b267-fd437a01c6e2/kube-rbac-proxy/0.log"
Jul 22 16:01:39.120611 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:39.120585    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4xqx6_61d7923b-f01b-4510-b267-fd437a01c6e2/exporter/0.log"
Jul 22 16:01:39.149966 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:39.149910    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4xqx6_61d7923b-f01b-4510-b267-fd437a01c6e2/extractor/0.log"
Jul 22 16:01:39.850750 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:39.850725    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zkc2l/perf-node-gather-daemonset-pkkmz"
Jul 22 16:01:41.474713 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:41.474683    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-thkz4_39e31b5a-79d5-46ea-b8a5-15b5f5bb55ee/manager/0.log"
Jul 22 16:01:41.828056 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:41.828020    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dbsjk_0c8f3a91-005b-486c-9ff3-4bd72c02cd82/manager/0.log"
Jul 22 16:01:42.049035 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:42.049005    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tz68s_779a049c-0fcf-4a91-a1ed-fa00de2ee539/server/0.log"
Jul 22 16:01:42.189262 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:42.186971    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fbmrr_73ac20fd-0264-4798-8ad7-e295dc8378be/manager/0.log"
Jul 22 16:01:42.277463 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:42.277425    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6f74d59b-rctlm_ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1/manager/0.log"
Jul 22 16:01:42.299765 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:42.299739    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6f74d59b-rctlm_ca7aa454-1ecd-4f39-b3b7-12c9780bdfa1/copy-manifests/0.log"
Jul 22 16:01:42.855330 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:42.855296    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hdd5b_9359a32a-6055-4731-a19e-3736631fbf12/istio-proxy/0.log"
Jul 22 16:01:43.177099 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:43.177062    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6764d75874-v9qdg_1ba07b96-f346-4210-8073-004ca3232972/kube-auth-proxy/0.log"
Jul 22 16:01:43.252804 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:43.252773    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9nlnb_3327f692-983e-4835-9815-3a85f2634d75/istio-proxy/0.log"
Jul 22 16:01:43.315047 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:43.315010    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9nlnb_3327f692-983e-4835-9815-3a85f2634d75/istio-proxy/1.log"
Jul 22 16:01:43.381408 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:43.381380    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-mtsmn_b88d58ec-be4e-4aa0-83d4-e540224819bc/payload-processing/0.log"
Jul 22 16:01:44.585546 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:44.585511    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hdd5b_9359a32a-6055-4731-a19e-3736631fbf12/istio-proxy/0.log"
Jul 22 16:01:44.816546 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:44.816511    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6764d75874-v9qdg_1ba07b96-f346-4210-8073-004ca3232972/kube-auth-proxy/0.log"
Jul 22 16:01:44.858272 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:44.858241    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9nlnb_3327f692-983e-4835-9815-3a85f2634d75/istio-proxy/0.log"
Jul 22 16:01:44.920240 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:44.920207    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-9nlnb_3327f692-983e-4835-9815-3a85f2634d75/istio-proxy/1.log"
Jul 22 16:01:44.981469 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:44.981439    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-mtsmn_b88d58ec-be4e-4aa0-83d4-e540224819bc/payload-processing/0.log"
Jul 22 16:01:48.743232 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:48.743201    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-94vb9_1fabc61c-9239-4881-ac75-87cba270c5ab/migrator/0.log"
Jul 22 16:01:48.764741 ip-10-0-133-167 kubenswrapper[2580]: I0722 16:01:48.764709    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-94vb9_1fabc61c-9239-4881-ac75-87cba270c5ab/graceful-termination/0.log"