Jul 21 20:39:33.849456 ip-10-0-134-121 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.288930    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295533    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295548    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295553    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295556    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295559    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295562    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295565    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:39:34.436366 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295568    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:39:34.382813 ip-10-0-134-121 systemd[1]: Started Kubernetes Kubelet.
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295571    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295574    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295577    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295579    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295582    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295584    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295587    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295590    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295593    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295595    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295597    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295600    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295603    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295605    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295608    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295610    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295614    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295618    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295621    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:39:34.587911 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295623    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295626    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295628    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295631    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295634    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295636    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295639    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295642    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295645    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295647    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295650    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295653    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295655    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295659    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295661    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295664    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295667    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295669    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295672    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295675    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:39:34.601771 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295678    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295680    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295683    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295686    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295688    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295691    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295694    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295696    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295699    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295701    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295704    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295706    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295709    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295711    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295714    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295717    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295719    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295724    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295727    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:39:34.603923 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295730    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295733    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295736    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295739    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295742    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295745    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295748    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295751    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295754    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295757    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295760    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295762    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295766    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295770    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295773    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295776    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295778    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295782    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295785    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:39:34.606484 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295787    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295790    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295793    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295795    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295798    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295800    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295803    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295805    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295808    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295810    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295812    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295818    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295821    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.295823    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296558    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296566    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296569    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296574    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296578    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:39:34.608879 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296581    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296584    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296587    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296590    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296593    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296595    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296598    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296600    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296603    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296605    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296608    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296610    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296614    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296617    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296619    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296622    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296624    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296627    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296631    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:39:34.611230 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296634    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296637    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296640    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296643    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296646    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296650    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296653    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296655    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296658    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296660    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296663    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296667    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296669    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296672    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296675    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296677    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296680    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296682    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296685    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296688    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:39:34.615294 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296690    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296694    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296696    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296699    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296701    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296703    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296707    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296709    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296712    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296714    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296717    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296719    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296722    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296724    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296727    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296729    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296732    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296735    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296738    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296740    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:39:34.617819 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296743    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296746    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296749    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296751    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296754    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296756    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296759    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296761    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296764    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296766    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296769    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296772    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296774    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296779    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296782    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296785    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296788    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296790    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296792    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296795    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:39:34.619876 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296798    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296800    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296803    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296805    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296807    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296810    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296813    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296815    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296818    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296823    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296825    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296828    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296831    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296833    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.296836    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297237    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297243    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297247    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297250    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:39:34.620881 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297253    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297256    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297259    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297262    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297266    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297270    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297275    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297278    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297280    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297283    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297286    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297289    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297292    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297294    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297298    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297301    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297303    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297306    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297308    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297311    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:39:34.621754 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297313    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297315    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297319    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297322    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297324    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297327    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297329    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297332    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297334    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297337    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297339    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297342    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297345    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297347    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297350    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297352    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297355    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297359    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297363    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297367    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:39:34.622778 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297370    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297372    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297375    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297378    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297381    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297384    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297386    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297389    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297392    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297394    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297398    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297400    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297402    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297405    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297410    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297412    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297415    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297419    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297422    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:39:34.623568 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297425    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297428    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297430    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297433    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297436    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297439    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297441    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297444    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297446    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297449    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297452    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297456    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297458    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297461    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297463    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297466    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297468    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297471    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297473    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:39:34.624172 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297476    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297480    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297482    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297485    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297487    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297490    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297492    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297495    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297498    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297501    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297504    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297507    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297509    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297512    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297514    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297517    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.297519    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297583    2560 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297590    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297596    2560 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297600    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 20:39:34.624781 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297604    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297607    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297611    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297619    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297622    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297625    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297628    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297631    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297634    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297637    2560 flags.go:64] FLAG: --cgroup-root=""
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297640    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297643    2560 flags.go:64] FLAG: --client-ca-file=""
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297646    2560 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297649    2560 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297652    2560 flags.go:64] FLAG: --cluster-domain=""
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297655    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297658    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297661    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297665    2560 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297669    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297672    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297675    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297678    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297681    2560 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 20:39:34.625380 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297685    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297688    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297691    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297694    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297698    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297701    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297704    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297706    2560 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297709    2560 flags.go:64] FLAG: --enable-server="true"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297712    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297716    2560 flags.go:64] FLAG: --event-burst="100"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297720    2560 flags.go:64] FLAG: --event-qps="50"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297723    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297726    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297729    2560 flags.go:64] FLAG: --eviction-hard=""
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297733    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297736    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297739    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297742    2560 flags.go:64] FLAG: --eviction-soft=""
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297745    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297747    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297751    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297754    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297756    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297759    2560 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 20:39:34.625990 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297762    2560 flags.go:64] FLAG: --feature-gates=""
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297766    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297770    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297773    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297776    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297779    2560 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297782    2560 flags.go:64] FLAG: --help="false"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297785    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297788    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297791    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297794    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297797    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297801    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297803    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297806    2560 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297809    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297812    2560 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297815    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297819    2560 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297822    2560 flags.go:64] FLAG: --kube-reserved=""
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297825    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297827    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297831    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297833    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 20:39:34.626733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297836    2560 flags.go:64] FLAG: --lock-file=""
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297839    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297842    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297845    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297850    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297853    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297856    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297858    2560 flags.go:64] FLAG: --logging-format="text"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297861    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297864    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297868    2560 flags.go:64] FLAG: --manifest-url=""
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297871    2560 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297875    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297878    2560 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297882    2560 flags.go:64] FLAG: --max-pods="110"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297885    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297888    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297890    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297893    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297896    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297899    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297902    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297908    2560 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297919    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297922    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 20:39:34.627674 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297925    2560 flags.go:64] FLAG: --pod-cidr=""
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297929    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297935    2560 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297937    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297941    2560 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297944    2560 flags.go:64] FLAG: --port="10250"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297947    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297949    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-043cb5b924fd40c93"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297952    2560 flags.go:64] FLAG: --qos-reserved=""
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297955    2560 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297958    2560 flags.go:64] FLAG: --register-node="true"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297961    2560 flags.go:64] FLAG: --register-with-taints=""
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297965    2560 flags.go:64] FLAG: --registry-burst="10"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297968    2560 flags.go:64] FLAG: --registry-qps="5"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297971    2560 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297974    2560 flags.go:64] FLAG: --reserved-memory=""
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297977    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297981    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297985    2560 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297987    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297990    2560 flags.go:64] FLAG: --runonce="false"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297993    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297996    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.297999    2560 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298002    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 20:39:34.628658 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298004    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298007    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298010    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298013    2560 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298016    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298019    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298021    2560 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298024    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298029    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298031    2560 flags.go:64] FLAG: --system-cgroups=""
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298034    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298040    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298042    2560 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298045    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298048    2560 flags.go:64] FLAG: --tls-min-version=""
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298051    2560 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298053    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298056    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298059    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298062    2560 flags.go:64] FLAG: --v="2"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298066    2560 flags.go:64] FLAG: --version="false"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298070    2560 flags.go:64] FLAG: --vmodule=""
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298074    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.298077    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298205    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:39:34.694842 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298210    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298213    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298216    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298219    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298222    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298224    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298229    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298232    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298235    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298238    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298241    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298243    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298246    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298249    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298251    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298255    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298258    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298260    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298263    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298266    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:39:34.695640 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298268    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298271    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298273    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298276    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298278    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298281    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298284    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298286    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298289    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298293    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298296    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298298    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298302    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298304    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298307    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298309    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298314    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298317    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298320    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:39:34.696164 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298323    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298326    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298329    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298332    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298334    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298337    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298340    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298343    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298348    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298351    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298355    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298359    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298362    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298366    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298368    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298371    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298374    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298377    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298380    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298383    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:39:34.696732 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298386    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298388    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298391    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298394    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298397    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298400    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298403    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298406    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298409    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298411    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298414    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298416    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298419    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298421    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298424    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298427    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298429    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298432    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298435    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298438    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:39:34.697275 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298442    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298445    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298448    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298450    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298453    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298455    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298458    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298460    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298463    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298465    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298468    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298470    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298473    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298475    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298478    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298481    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298484    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298487    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:39:34.697833 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.298490    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.299062    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.305941    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.305956    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.305978    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.305984    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306043    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306047    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306051    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306054    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306057    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306059    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306062    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306064    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306067    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:39:34.698330 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306070    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306072    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306075    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306078    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306080    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306083    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306085    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306088    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306091    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306095    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306097    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306100    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306102    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306105    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306108    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306111    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306113    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306116    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306119    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:39:34.698810 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306122    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306125    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306127    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306131    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306133    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306136    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306141    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306144    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306146    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306149    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306151    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306154    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306156    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306159    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306161    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306166    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306170    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306173    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306176    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306178    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:39:34.699348 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306181    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306220    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306227    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306230    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306233    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306237    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306242    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306246    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306249    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306252    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306254    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306257    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306260    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306262    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306268    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306271    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306274    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306277    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306283    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:39:34.699892 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306288    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306292    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306295    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306299    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306303    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306306    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306309    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306313    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306315    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306318    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306322    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306325    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306327    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306330    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306332    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306335    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306338    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306340    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306343    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:39:34.700424 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306346    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306348    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306351    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306354    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306356    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306359    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306362    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306364    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306367    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306370    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306373    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306375    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306379    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.306385    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306524    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306529    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 20:39:34.700955 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306533    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306536    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306540    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306543    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306546    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306548    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306551    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306554    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306556    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306559    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306562    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306564    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306567    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306569    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306572    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306574    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306577    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306579    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306582    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 20:39:34.701396 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306584    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306587    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306589    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306592    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306595    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306598    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306600    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306603    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306606    2560 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306609    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306612    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306614    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306617    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306620    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306622    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306626    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306629    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306631    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306634    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306636    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 20:39:34.701924 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306639    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306642    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306644    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306647    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306649    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306652    2560 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306655    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306657    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306660    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306662    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306665    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306667    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306671    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306675    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306677    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306680    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306683    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306685    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306689    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306693    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 20:39:34.702463 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306696    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306700    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306703    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306705    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306708    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306711    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306713    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306717    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306720    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306722    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306725    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306728    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306730    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306733    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306735    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306738    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306741    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306743    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306746    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306748    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 20:39:34.703008 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306751    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306755    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306759    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306762    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306764    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306767    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306770    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306773    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306775    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306777    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306780    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306783    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306785    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306790    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306792    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306795    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306797    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 20:39:34.703538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:34.306800    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.306805    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.306902    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.309933    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.311549    2560 server.go:1019] "Starting client certificate rotation"
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.311662    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.311697    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.314618    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.316717    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.334105    2560 log.go:25] "Validated CRI v1 runtime API"
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.336245    2560 log.go:25] "Validated CRI v1 image API"
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.338026    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 20:39:34.704013 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.341437    2560 fs.go:135] Filesystem UUIDs: map[3ac9efd0-5642-4eec-b10a-1a1fd0724997:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8861d50a-0bd6-4823-a034-99d21928b614:/dev/nvme0n1p3]
Jul 21 20:39:34.704419 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.341455    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 20:39:34.704520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.345850    2560 manager.go:216] Machine: {Timestamp:2026-07-21 20:39:34.345364262 +0000 UTC m=+0.365772719 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101121 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21a569083a23071e0f7925ae20917b SystemUUID:ec21a569-083a-2307-1e0f-7925ae20917b BootID:78e0c086-5a55-4d06-9c0c-1824b4116b54 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:21:a5:a2:90:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:21:a5:a2:90:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:48:03:61:1a:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 20:39:34.704520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.345947    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 20:39:34.704520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.346013    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 20:39:34.704520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.347883    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 20:39:34.704520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.347904    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 20:39:34.704520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.348709    2560 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 20:39:34.704520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.348721    2560 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 20:39:34.704520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.348729    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.349431    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.350660    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.354386    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.354486    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.355170    2560 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.355200    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.355215    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.355224    2560 kubelet.go:398] "Adding apiserver pod source"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.355232    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.355619    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.355635    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.357787    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.357903    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.359739    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.359769    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361130    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361143    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361148    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361154    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361163    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361168    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361176    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361197    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361207    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361214    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361222    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.361228    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.362156    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.362166    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.381929    2560 server.go:1268] "Started kubelet"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.382024    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.382433    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.382943    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.385865    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.387070    2560 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.388399    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.391781    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.391755    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 20:39:34.705065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.391839    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.392610    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.392627    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.392706    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.391742    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-121.ec2.internal.18c4689ca79bbd32  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-121.ec2.internal,UID:ip-10-0-134-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-121.ec2.internal,},FirstTimestamp:2026-07-21 20:39:34.381747506 +0000 UTC m=+0.402155960,LastTimestamp:2026-07-21 20:39:34.381747506 +0000 UTC m=+0.402155960,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-121.ec2.internal,}"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.393171    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.393172    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.393215    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.393272    2560 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.393282    2560 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.394042    2560 factory.go:55] Registering systemd factory
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.394054    2560 factory.go:223] Registration of the systemd container factory successfully
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.394529    2560 factory.go:153] Registering CRI-O factory
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.394544    2560 factory.go:223] Registration of the crio container factory successfully
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.394593    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.394619    2560 factory.go:103] Registering Raw factory
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.394647    2560 manager.go:1196] Started watching for new ooms in manager
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.395054    2560 manager.go:349] Starting recovery of all containers
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.404228    2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.404366    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.409654    2560 manager.go:354] Recovery completed
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.414044    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.415906    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.415945    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.415960    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.416659    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.416671    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.416678    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.416688    2560 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.417391    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.417414    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.417425    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.418926    2560 policy_none.go:49] "None policy: Start"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.418944    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 20:39:34.706102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.418954    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.421091    2560 policy_none.go:47] "Start"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.422703    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vn5k4"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.428710    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-121.ec2.internal.18c4689ca9a554ba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-121.ec2.internal,UID:ip-10-0-134-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-121.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-121.ec2.internal,},FirstTimestamp:2026-07-21 20:39:34.415930554 +0000 UTC m=+0.436339008,LastTimestamp:2026-07-21 20:39:34.415930554 +0000 UTC m=+0.436339008,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-121.ec2.internal,}"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.430928    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vn5k4"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.467707    2560 manager.go:337] "Starting Device Plugin manager"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.467733    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.467743    2560 server.go:87] "Starting device plugin registration server"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.467973    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.467984    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.468078    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.468142    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.468149    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.468700    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.468742    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.489887    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.491035    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.491066    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.491084    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.491113    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.495342    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.568497    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.569332    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.569359    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.569369    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.569395    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.578921    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.578939    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-121.ec2.internal\": node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.591215    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"]
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.591408    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.592635    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:39:34.889855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.592658    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.592667    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.595249    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.595338    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.595373    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.595864    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.595886    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.595897    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.595946    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.595963    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.595975    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.598162    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.598205    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.598807    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.598828    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.598838    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.626282    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-121.ec2.internal\" not found" node="ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.630143    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-121.ec2.internal\" not found" node="ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.645018    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.694646    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e39b9f23455a45c102012bdb6cd46aeb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-121.ec2.internal\" (UID: \"e39b9f23455a45c102012bdb6cd46aeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.694672    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.694690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.746100    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.795400    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e39b9f23455a45c102012bdb6cd46aeb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-121.ec2.internal\" (UID: \"e39b9f23455a45c102012bdb6cd46aeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.890759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.795422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.891425 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.795439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.891425 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.795485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.891425 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.795496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e39b9f23455a45c102012bdb6cd46aeb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-121.ec2.internal\" (UID: \"e39b9f23455a45c102012bdb6cd46aeb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.891425 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.795511    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6cfba4c61799a6b7e50aa7b14dc6a91c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"6cfba4c61799a6b7e50aa7b14dc6a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:34.891425 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.847029    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 21 20:39:35.065520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.929080    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:35.065520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:34.932609    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:35.065520 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:34.947210    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 21 20:39:35.065520 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.047653    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 21 20:39:35.186164 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.148125    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 21 20:39:35.341519 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.248556    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 21 20:39:35.341519 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.284531    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:39:35.341519 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.293684    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:35.341519 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.305131    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 20:39:35.341519 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.307096    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:35.341519 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.310324    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 20:39:35.341519 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.310425    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 20:39:35.341519 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.310432    2560 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a24fe5465df3b44ea9a9562082a6cd25-e53e7cc8b0077d60.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.134.121:33722->23.23.9.74:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:35.341519 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.310434    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.355618    2560 apiserver.go:52] "Watching apiserver"
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.371447    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.373903    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qs2qx","kube-system/konnectivity-agent-wxbfz","openshift-dns/node-resolver-zhm2n","openshift-image-registry/node-ca-4mcr8","openshift-multus/multus-additional-cni-plugins-lvsbr","openshift-multus/multus-pnwmz","openshift-network-diagnostics/network-check-target-zb77t","openshift-network-operator/iptables-alerter-x5tbf","kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g","openshift-cluster-node-tuning-operator/tuned-b7lqd","openshift-multus/network-metrics-daemon-c6mdf","openshift-ovn-kubernetes/ovnkube-node-cqbp6"]
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.376511    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.378949    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.379721    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.380209    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dj6h5\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.380219    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.380732    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.380823    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhm2n"
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.381922    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.382471    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w5b2x\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.382973    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.383065    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.383392    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.383926    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.385112    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.385162    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.387239    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x5tbf"
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.389357    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.391522    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t9gtd\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.391546    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.391552    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.391578    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-87c2m\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.391589    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.391596    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.391550    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 20:39:35.479053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.391551    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.391821    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.391876    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.392065    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.392161    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tqf9d\""
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.392180    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.392709    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.393826    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.394726    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.396986    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mtcdl\""
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.396986    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.397308    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4mcr8"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398007    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3c67df9-3601-49db-98a3-e031f1ae8fa8-tmp\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff7dd\" (UniqueName: \"kubernetes.io/projected/b3c67df9-3601-49db-98a3-e031f1ae8fa8-kube-api-access-ff7dd\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398147    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-run-ovn\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-cnibin\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398244    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vprsg\" (UniqueName: \"kubernetes.io/projected/8bc46535-1233-48ac-a6be-ebb82083e332-kube-api-access-vprsg\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f861605-37aa-4d3a-9fde-c29df825f649-host-slash\") pod \"iptables-alerter-x5tbf\" (UID: \"9f861605-37aa-4d3a-9fde-c29df825f649\") " pod="openshift-network-operator/iptables-alerter-x5tbf"
Jul 21 20:39:35.480679 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398297    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-system-cni-dir\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398316    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bc46535-1233-48ac-a6be-ebb82083e332-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398331    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jndxc\" (UniqueName: \"kubernetes.io/projected/9f861605-37aa-4d3a-9fde-c29df825f649-kube-api-access-jndxc\") pod \"iptables-alerter-x5tbf\" (UID: \"9f861605-37aa-4d3a-9fde-c29df825f649\") " pod="openshift-network-operator/iptables-alerter-x5tbf"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398347    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-host\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398373    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-modprobe-d\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398390    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-kubelet\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398403    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-run-openvswitch\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398417    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqvn4\" (UniqueName: \"kubernetes.io/projected/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-kube-api-access-hqvn4\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8bc46535-1233-48ac-a6be-ebb82083e332-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398458    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-var-lib-openvswitch\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-sysconfig\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-var-lib-kubelet\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398634    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 20:39:35.482229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.398975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8bc46535-1233-48ac-a6be-ebb82083e332-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-socket-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399044    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zcb4g\""
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-registration-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-device-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399093    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f861605-37aa-4d3a-9fde-c29df825f649-iptables-alerter-script\") pod \"iptables-alerter-x5tbf\" (UID: \"9f861605-37aa-4d3a-9fde-c29df825f649\") " pod="openshift-network-operator/iptables-alerter-x5tbf"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-systemd\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399134    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-node-log\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-cni-netd\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bclgt\" (UniqueName: \"kubernetes.io/projected/23a0b2eb-4908-4197-acb7-11dfe462f642-kube-api-access-bclgt\") pod \"node-resolver-zhm2n\" (UID: \"23a0b2eb-4908-4197-acb7-11dfe462f642\") " pod="openshift-dns/node-resolver-zhm2n"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-cni-bin\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399346    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23a0b2eb-4908-4197-acb7-11dfe462f642-hosts-file\") pod \"node-resolver-zhm2n\" (UID: \"23a0b2eb-4908-4197-acb7-11dfe462f642\") " pod="openshift-dns/node-resolver-zhm2n"
Jul 21 20:39:35.483237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399389    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-tuned\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-run-netns\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-run-systemd\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-run\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-slash\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399507    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-log-socket\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399553    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-ovnkube-config\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399581    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4f5m\" (UniqueName: \"kubernetes.io/projected/3a71eaf1-563f-452a-bc6b-a24e930f16ee-kube-api-access-c4f5m\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a0b2eb-4908-4197-acb7-11dfe462f642-tmp-dir\") pod \"node-resolver-zhm2n\" (UID: \"23a0b2eb-4908-4197-acb7-11dfe462f642\") " pod="openshift-dns/node-resolver-zhm2n"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399631    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399632    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-sys\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399740    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-env-overrides\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399763    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-ovn-node-metrics-cert\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399781    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/51d7a014-3816-4594-bfaf-075941847018-konnectivity-ca\") pod \"konnectivity-agent-wxbfz\" (UID: \"51d7a014-3816-4594-bfaf-075941847018\") " pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:35.484089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399805    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-lib-modules\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399829    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-sys-fs\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399849    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-kubernetes\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-etc-openvswitch\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-ovnkube-script-lib\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399936    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdwwd\" (UniqueName: \"kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd\") pod \"network-check-target-zb77t\" (UID: \"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c\") " pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.399984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/51d7a014-3816-4594-bfaf-075941847018-agent-certs\") pod \"konnectivity-agent-wxbfz\" (UID: \"51d7a014-3816-4594-bfaf-075941847018\") " pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.400017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-sysctl-d\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.400040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfxql\" (UniqueName: \"kubernetes.io/projected/0b527024-4b36-41f9-844e-c932757f0b46-kube-api-access-rfxql\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.400102    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-sysctl-conf\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.400125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-systemd-units\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.400167    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-os-release\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.484936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.400388    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.400409    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.400390    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.405915    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.405983    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.406012    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.406059    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.406057    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.406358    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.406449    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6fqct\""
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.406657    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.406825    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q8lpq\""
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.412947    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.436900    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 20:34:34 +0000 UTC" deadline="2028-03-28 17:11:33.2456705 +0000 UTC"
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.436936    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14780h31m57.808737015s"
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.441242    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tdtbf"
Jul 21 20:39:35.485556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.451270    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tdtbf"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.493546    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500376    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-run\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-slash\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500408    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-log-socket\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-slash\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-log-socket\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-ovnkube-config\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-run\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500506    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4f5m\" (UniqueName: \"kubernetes.io/projected/3a71eaf1-563f-452a-bc6b-a24e930f16ee-kube-api-access-c4f5m\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500534    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a0b2eb-4908-4197-acb7-11dfe462f642-tmp-dir\") pod \"node-resolver-zhm2n\" (UID: \"23a0b2eb-4908-4197-acb7-11dfe462f642\") " pod="openshift-dns/node-resolver-zhm2n"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500553    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad08e483-50bc-440d-8a37-7b47614c25aa-serviceca\") pod \"node-ca-4mcr8\" (UID: \"ad08e483-50bc-440d-8a37-7b47614c25aa\") " pod="openshift-image-registry/node-ca-4mcr8"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500568    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-etc-kubernetes\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500585    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-sys\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.574148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-env-overrides\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-ovn-node-metrics-cert\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500631    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-run-netns\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500647    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/734e584c-d5a4-47a4-b073-00fe97a35f37-dbus\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500688    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/51d7a014-3816-4594-bfaf-075941847018-konnectivity-ca\") pod \"konnectivity-agent-wxbfz\" (UID: \"51d7a014-3816-4594-bfaf-075941847018\") " pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500714    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-sys\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-lib-modules\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500828    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-sys-fs\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500845    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500859    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-kubernetes\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500889    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-etc-openvswitch\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-ovnkube-script-lib\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500909    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-sys-fs\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.574944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500920    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-cnibin\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500936    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-run-k8s-cni-cncf-io\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500954    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwwd\" (UniqueName: \"kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd\") pod \"network-check-target-zb77t\" (UID: \"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c\") " pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/51d7a014-3816-4594-bfaf-075941847018-agent-certs\") pod \"konnectivity-agent-wxbfz\" (UID: \"51d7a014-3816-4594-bfaf-075941847018\") " pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500969    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a0b2eb-4908-4197-acb7-11dfe462f642-tmp-dir\") pod \"node-resolver-zhm2n\" (UID: \"23a0b2eb-4908-4197-acb7-11dfe462f642\") " pod="openshift-dns/node-resolver-zhm2n"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-sysctl-d\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfxql\" (UniqueName: \"kubernetes.io/projected/0b527024-4b36-41f9-844e-c932757f0b46-kube-api-access-rfxql\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.500990    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-var-lib-cni-multus\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501095    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-sysctl-conf\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501124    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-systemd-units\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501154    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-os-release\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501243    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3c67df9-3601-49db-98a3-e031f1ae8fa8-tmp\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff7dd\" (UniqueName: \"kubernetes.io/projected/b3c67df9-3601-49db-98a3-e031f1ae8fa8-kube-api-access-ff7dd\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501289    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/51d7a014-3816-4594-bfaf-075941847018-konnectivity-ca\") pod \"konnectivity-agent-wxbfz\" (UID: \"51d7a014-3816-4594-bfaf-075941847018\") " pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:35.575772 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-run-ovn\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501346    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad08e483-50bc-440d-8a37-7b47614c25aa-host\") pod \"node-ca-4mcr8\" (UID: \"ad08e483-50bc-440d-8a37-7b47614c25aa\") " pod="openshift-image-registry/node-ca-4mcr8"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501368    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-hostroot\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501392    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-cnibin\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vprsg\" (UniqueName: \"kubernetes.io/projected/8bc46535-1233-48ac-a6be-ebb82083e332-kube-api-access-vprsg\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501441    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f861605-37aa-4d3a-9fde-c29df825f649-host-slash\") pod \"iptables-alerter-x5tbf\" (UID: \"9f861605-37aa-4d3a-9fde-c29df825f649\") " pod="openshift-network-operator/iptables-alerter-x5tbf"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501463    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-conf-dir\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/734e584c-d5a4-47a4-b073-00fe97a35f37-kubelet-config\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501513    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-system-cni-dir\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501537    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bc46535-1233-48ac-a6be-ebb82083e332-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501563    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jndxc\" (UniqueName: \"kubernetes.io/projected/9f861605-37aa-4d3a-9fde-c29df825f649-kube-api-access-jndxc\") pod \"iptables-alerter-x5tbf\" (UID: \"9f861605-37aa-4d3a-9fde-c29df825f649\") " pod="openshift-network-operator/iptables-alerter-x5tbf"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-host\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501596    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-ovnkube-config\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.576437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-sysctl-d\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501621    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-socket-dir-parent\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-lib-modules\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7m77\" (UniqueName: \"kubernetes.io/projected/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-kube-api-access-g7m77\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-modprobe-d\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-kubelet\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501732    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-run-openvswitch\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-sysctl-conf\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqvn4\" (UniqueName: \"kubernetes.io/projected/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-kube-api-access-hqvn4\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vbpq\" (UniqueName: \"kubernetes.io/projected/ad08e483-50bc-440d-8a37-7b47614c25aa-kube-api-access-4vbpq\") pod \"node-ca-4mcr8\" (UID: \"ad08e483-50bc-440d-8a37-7b47614c25aa\") " pod="openshift-image-registry/node-ca-4mcr8"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501825    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-system-cni-dir\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501850    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-cni-dir\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501879    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8bc46535-1233-48ac-a6be-ebb82083e332-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-env-overrides\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.577144 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501935    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-ovnkube-script-lib\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-run-ovn\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502037    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f861605-37aa-4d3a-9fde-c29df825f649-host-slash\") pod \"iptables-alerter-x5tbf\" (UID: \"9f861605-37aa-4d3a-9fde-c29df825f649\") " pod="openshift-network-operator/iptables-alerter-x5tbf"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.502057    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.502143    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs podName:0b527024-4b36-41f9-844e-c932757f0b46 nodeName:}" failed. No retries permitted until 2026-07-21 20:39:36.002102697 +0000 UTC m=+2.022511160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs") pod "network-metrics-daemon-c6mdf" (UID: "0b527024-4b36-41f9-844e-c932757f0b46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.501828    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-cnibin\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-systemd-units\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-system-cni-dir\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-etc-openvswitch\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-modprobe-d\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-kubernetes\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-kubelet\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.577685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502533    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-run-openvswitch\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502542    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bc46535-1233-48ac-a6be-ebb82083e332-cni-binary-copy\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502561    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-var-lib-openvswitch\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-host\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502599    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502634    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bc46535-1233-48ac-a6be-ebb82083e332-os-release\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502652    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-cni-binary-copy\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502677    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-sysconfig\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-var-lib-openvswitch\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-var-lib-kubelet\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502733    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8bc46535-1233-48ac-a6be-ebb82083e332-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-var-lib-kubelet\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502762    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-sysconfig\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502677    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.578190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502764    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-socket-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502811    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-registration-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-device-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-daemon-config\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f861605-37aa-4d3a-9fde-c29df825f649-iptables-alerter-script\") pod \"iptables-alerter-x5tbf\" (UID: \"9f861605-37aa-4d3a-9fde-c29df825f649\") " pod="openshift-network-operator/iptables-alerter-x5tbf"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-systemd\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502928    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-device-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-node-log\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502949    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8bc46535-1233-48ac-a6be-ebb82083e332-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-cni-netd\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.502997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-registration-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503010    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-systemd\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bclgt\" (UniqueName: \"kubernetes.io/projected/23a0b2eb-4908-4197-acb7-11dfe462f642-kube-api-access-bclgt\") pod \"node-resolver-zhm2n\" (UID: \"23a0b2eb-4908-4197-acb7-11dfe462f642\") " pod="openshift-dns/node-resolver-zhm2n"
Jul 21 20:39:35.578713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-cni-netd\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503057    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-os-release\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-var-lib-cni-bin\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-node-log\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503139    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-cni-bin\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503173    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23a0b2eb-4908-4197-acb7-11dfe462f642-hosts-file\") pod \"node-resolver-zhm2n\" (UID: \"23a0b2eb-4908-4197-acb7-11dfe462f642\") " pod="openshift-dns/node-resolver-zhm2n"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503226    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-var-lib-kubelet\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503244    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-cni-bin\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503274    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-run-multus-certs\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503300    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23a0b2eb-4908-4197-acb7-11dfe462f642-hosts-file\") pod \"node-resolver-zhm2n\" (UID: \"23a0b2eb-4908-4197-acb7-11dfe462f642\") " pod="openshift-dns/node-resolver-zhm2n"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503327    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-tuned\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.579207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503379    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-run-netns\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9f861605-37aa-4d3a-9fde-c29df825f649-iptables-alerter-script\") pod \"iptables-alerter-x5tbf\" (UID: \"9f861605-37aa-4d3a-9fde-c29df825f649\") " pod="openshift-network-operator/iptables-alerter-x5tbf"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503469    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-run-systemd\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503502    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-host-run-netns\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503571    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-run-systemd\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.503781    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a71eaf1-563f-452a-bc6b-a24e930f16ee-socket-dir\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.504262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8bc46535-1233-48ac-a6be-ebb82083e332-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.504983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3c67df9-3601-49db-98a3-e031f1ae8fa8-tmp\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.505087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-ovn-node-metrics-cert\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.505210    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/51d7a014-3816-4594-bfaf-075941847018-agent-certs\") pod \"konnectivity-agent-wxbfz\" (UID: \"51d7a014-3816-4594-bfaf-075941847018\") " pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.505530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b3c67df9-3601-49db-98a3-e031f1ae8fa8-etc-tuned\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.509122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4f5m\" (UniqueName: \"kubernetes.io/projected/3a71eaf1-563f-452a-bc6b-a24e930f16ee-kube-api-access-c4f5m\") pod \"aws-ebs-csi-driver-node-c5z8g\" (UID: \"3a71eaf1-563f-452a-bc6b-a24e930f16ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.509201    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfxql\" (UniqueName: \"kubernetes.io/projected/0b527024-4b36-41f9-844e-c932757f0b46-kube-api-access-rfxql\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.511424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vprsg\" (UniqueName: \"kubernetes.io/projected/8bc46535-1233-48ac-a6be-ebb82083e332-kube-api-access-vprsg\") pod \"multus-additional-cni-plugins-lvsbr\" (UID: \"8bc46535-1233-48ac-a6be-ebb82083e332\") " pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.515022    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:39:35.579673 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.515039    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:39:35.580187 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.515048    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kdwwd for pod openshift-network-diagnostics/network-check-target-zb77t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:35.580187 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.515095    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd podName:feb7dcaa-7396-4fb6-80d9-5ee6a08b236c nodeName:}" failed. No retries permitted until 2026-07-21 20:39:36.015078401 +0000 UTC m=+2.035486841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kdwwd" (UniqueName: "kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd") pod "network-check-target-zb77t" (UID: "feb7dcaa-7396-4fb6-80d9-5ee6a08b236c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:35.580187 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.517426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff7dd\" (UniqueName: \"kubernetes.io/projected/b3c67df9-3601-49db-98a3-e031f1ae8fa8-kube-api-access-ff7dd\") pod \"tuned-b7lqd\" (UID: \"b3c67df9-3601-49db-98a3-e031f1ae8fa8\") " pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.580187 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.518537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jndxc\" (UniqueName: \"kubernetes.io/projected/9f861605-37aa-4d3a-9fde-c29df825f649-kube-api-access-jndxc\") pod \"iptables-alerter-x5tbf\" (UID: \"9f861605-37aa-4d3a-9fde-c29df825f649\") " pod="openshift-network-operator/iptables-alerter-x5tbf"
Jul 21 20:39:35.580187 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.518557    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqvn4\" (UniqueName: \"kubernetes.io/projected/c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d-kube-api-access-hqvn4\") pod \"ovnkube-node-cqbp6\" (UID: \"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.580187 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.519238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bclgt\" (UniqueName: \"kubernetes.io/projected/23a0b2eb-4908-4197-acb7-11dfe462f642-kube-api-access-bclgt\") pod \"node-resolver-zhm2n\" (UID: \"23a0b2eb-4908-4197-acb7-11dfe462f642\") " pod="openshift-dns/node-resolver-zhm2n"
Jul 21 20:39:35.580187 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.554011    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-daemon-config\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604442    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-os-release\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-var-lib-cni-bin\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604481    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-var-lib-kubelet\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604497    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-run-multus-certs\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604526    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604568    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad08e483-50bc-440d-8a37-7b47614c25aa-serviceca\") pod \"node-ca-4mcr8\" (UID: \"ad08e483-50bc-440d-8a37-7b47614c25aa\") " pod="openshift-image-registry/node-ca-4mcr8"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-var-lib-cni-bin\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604572    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-var-lib-kubelet\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-etc-kubernetes\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604571    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-os-release\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604609    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-run-multus-certs\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604645    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-run-netns\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-etc-kubernetes\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/734e584c-d5a4-47a4-b073-00fe97a35f37-dbus\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:35.696821 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.604704    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604732    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-run-netns\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:35.604768    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret podName:734e584c-d5a4-47a4-b073-00fe97a35f37 nodeName:}" failed. No retries permitted until 2026-07-21 20:39:36.1047457 +0000 UTC m=+2.125154143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret") pod "global-pull-secret-syncer-qs2qx" (UID: "734e584c-d5a4-47a4-b073-00fe97a35f37") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604853    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/734e584c-d5a4-47a4-b073-00fe97a35f37-dbus\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604872    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-cnibin\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-run-k8s-cni-cncf-io\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604953    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-var-lib-cni-multus\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.604959    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-run-k8s-cni-cncf-io\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad08e483-50bc-440d-8a37-7b47614c25aa-host\") pod \"node-ca-4mcr8\" (UID: \"ad08e483-50bc-440d-8a37-7b47614c25aa\") " pod="openshift-image-registry/node-ca-4mcr8"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-cnibin\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605026    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-hostroot\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605045    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-host-var-lib-cni-multus\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605052    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-conf-dir\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605066    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad08e483-50bc-440d-8a37-7b47614c25aa-host\") pod \"node-ca-4mcr8\" (UID: \"ad08e483-50bc-440d-8a37-7b47614c25aa\") " pod="openshift-image-registry/node-ca-4mcr8"
Jul 21 20:39:35.697520 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605022    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-daemon-config\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605078    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ad08e483-50bc-440d-8a37-7b47614c25aa-serviceca\") pod \"node-ca-4mcr8\" (UID: \"ad08e483-50bc-440d-8a37-7b47614c25aa\") " pod="openshift-image-registry/node-ca-4mcr8"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-hostroot\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/734e584c-d5a4-47a4-b073-00fe97a35f37-kubelet-config\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/734e584c-d5a4-47a4-b073-00fe97a35f37-kubelet-config\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-socket-dir-parent\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605091    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-conf-dir\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605199    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-socket-dir-parent\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605191    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7m77\" (UniqueName: \"kubernetes.io/projected/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-kube-api-access-g7m77\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605281    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vbpq\" (UniqueName: \"kubernetes.io/projected/ad08e483-50bc-440d-8a37-7b47614c25aa-kube-api-access-4vbpq\") pod \"node-ca-4mcr8\" (UID: \"ad08e483-50bc-440d-8a37-7b47614c25aa\") " pod="openshift-image-registry/node-ca-4mcr8"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-system-cni-dir\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605339    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-cni-dir\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-cni-binary-copy\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605444    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-system-cni-dir\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605507    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-multus-cni-dir\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698018 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.605749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-cni-binary-copy\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698605 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.617708    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7m77\" (UniqueName: \"kubernetes.io/projected/d1f870a9-5f4a-4213-9fa1-e93eee8e1662-kube-api-access-g7m77\") pod \"multus-pnwmz\" (UID: \"d1f870a9-5f4a-4213-9fa1-e93eee8e1662\") " pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.698605 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.618897    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vbpq\" (UniqueName: \"kubernetes.io/projected/ad08e483-50bc-440d-8a37-7b47614c25aa-kube-api-access-4vbpq\") pod \"node-ca-4mcr8\" (UID: \"ad08e483-50bc-440d-8a37-7b47614c25aa\") " pod="openshift-image-registry/node-ca-4mcr8"
Jul 21 20:39:35.698605 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:35.660909    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode39b9f23455a45c102012bdb6cd46aeb.slice/crio-51eaf43b181ae050cfaa6bd430058cc4a597d76cf56b349683141aab5a05762a WatchSource:0}: Error finding container 51eaf43b181ae050cfaa6bd430058cc4a597d76cf56b349683141aab5a05762a: Status 404 returned error can't find the container with id 51eaf43b181ae050cfaa6bd430058cc4a597d76cf56b349683141aab5a05762a
Jul 21 20:39:35.698605 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:35.661319    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfba4c61799a6b7e50aa7b14dc6a91c.slice/crio-1b5ce3fb4440d7bdf225c8c485ba85bd01ce1a8f1dc839060e2f62fccdc7b14c WatchSource:0}: Error finding container 1b5ce3fb4440d7bdf225c8c485ba85bd01ce1a8f1dc839060e2f62fccdc7b14c: Status 404 returned error can't find the container with id 1b5ce3fb4440d7bdf225c8c485ba85bd01ce1a8f1dc839060e2f62fccdc7b14c
Jul 21 20:39:35.698605 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.665452    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.700525    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.716284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g"
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:35.726227    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a71eaf1_563f_452a_bc6b_a24e930f16ee.slice/crio-7fad6f8580369063dd329737eb69c4832e4f3c6016d2725528199c488abe7f91 WatchSource:0}: Error finding container 7fad6f8580369063dd329737eb69c4832e4f3c6016d2725528199c488abe7f91: Status 404 returned error can't find the container with id 7fad6f8580369063dd329737eb69c4832e4f3c6016d2725528199c488abe7f91
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.741526    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:35.750697    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d7a014_3816_4594_bfaf_075941847018.slice/crio-444181a099f4d568605d1116c5a690600c2e2d04ba02d633073eafb6b9d397b5 WatchSource:0}: Error finding container 444181a099f4d568605d1116c5a690600c2e2d04ba02d633073eafb6b9d397b5: Status 404 returned error can't find the container with id 444181a099f4d568605d1116c5a690600c2e2d04ba02d633073eafb6b9d397b5
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.768256    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zhm2n"
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:35.777209    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a0b2eb_4908_4197_acb7_11dfe462f642.slice/crio-7bcaf016482dd5eed2db0b28478481e55d3d651bf5def31c286da6c3a016b83e WatchSource:0}: Error finding container 7bcaf016482dd5eed2db0b28478481e55d3d651bf5def31c286da6c3a016b83e: Status 404 returned error can't find the container with id 7bcaf016482dd5eed2db0b28478481e55d3d651bf5def31c286da6c3a016b83e
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.787308    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lvsbr"
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:35.797014    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc46535_1233_48ac_a6be_ebb82083e332.slice/crio-83c9efa91ed1b843b6be1380eb9ce77db385e5378dc649c343380b4ed26b3a56 WatchSource:0}: Error finding container 83c9efa91ed1b843b6be1380eb9ce77db385e5378dc649c343380b4ed26b3a56: Status 404 returned error can't find the container with id 83c9efa91ed1b843b6be1380eb9ce77db385e5378dc649c343380b4ed26b3a56
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.800181    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x5tbf"
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.801348    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b7lqd"
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:35.809738    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f861605_37aa_4d3a_9fde_c29df825f649.slice/crio-d8d17c8cf07505c30a66e72594f0f1b2d01529e78e1f7bb10af5d44f7071fb6a WatchSource:0}: Error finding container d8d17c8cf07505c30a66e72594f0f1b2d01529e78e1f7bb10af5d44f7071fb6a: Status 404 returned error can't find the container with id d8d17c8cf07505c30a66e72594f0f1b2d01529e78e1f7bb10af5d44f7071fb6a
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:35.812309    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c67df9_3601_49db_98a3_e031f1ae8fa8.slice/crio-ca86f36b692620575f64f35f9c154503ae375e838b5a040c372d1fd47f2bd09d WatchSource:0}: Error finding container ca86f36b692620575f64f35f9c154503ae375e838b5a040c372d1fd47f2bd09d: Status 404 returned error can't find the container with id ca86f36b692620575f64f35f9c154503ae375e838b5a040c372d1fd47f2bd09d
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.818821    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:35.832839    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc58ec16f_a76f_40c2_b56a_8c78fbbe4e6d.slice/crio-2d7a4ac47da3bdaa2c77d30e1fd8e92cc7ef0e1018f7ca7b36a69521b250a126 WatchSource:0}: Error finding container 2d7a4ac47da3bdaa2c77d30e1fd8e92cc7ef0e1018f7ca7b36a69521b250a126: Status 404 returned error can't find the container with id 2d7a4ac47da3bdaa2c77d30e1fd8e92cc7ef0e1018f7ca7b36a69521b250a126
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.862160    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4mcr8"
Jul 21 20:39:35.881131 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:35.866284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pnwmz"
Jul 21 20:39:35.883522 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:39:35.877689    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f870a9_5f4a_4213_9fa1_e93eee8e1662.slice/crio-127d5049110d2aa1383e852e22367ca971e302dd1941bdcabb0e536f6f4e7809 WatchSource:0}: Error finding container 127d5049110d2aa1383e852e22367ca971e302dd1941bdcabb0e536f6f4e7809: Status 404 returned error can't find the container with id 127d5049110d2aa1383e852e22367ca971e302dd1941bdcabb0e536f6f4e7809
Jul 21 20:39:36.066625 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.008458    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:36.066625 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:36.008571    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:36.066625 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:36.008622    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs podName:0b527024-4b36-41f9-844e-c932757f0b46 nodeName:}" failed. No retries permitted until 2026-07-21 20:39:37.008607272 +0000 UTC m=+3.029015717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs") pod "network-metrics-daemon-c6mdf" (UID: "0b527024-4b36-41f9-844e-c932757f0b46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:36.143560 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.108760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:36.143560 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.108813    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwwd\" (UniqueName: \"kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd\") pod \"network-check-target-zb77t\" (UID: \"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c\") " pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:36.143560 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:36.108915    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:36.143560 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:36.108931    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:39:36.143560 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:36.108950    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:39:36.143560 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:36.108962    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kdwwd for pod openshift-network-diagnostics/network-check-target-zb77t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:36.143560 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:36.108982    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret podName:734e584c-d5a4-47a4-b073-00fe97a35f37 nodeName:}" failed. No retries permitted until 2026-07-21 20:39:37.108963762 +0000 UTC m=+3.129372227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret") pod "global-pull-secret-syncer-qs2qx" (UID: "734e584c-d5a4-47a4-b073-00fe97a35f37") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:36.143560 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:36.109000    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd podName:feb7dcaa-7396-4fb6-80d9-5ee6a08b236c nodeName:}" failed. No retries permitted until 2026-07-21 20:39:37.108989901 +0000 UTC m=+3.129398347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdwwd" (UniqueName: "kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd") pod "network-check-target-zb77t" (UID: "feb7dcaa-7396-4fb6-80d9-5ee6a08b236c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:36.506846 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.421616    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:39:36.506846 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.454537    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 20:34:35 +0000 UTC" deadline="2028-02-07 21:03:03.094564654 +0000 UTC"
Jul 21 20:39:36.506846 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.454589    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13584h23m26.639979103s"
Jul 21 20:39:36.506846 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.491950    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:36.506846 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:36.492099    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:36.582508 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.539103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pnwmz" event={"ID":"d1f870a9-5f4a-4213-9fa1-e93eee8e1662","Type":"ContainerStarted","Data":"127d5049110d2aa1383e852e22367ca971e302dd1941bdcabb0e536f6f4e7809"}
Jul 21 20:39:36.582508 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.547010    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4mcr8" event={"ID":"ad08e483-50bc-440d-8a37-7b47614c25aa","Type":"ContainerStarted","Data":"6395ab67e45fbe7518a60cd6f383ba65786d22055d9b91c2c14873b4dfcba198"}
Jul 21 20:39:36.582508 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.566030    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b7lqd" event={"ID":"b3c67df9-3601-49db-98a3-e031f1ae8fa8","Type":"ContainerStarted","Data":"ca86f36b692620575f64f35f9c154503ae375e838b5a040c372d1fd47f2bd09d"}
Jul 21 20:39:36.582508 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.579645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x5tbf" event={"ID":"9f861605-37aa-4d3a-9fde-c29df825f649","Type":"ContainerStarted","Data":"d8d17c8cf07505c30a66e72594f0f1b2d01529e78e1f7bb10af5d44f7071fb6a"}
Jul 21 20:39:36.656631 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.585427    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvsbr" event={"ID":"8bc46535-1233-48ac-a6be-ebb82083e332","Type":"ContainerStarted","Data":"83c9efa91ed1b843b6be1380eb9ce77db385e5378dc649c343380b4ed26b3a56"}
Jul 21 20:39:36.656631 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.588637    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhm2n" event={"ID":"23a0b2eb-4908-4197-acb7-11dfe462f642","Type":"ContainerStarted","Data":"7bcaf016482dd5eed2db0b28478481e55d3d651bf5def31c286da6c3a016b83e"}
Jul 21 20:39:36.656631 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.596035    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" event={"ID":"6cfba4c61799a6b7e50aa7b14dc6a91c","Type":"ContainerStarted","Data":"1b5ce3fb4440d7bdf225c8c485ba85bd01ce1a8f1dc839060e2f62fccdc7b14c"}
Jul 21 20:39:36.656631 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.604383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6" event={"ID":"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d","Type":"ContainerStarted","Data":"2d7a4ac47da3bdaa2c77d30e1fd8e92cc7ef0e1018f7ca7b36a69521b250a126"}
Jul 21 20:39:36.656631 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.606263    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wxbfz" event={"ID":"51d7a014-3816-4594-bfaf-075941847018","Type":"ContainerStarted","Data":"444181a099f4d568605d1116c5a690600c2e2d04ba02d633073eafb6b9d397b5"}
Jul 21 20:39:36.656631 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.610123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g" event={"ID":"3a71eaf1-563f-452a-bc6b-a24e930f16ee","Type":"ContainerStarted","Data":"7fad6f8580369063dd329737eb69c4832e4f3c6016d2725528199c488abe7f91"}
Jul 21 20:39:36.656631 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:36.619899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal" event={"ID":"e39b9f23455a45c102012bdb6cd46aeb","Type":"ContainerStarted","Data":"51eaf43b181ae050cfaa6bd430058cc4a597d76cf56b349683141aab5a05762a"}
Jul 21 20:39:37.036852 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:37.036275    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:37.036852 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:37.036418    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:37.036852 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:37.036482    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs podName:0b527024-4b36-41f9-844e-c932757f0b46 nodeName:}" failed. No retries permitted until 2026-07-21 20:39:39.036463095 +0000 UTC m=+5.056871538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs") pod "network-metrics-daemon-c6mdf" (UID: "0b527024-4b36-41f9-844e-c932757f0b46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:37.137456 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:37.136699    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwwd\" (UniqueName: \"kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd\") pod \"network-check-target-zb77t\" (UID: \"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c\") " pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:37.137456 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:37.136776    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:37.137456 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:37.136897    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:37.137456 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:37.136951    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret podName:734e584c-d5a4-47a4-b073-00fe97a35f37 nodeName:}" failed. No retries permitted until 2026-07-21 20:39:39.136933437 +0000 UTC m=+5.157341891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret") pod "global-pull-secret-syncer-qs2qx" (UID: "734e584c-d5a4-47a4-b073-00fe97a35f37") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:37.137456 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:37.137350    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:39:37.137456 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:37.137371    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:39:37.137456 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:37.137384    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kdwwd for pod openshift-network-diagnostics/network-check-target-zb77t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:37.137456 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:37.137426    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd podName:feb7dcaa-7396-4fb6-80d9-5ee6a08b236c nodeName:}" failed. No retries permitted until 2026-07-21 20:39:39.137412435 +0000 UTC m=+5.157820882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdwwd" (UniqueName: "kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd") pod "network-check-target-zb77t" (UID: "feb7dcaa-7396-4fb6-80d9-5ee6a08b236c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:37.455753 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:37.455642    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 20:34:35 +0000 UTC" deadline="2028-02-29 00:42:14.652984393 +0000 UTC"
Jul 21 20:39:37.455753 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:37.455678    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14092h2m37.197310994s"
Jul 21 20:39:37.492518 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:37.492041    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:37.492518 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:37.492160    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:37.492518 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:37.491991    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:37.492518 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:37.492465    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:38.113061 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:38.112937    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 20:39:38.491699 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:38.491629    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:38.491840 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:38.491762    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:39.052963 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:39.052415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:39.052963 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:39.052558    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:39.052963 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:39.052618    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs podName:0b527024-4b36-41f9-844e-c932757f0b46 nodeName:}" failed. No retries permitted until 2026-07-21 20:39:43.052599332 +0000 UTC m=+9.073007781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs") pod "network-metrics-daemon-c6mdf" (UID: "0b527024-4b36-41f9-844e-c932757f0b46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:39.153228 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:39.153012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwwd\" (UniqueName: \"kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd\") pod \"network-check-target-zb77t\" (UID: \"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c\") " pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:39.153228 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:39.153111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:39.153724 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:39.153270    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:39.153724 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:39.153334    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret podName:734e584c-d5a4-47a4-b073-00fe97a35f37 nodeName:}" failed. No retries permitted until 2026-07-21 20:39:43.153316989 +0000 UTC m=+9.173725434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret") pod "global-pull-secret-syncer-qs2qx" (UID: "734e584c-d5a4-47a4-b073-00fe97a35f37") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:39.153835 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:39.153740    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:39:39.153835 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:39.153763    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:39:39.153835 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:39.153782    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kdwwd for pod openshift-network-diagnostics/network-check-target-zb77t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:39.153835 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:39.153829    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd podName:feb7dcaa-7396-4fb6-80d9-5ee6a08b236c nodeName:}" failed. No retries permitted until 2026-07-21 20:39:43.153813793 +0000 UTC m=+9.174222251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdwwd" (UniqueName: "kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd") pod "network-check-target-zb77t" (UID: "feb7dcaa-7396-4fb6-80d9-5ee6a08b236c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:39.491979 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:39.491941    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:39.492169 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:39.491988    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:39.492169 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:39.492098    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:39.492296 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:39.492237    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:40.496239 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:40.496084    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:40.497149 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:40.496773    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:41.491678 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:41.491546    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:41.491678 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:41.491574    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:41.491920 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:41.491681    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:41.492142 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:41.492091    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:42.492502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:42.491951    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:42.492502 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:42.492148    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:43.088455 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:43.088419    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:43.088644 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:43.088573    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:43.088707 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:43.088648    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs podName:0b527024-4b36-41f9-844e-c932757f0b46 nodeName:}" failed. No retries permitted until 2026-07-21 20:39:51.088626603 +0000 UTC m=+17.109035053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs") pod "network-metrics-daemon-c6mdf" (UID: "0b527024-4b36-41f9-844e-c932757f0b46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:43.190241 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:43.189518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:43.190241 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:43.189589    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwwd\" (UniqueName: \"kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd\") pod \"network-check-target-zb77t\" (UID: \"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c\") " pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:43.190241 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:43.189738    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:39:43.190241 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:43.189754    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:39:43.190241 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:43.189764    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kdwwd for pod openshift-network-diagnostics/network-check-target-zb77t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:43.190241 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:43.189816    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd podName:feb7dcaa-7396-4fb6-80d9-5ee6a08b236c nodeName:}" failed. No retries permitted until 2026-07-21 20:39:51.18979942 +0000 UTC m=+17.210207870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdwwd" (UniqueName: "kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd") pod "network-check-target-zb77t" (UID: "feb7dcaa-7396-4fb6-80d9-5ee6a08b236c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:43.190241 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:43.190152    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:43.190241 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:43.190212    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret podName:734e584c-d5a4-47a4-b073-00fe97a35f37 nodeName:}" failed. No retries permitted until 2026-07-21 20:39:51.190199036 +0000 UTC m=+17.210607493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret") pod "global-pull-secret-syncer-qs2qx" (UID: "734e584c-d5a4-47a4-b073-00fe97a35f37") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:43.492106 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:43.491832    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:43.492106 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:43.491876    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:43.492106 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:43.491963    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:43.492106 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:43.492039    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:44.495820 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:44.495796    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:44.496294 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:44.495904    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:45.491950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:45.491920    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:45.492114 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:45.491920    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:45.492114 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:45.492046    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:45.492236 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:45.492106    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:46.491405 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:46.491374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:46.491817 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:46.491516    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:47.491756 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:47.491725    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:47.492114 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:47.491724    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:47.492114 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:47.491825    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:47.492114 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:47.491889    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:48.492113 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:48.492081    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:48.492515 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:48.492211    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:49.491733 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:49.491695    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:49.491896 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:49.491822    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:49.491974 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:49.491907    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:49.491974 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:49.491816    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:50.492001 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:50.491967    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:50.492509 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:50.492105    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:51.153106 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:51.153068    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:51.153317 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:51.153265    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:51.153393 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:51.153346    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs podName:0b527024-4b36-41f9-844e-c932757f0b46 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:07.153323121 +0000 UTC m=+33.173731571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs") pod "network-metrics-daemon-c6mdf" (UID: "0b527024-4b36-41f9-844e-c932757f0b46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:39:51.253986 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:51.253949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:51.254223 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:51.254007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwwd\" (UniqueName: \"kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd\") pod \"network-check-target-zb77t\" (UID: \"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c\") " pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:51.254223 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:51.254107    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:51.254223 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:51.254144    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:39:51.254223 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:51.254164    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:39:51.254223 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:51.254171    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret podName:734e584c-d5a4-47a4-b073-00fe97a35f37 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:07.254154164 +0000 UTC m=+33.274562622 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret") pod "global-pull-secret-syncer-qs2qx" (UID: "734e584c-d5a4-47a4-b073-00fe97a35f37") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:39:51.254223 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:51.254179    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kdwwd for pod openshift-network-diagnostics/network-check-target-zb77t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:51.254532 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:51.254247    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd podName:feb7dcaa-7396-4fb6-80d9-5ee6a08b236c nodeName:}" failed. No retries permitted until 2026-07-21 20:40:07.25423198 +0000 UTC m=+33.274640442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdwwd" (UniqueName: "kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd") pod "network-check-target-zb77t" (UID: "feb7dcaa-7396-4fb6-80d9-5ee6a08b236c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:39:51.491961 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:51.491884    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:51.491961 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:51.491925    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:51.492426 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:51.492022    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:51.492426 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:51.492130    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:52.491619 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:52.491525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:52.491764 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:52.491660    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:53.491502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:53.491468    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:53.491902 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:53.491471    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:53.491902 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:53.491581    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:53.491902 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:53.491648    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:54.494484 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:54.494451    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:54.494871 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:54.494566    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:55.491530 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:55.491495    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:55.491696 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:55.491612    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:55.491696 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:55.491674    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:55.491822 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:55.491797    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:56.491631 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.491605    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:56.491923 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:56.491749    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:56.678436 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.678409    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:39:56.678806 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.678773    2560 generic.go:356] "Generic (PLEG): container finished" podID="c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d" containerID="04787e5ecc5cb3e7b6a278bea4570cfb0ba3f6b7bfbd091b474d82baccc7b2ba" exitCode=1
Jul 21 20:39:56.678915 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.678852    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6" event={"ID":"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d","Type":"ContainerStarted","Data":"6fbd0867fbfde5bce129878166d37ed7b17c4fc596232278e73b8d813a4ff299"}
Jul 21 20:39:56.678977 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.678941    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6" event={"ID":"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d","Type":"ContainerStarted","Data":"78ff5523ef8134c54990b96ccb85f3ed1746cd869d52a90cb17963a2cbd53c08"}
Jul 21 20:39:56.679032 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.678993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6" event={"ID":"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d","Type":"ContainerDied","Data":"04787e5ecc5cb3e7b6a278bea4570cfb0ba3f6b7bfbd091b474d82baccc7b2ba"}
Jul 21 20:39:56.679085 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.679045    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6" event={"ID":"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d","Type":"ContainerStarted","Data":"2e3b2b7c33af70e5126b4604421e2cee90b37213a4f88a58259dcffdf7eb5bc3"}
Jul 21 20:39:56.681491 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.680845    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal" event={"ID":"e39b9f23455a45c102012bdb6cd46aeb","Type":"ContainerStarted","Data":"d1f6c215eef83c98ecaa1ab9b394df136ebaa556ff5a308550e3cb13b2255d4d"}
Jul 21 20:39:56.682494 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.682470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pnwmz" event={"ID":"d1f870a9-5f4a-4213-9fa1-e93eee8e1662","Type":"ContainerStarted","Data":"5d9ab03a2a4c1dea67f47d0c685c45fab3c308bb38bd056037a94fb2a3265e83"}
Jul 21 20:39:56.684154 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.684127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b7lqd" event={"ID":"b3c67df9-3601-49db-98a3-e031f1ae8fa8","Type":"ContainerStarted","Data":"89cb14bdbcd4126c799323b6fceb5b612ef8349266037cc28d2e0e665adf8b88"}
Jul 21 20:39:56.720354 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.720300    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pnwmz" podStartSLOduration=1.51719494 podStartE2EDuration="21.720280291s" totalImagesPullingTime="20.203085351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:39:56.720090172 +0000 UTC m=+22.740498635" watchObservedRunningTime="2026-07-21 20:39:56.720280291 +0000 UTC m=+22.740688758"
Jul 21 20:39:56.720563 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.720537    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal" podStartSLOduration=21.720528099 podStartE2EDuration="21.720528099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:39:56.698145624 +0000 UTC m=+22.718554088" watchObservedRunningTime="2026-07-21 20:39:56.720528099 +0000 UTC m=+22.740936576"
Jul 21 20:39:56.738572 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:56.738529    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b7lqd" podStartSLOduration=2.697523096 podStartE2EDuration="22.73850847s" totalImagesPullingTime="20.040985374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:39:56.738155364 +0000 UTC m=+22.758563839" watchObservedRunningTime="2026-07-21 20:39:56.73850847 +0000 UTC m=+22.758916933"
Jul 21 20:39:57.491706 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.491498    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:57.492453 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.491528    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:57.492453 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:57.491786    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:57.492453 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:57.491869    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:57.688401 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.688361    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4mcr8" event={"ID":"ad08e483-50bc-440d-8a37-7b47614c25aa","Type":"ContainerStarted","Data":"0109ad491c9af91a3b3e322385703c9c4339698b7332febd917609a8c8853d3d"}
Jul 21 20:39:57.690137 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.690103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x5tbf" event={"ID":"9f861605-37aa-4d3a-9fde-c29df825f649","Type":"ContainerStarted","Data":"625da5f0675d35242cda3cd1250d85b997dd85aa58b321eae7be6f15c6c3899d"}
Jul 21 20:39:57.691891 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.691842    2560 generic.go:356] "Generic (PLEG): container finished" podID="8bc46535-1233-48ac-a6be-ebb82083e332" containerID="ab32537441e2bd03b4afad231332c3daf7ace5fdfa3a31643269e8ec79d7ce37" exitCode=0
Jul 21 20:39:57.692042 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.691928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvsbr" event={"ID":"8bc46535-1233-48ac-a6be-ebb82083e332","Type":"ContainerDied","Data":"ab32537441e2bd03b4afad231332c3daf7ace5fdfa3a31643269e8ec79d7ce37"}
Jul 21 20:39:57.693631 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.693605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zhm2n" event={"ID":"23a0b2eb-4908-4197-acb7-11dfe462f642","Type":"ContainerStarted","Data":"b0128257657f1c1efbb6a2e2e80c1acd1a8340696dc4aa9b19ec28ecc2c982e3"}
Jul 21 20:39:57.695847 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.695820    2560 generic.go:356] "Generic (PLEG): container finished" podID="6cfba4c61799a6b7e50aa7b14dc6a91c" containerID="9ac7972a5f856161883cb135ef6d9ef4091bd68aaa2cace2ba83e5fbe520022f" exitCode=0
Jul 21 20:39:57.695954 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.695897    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" event={"ID":"6cfba4c61799a6b7e50aa7b14dc6a91c","Type":"ContainerDied","Data":"9ac7972a5f856161883cb135ef6d9ef4091bd68aaa2cace2ba83e5fbe520022f"}
Jul 21 20:39:57.696022 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.695998    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 21 20:39:57.699083 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.699064    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:39:57.699513 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.699478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6" event={"ID":"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d","Type":"ContainerStarted","Data":"90231039190b642a3da94bb858ec7cb9f377818bfce98c43dc8b0f360db16a6d"}
Jul 21 20:39:57.699612 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.699563    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6" event={"ID":"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d","Type":"ContainerStarted","Data":"650df8f66fb49fbfb6a5f9e06e535d4c3ca9f7dc24eb5a69dc93ae9aed6bc45f"}
Jul 21 20:39:57.701123 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.701078    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wxbfz" event={"ID":"51d7a014-3816-4594-bfaf-075941847018","Type":"ContainerStarted","Data":"f599c629d9be5310dc4ca14aaada422024602e6ae308a4bdebec864177d250b6"}
Jul 21 20:39:57.703047 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.702991    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g" event={"ID":"3a71eaf1-563f-452a-bc6b-a24e930f16ee","Type":"ContainerStarted","Data":"0bdeaf697ab3f2355a03d7e28be1b2ea2aa0041e307be5b0494ca7858a364602"}
Jul 21 20:39:57.704247 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.704210    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4mcr8" podStartSLOduration=2.725732914 podStartE2EDuration="22.704171187s" totalImagesPullingTime="19.978438273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:39:57.703843676 +0000 UTC m=+23.724252140" watchObservedRunningTime="2026-07-21 20:39:57.704171187 +0000 UTC m=+23.724579650"
Jul 21 20:39:57.707365 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.707348    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 20:39:57.708190 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.708166    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"]
Jul 21 20:39:57.718518 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.718484    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zhm2n" podStartSLOduration=3.641956327 podStartE2EDuration="23.718475068s" totalImagesPullingTime="20.076518741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:39:57.718405856 +0000 UTC m=+23.738814316" watchObservedRunningTime="2026-07-21 20:39:57.718475068 +0000 UTC m=+23.738883530"
Jul 21 20:39:57.739098 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:57.739045    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wxbfz" podStartSLOduration=7.349358765 podStartE2EDuration="23.73902603s" totalImagesPullingTime="16.389667265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:39:57.738691546 +0000 UTC m=+23.759100001" watchObservedRunningTime="2026-07-21 20:39:57.73902603 +0000 UTC m=+23.759434493"
Jul 21 20:39:58.392799 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.392779    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 20:39:58.444166 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.444138    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:58.444698 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.444680    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:58.465645 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.465607    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x5tbf" podStartSLOduration=4.435302621 podStartE2EDuration="24.465593023s" totalImagesPullingTime="20.030290402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:39:57.779075695 +0000 UTC m=+23.799484157" watchObservedRunningTime="2026-07-21 20:39:58.465593023 +0000 UTC m=+24.486001486"
Jul 21 20:39:58.484565 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.484486    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T20:39:58.392799145Z","UUID":"6c249cfd-933f-4699-8500-bbf05a5cb60a","Handler":null,"Name":"","Endpoint":""}
Jul 21 20:39:58.486118 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.486100    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 20:39:58.486213 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.486135    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 20:39:58.491550 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.491530    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:39:58.491664 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:58.491641    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:39:58.707335 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.707302    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g" event={"ID":"3a71eaf1-563f-452a-bc6b-a24e930f16ee","Type":"ContainerStarted","Data":"e3a1995c2b01d83fc7d14bbf8a629f447f72c4d0e222ea902cff1e117723ab17"}
Jul 21 20:39:58.709382 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.709335    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" event={"ID":"6cfba4c61799a6b7e50aa7b14dc6a91c","Type":"ContainerStarted","Data":"b3a6d6e12a9c89fe880a402e8d3839f57754d91278a0fea9c691d6df3f3f13d2"}
Jul 21 20:39:58.710331 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.710306    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:58.710455 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.710385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wxbfz"
Jul 21 20:39:58.731938 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:58.731886    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" podStartSLOduration=1.731867579 podStartE2EDuration="1.731867579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:39:58.731574868 +0000 UTC m=+24.751983331" watchObservedRunningTime="2026-07-21 20:39:58.731867579 +0000 UTC m=+24.752276045"
Jul 21 20:39:59.492332 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:59.492296    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:39:59.492602 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:59.492343    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:39:59.492602 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:59.492439    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:39:59.492602 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:39:59.492561    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:39:59.716089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:59.716069    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:39:59.717094 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:39:59.717008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6" event={"ID":"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d","Type":"ContainerStarted","Data":"78f8a2f414dbf57e8ec0dd38010bf44cc4f17965c1ef589f64e7c2f54de9ac5d"}
Jul 21 20:40:00.491959 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:00.491927    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:40:00.492198 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:00.492065    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:40:00.727393 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:00.727354    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g" event={"ID":"3a71eaf1-563f-452a-bc6b-a24e930f16ee","Type":"ContainerStarted","Data":"caf8999bc06b8c102f59d8e8438fe85816caac60a35ee929a66fe55d856acd48"}
Jul 21 20:40:00.759507 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:00.759426    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c5z8g" podStartSLOduration=4.342569916 podStartE2EDuration="26.759411601s" totalImagesPullingTime="22.416841685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:00.759034742 +0000 UTC m=+26.779443207" watchObservedRunningTime="2026-07-21 20:40:00.759411601 +0000 UTC m=+26.779820064"
Jul 21 20:40:01.491439 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:01.491406    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:40:01.491610 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:01.491410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:40:01.491610 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:01.491515    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:40:01.491698 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:01.491605    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:40:02.491463 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:02.491292    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:40:02.492070 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:02.491544    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:40:02.732636 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:02.732605    2560 generic.go:356] "Generic (PLEG): container finished" podID="8bc46535-1233-48ac-a6be-ebb82083e332" containerID="dee3973347ec0fe726dd5c70e243565c10cea9426c9882c7b5665b1dd78c19a0" exitCode=0
Jul 21 20:40:02.732799 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:02.732689    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvsbr" event={"ID":"8bc46535-1233-48ac-a6be-ebb82083e332","Type":"ContainerDied","Data":"dee3973347ec0fe726dd5c70e243565c10cea9426c9882c7b5665b1dd78c19a0"}
Jul 21 20:40:02.735994 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:02.735977    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:40:02.736318 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:02.736299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6" event={"ID":"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d","Type":"ContainerStarted","Data":"2782644d51e07abe0fcfdeb80e97e6f678afc0eedbc614a2f1ebacd26ff00d17"}
Jul 21 20:40:02.736529 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:02.736507    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:40:02.736629 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:02.736564    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:40:02.736683 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:02.736655    2560 scope.go:117] "RemoveContainer" containerID="04787e5ecc5cb3e7b6a278bea4570cfb0ba3f6b7bfbd091b474d82baccc7b2ba"
Jul 21 20:40:02.751764 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:02.751739    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:40:03.492358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:03.492169    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:40:03.492867 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:03.492169    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:40:03.492867 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:03.492472    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:40:03.492867 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:03.492515    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:40:03.742781 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:03.742694    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:40:03.743039 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:03.743020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6" event={"ID":"c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d","Type":"ContainerStarted","Data":"318deeaafbbd766246d7e70d8923add8ac14d1c887eb87b13e9a743ff5726f61"}
Jul 21 20:40:03.743287 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:03.743265    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:40:03.757681 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:03.757658    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:40:03.784513 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:03.784473    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6" podStartSLOduration=9.4474596 podStartE2EDuration="29.784459128s" totalImagesPullingTime="20.336999528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:03.783276879 +0000 UTC m=+29.803685359" watchObservedRunningTime="2026-07-21 20:40:03.784459128 +0000 UTC m=+29.804867591"
Jul 21 20:40:04.453865 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:04.453832    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qs2qx"]
Jul 21 20:40:04.454068 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:04.453941    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:40:04.454068 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:04.454045    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:40:04.457025 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:04.456992    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zb77t"]
Jul 21 20:40:04.457147 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:04.457085    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:40:04.457228 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:04.457205    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:40:04.457688 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:04.457665    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c6mdf"]
Jul 21 20:40:04.457783 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:04.457770    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:40:04.457892 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:04.457871    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:40:04.746921 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:04.746892    2560 generic.go:356] "Generic (PLEG): container finished" podID="8bc46535-1233-48ac-a6be-ebb82083e332" containerID="8dd6f09f76a255bc5c70b076104d25cc029a8b6832aed3ee10d8c0745b273ff2" exitCode=0
Jul 21 20:40:04.747394 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:04.746977    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvsbr" event={"ID":"8bc46535-1233-48ac-a6be-ebb82083e332","Type":"ContainerDied","Data":"8dd6f09f76a255bc5c70b076104d25cc029a8b6832aed3ee10d8c0745b273ff2"}
Jul 21 20:40:06.491646 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:06.491420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:40:06.492032 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:06.491422    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:40:06.492032 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:06.491693    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:40:06.492032 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:06.491473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:40:06.492032 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:06.491792    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:40:06.492032 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:06.491846    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:40:06.753896 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:06.753810    2560 generic.go:356] "Generic (PLEG): container finished" podID="8bc46535-1233-48ac-a6be-ebb82083e332" containerID="c0c4040707bc95df9ae9c4760ee40d0f8fd73bc508c2450348d3f8347375dc73" exitCode=0
Jul 21 20:40:06.753896 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:06.753871    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvsbr" event={"ID":"8bc46535-1233-48ac-a6be-ebb82083e332","Type":"ContainerDied","Data":"c0c4040707bc95df9ae9c4760ee40d0f8fd73bc508c2450348d3f8347375dc73"}
Jul 21 20:40:07.171283 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:07.171247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:40:07.171459 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:07.171409    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:40:07.171762 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:07.171486    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs podName:0b527024-4b36-41f9-844e-c932757f0b46 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:39.17146716 +0000 UTC m=+65.191875610 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs") pod "network-metrics-daemon-c6mdf" (UID: "0b527024-4b36-41f9-844e-c932757f0b46") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 20:40:07.271692 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:07.271655    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwwd\" (UniqueName: \"kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd\") pod \"network-check-target-zb77t\" (UID: \"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c\") " pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:40:07.271852 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:07.271744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:40:07.271852 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:07.271831    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 20:40:07.271852 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:07.271850    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 20:40:07.271994 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:07.271860    2560 projected.go:196] Error preparing data for projected volume kube-api-access-kdwwd for pod openshift-network-diagnostics/network-check-target-zb77t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:40:07.271994 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:07.271863    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 20:40:07.271994 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:07.271929    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret podName:734e584c-d5a4-47a4-b073-00fe97a35f37 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:39.271910557 +0000 UTC m=+65.292319001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret") pod "global-pull-secret-syncer-qs2qx" (UID: "734e584c-d5a4-47a4-b073-00fe97a35f37") : object "kube-system"/"original-pull-secret" not registered
Jul 21 20:40:07.271994 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:07.271949    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd podName:feb7dcaa-7396-4fb6-80d9-5ee6a08b236c nodeName:}" failed. No retries permitted until 2026-07-21 20:40:39.271939374 +0000 UTC m=+65.292347818 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdwwd" (UniqueName: "kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd") pod "network-check-target-zb77t" (UID: "feb7dcaa-7396-4fb6-80d9-5ee6a08b236c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 20:40:08.491473 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:08.491441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:40:08.491928 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:08.491441    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:40:08.491928 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:08.491558    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:40:08.491928 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:08.491560    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c6mdf" podUID="0b527024-4b36-41f9-844e-c932757f0b46"
Jul 21 20:40:08.491928 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:08.491661    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb77t" podUID="feb7dcaa-7396-4fb6-80d9-5ee6a08b236c"
Jul 21 20:40:08.491928 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:08.491736    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qs2qx" podUID="734e584c-d5a4-47a4-b073-00fe97a35f37"
Jul 21 20:40:09.272954 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.272919    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeReady"
Jul 21 20:40:09.273160 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.273091    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 20:40:09.326664 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.326633    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p2mfz"]
Jul 21 20:40:09.328771 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.328746    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.329884 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.329861    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ckl2m"]
Jul 21 20:40:09.331476 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.331453    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lm6sh\""
Jul 21 20:40:09.331583 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.331478    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ckl2m"
Jul 21 20:40:09.331583 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.331505    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 20:40:09.331583 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.331513    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 20:40:09.333829 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.333811    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 20:40:09.334417 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.334398    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 20:40:09.335722 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.335705    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qq4pr\""
Jul 21 20:40:09.335830 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.335716    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 20:40:09.341089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.341073    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p2mfz"]
Jul 21 20:40:09.356552 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.356529    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ckl2m"]
Jul 21 20:40:09.487041 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.487010    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-tmp-dir\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.487247 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.487045    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbcct\" (UniqueName: \"kubernetes.io/projected/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-kube-api-access-zbcct\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.487247 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.487079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-config-volume\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.487247 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.487104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2m4k\" (UniqueName: \"kubernetes.io/projected/7f7626cf-986d-42d3-8614-28c140d2491f-kube-api-access-r2m4k\") pod \"ingress-canary-ckl2m\" (UID: \"7f7626cf-986d-42d3-8614-28c140d2491f\") " pod="openshift-ingress-canary/ingress-canary-ckl2m"
Jul 21 20:40:09.487247 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.487129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f7626cf-986d-42d3-8614-28c140d2491f-cert\") pod \"ingress-canary-ckl2m\" (UID: \"7f7626cf-986d-42d3-8614-28c140d2491f\") " pod="openshift-ingress-canary/ingress-canary-ckl2m"
Jul 21 20:40:09.487247 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.487179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.588453 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.588409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-tmp-dir\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.589056 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.588463    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbcct\" (UniqueName: \"kubernetes.io/projected/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-kube-api-access-zbcct\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.589056 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.588495    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-config-volume\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.589056 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.588518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2m4k\" (UniqueName: \"kubernetes.io/projected/7f7626cf-986d-42d3-8614-28c140d2491f-kube-api-access-r2m4k\") pod \"ingress-canary-ckl2m\" (UID: \"7f7626cf-986d-42d3-8614-28c140d2491f\") " pod="openshift-ingress-canary/ingress-canary-ckl2m"
Jul 21 20:40:09.589056 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.588552    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f7626cf-986d-42d3-8614-28c140d2491f-cert\") pod \"ingress-canary-ckl2m\" (UID: \"7f7626cf-986d-42d3-8614-28c140d2491f\") " pod="openshift-ingress-canary/ingress-canary-ckl2m"
Jul 21 20:40:09.589056 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.588600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.589056 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:09.588735    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:40:09.589056 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:09.588791    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls podName:790e4ae8-009b-4a5d-8cb4-7eea0cb22d41 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:10.088772063 +0000 UTC m=+36.109180507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls") pod "dns-default-p2mfz" (UID: "790e4ae8-009b-4a5d-8cb4-7eea0cb22d41") : secret "dns-default-metrics-tls" not found
Jul 21 20:40:09.589056 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.588871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-tmp-dir\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.589570 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.589536    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-config-volume\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.594619 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.594595    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f7626cf-986d-42d3-8614-28c140d2491f-cert\") pod \"ingress-canary-ckl2m\" (UID: \"7f7626cf-986d-42d3-8614-28c140d2491f\") " pod="openshift-ingress-canary/ingress-canary-ckl2m"
Jul 21 20:40:09.598207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.598151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbcct\" (UniqueName: \"kubernetes.io/projected/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-kube-api-access-zbcct\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:09.598465 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.598362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2m4k\" (UniqueName: \"kubernetes.io/projected/7f7626cf-986d-42d3-8614-28c140d2491f-kube-api-access-r2m4k\") pod \"ingress-canary-ckl2m\" (UID: \"7f7626cf-986d-42d3-8614-28c140d2491f\") " pod="openshift-ingress-canary/ingress-canary-ckl2m"
Jul 21 20:40:09.648462 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:09.648435    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ckl2m"
Jul 21 20:40:10.093779 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:10.093740    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:10.093968 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:10.093911    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:40:10.094039 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:10.093993    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls podName:790e4ae8-009b-4a5d-8cb4-7eea0cb22d41 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:11.09397013 +0000 UTC m=+37.114378572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls") pod "dns-default-p2mfz" (UID: "790e4ae8-009b-4a5d-8cb4-7eea0cb22d41") : secret "dns-default-metrics-tls" not found
Jul 21 20:40:10.491890 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:10.491811    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:40:10.492084 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:10.491811    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:40:10.492408 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:10.491812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:40:10.494586 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:10.494567    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jpthn\""
Jul 21 20:40:10.494774 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:10.494762    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 20:40:10.495452 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:10.495424    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 20:40:10.495660 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:10.495641    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 20:40:10.495766 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:10.495702    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 20:40:10.495830 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:10.495783    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zdqrl\""
Jul 21 20:40:10.768320 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:10.768173    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ckl2m"]
Jul 21 20:40:10.771048 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:40:10.771021    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7626cf_986d_42d3_8614_28c140d2491f.slice/crio-af5e069aa1d94594d2127844e9f633afff80db576bc28b1cd31f1f8a5bc14c6e WatchSource:0}: Error finding container af5e069aa1d94594d2127844e9f633afff80db576bc28b1cd31f1f8a5bc14c6e: Status 404 returned error can't find the container with id af5e069aa1d94594d2127844e9f633afff80db576bc28b1cd31f1f8a5bc14c6e
Jul 21 20:40:11.100435 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:11.100402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:11.100580 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:11.100556    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:40:11.100635 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:11.100624    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls podName:790e4ae8-009b-4a5d-8cb4-7eea0cb22d41 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:13.100605366 +0000 UTC m=+39.121013827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls") pod "dns-default-p2mfz" (UID: "790e4ae8-009b-4a5d-8cb4-7eea0cb22d41") : secret "dns-default-metrics-tls" not found
Jul 21 20:40:11.770129 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:11.769680    2560 generic.go:356] "Generic (PLEG): container finished" podID="8bc46535-1233-48ac-a6be-ebb82083e332" containerID="23eafe325a36f4a40569b48cc55cec681c9a185e2a9e02cde063ceb0d0d61892" exitCode=0
Jul 21 20:40:11.770129 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:11.769719    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvsbr" event={"ID":"8bc46535-1233-48ac-a6be-ebb82083e332","Type":"ContainerDied","Data":"23eafe325a36f4a40569b48cc55cec681c9a185e2a9e02cde063ceb0d0d61892"}
Jul 21 20:40:11.771417 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:11.771390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ckl2m" event={"ID":"7f7626cf-986d-42d3-8614-28c140d2491f","Type":"ContainerStarted","Data":"af5e069aa1d94594d2127844e9f633afff80db576bc28b1cd31f1f8a5bc14c6e"}
Jul 21 20:40:12.778503 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:12.778471    2560 generic.go:356] "Generic (PLEG): container finished" podID="8bc46535-1233-48ac-a6be-ebb82083e332" containerID="da62cedfd9c8a5f8c9a7a3f4d8505c1dee7a06272d1f144cb02c3c410bface48" exitCode=0
Jul 21 20:40:12.778975 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:12.778556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvsbr" event={"ID":"8bc46535-1233-48ac-a6be-ebb82083e332","Type":"ContainerDied","Data":"da62cedfd9c8a5f8c9a7a3f4d8505c1dee7a06272d1f144cb02c3c410bface48"}
Jul 21 20:40:13.115331 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:13.115305    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:13.115448 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:13.115418    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:40:13.115486 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:13.115470    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls podName:790e4ae8-009b-4a5d-8cb4-7eea0cb22d41 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:17.115455664 +0000 UTC m=+43.135864105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls") pod "dns-default-p2mfz" (UID: "790e4ae8-009b-4a5d-8cb4-7eea0cb22d41") : secret "dns-default-metrics-tls" not found
Jul 21 20:40:13.783968 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:13.783781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lvsbr" event={"ID":"8bc46535-1233-48ac-a6be-ebb82083e332","Type":"ContainerStarted","Data":"7d8bd875285b6454e1adcd7d2d569c8a877c7e27e2cae6cf46c691f4098607ba"}
Jul 21 20:40:13.785231 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:13.785199    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ckl2m" event={"ID":"7f7626cf-986d-42d3-8614-28c140d2491f","Type":"ContainerStarted","Data":"db705bd39e99ca7861415d4ad0754f46b633f48ea4aaf87335ed7d748afcecd4"}
Jul 21 20:40:13.807408 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:13.807362    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lvsbr" podStartSLOduration=9.064838404 podStartE2EDuration="39.807348225s" totalImagesPullingTime="30.742509821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:13.805656384 +0000 UTC m=+39.826064857" watchObservedRunningTime="2026-07-21 20:40:13.807348225 +0000 UTC m=+39.827756689"
Jul 21 20:40:13.823319 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:13.823281    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ckl2m" podStartSLOduration=2.581996453 podStartE2EDuration="4.8232672s" totalImagesPullingTime="2.241270747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:13.82244952 +0000 UTC m=+39.842857983" watchObservedRunningTime="2026-07-21 20:40:13.8232672 +0000 UTC m=+39.843675715"
Jul 21 20:40:17.144785 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:17.144749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:17.145220 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:17.144866    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:40:17.145220 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:17.144958    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls podName:790e4ae8-009b-4a5d-8cb4-7eea0cb22d41 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:25.144912891 +0000 UTC m=+51.165321333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls") pod "dns-default-p2mfz" (UID: "790e4ae8-009b-4a5d-8cb4-7eea0cb22d41") : secret "dns-default-metrics-tls" not found
Jul 21 20:40:25.196553 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:25.196511    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:25.197095 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:25.196666    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:40:25.197095 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:25.196732    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls podName:790e4ae8-009b-4a5d-8cb4-7eea0cb22d41 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:41.196716934 +0000 UTC m=+67.217125375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls") pod "dns-default-p2mfz" (UID: "790e4ae8-009b-4a5d-8cb4-7eea0cb22d41") : secret "dns-default-metrics-tls" not found
Jul 21 20:40:28.219906 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.219873    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k7k2l"]
Jul 21 20:40:28.221947 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.221917    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k7k2l"
Jul 21 20:40:28.222917 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.222899    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"]
Jul 21 20:40:28.224358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.224339    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:40:28.224358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.224353    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 21 20:40:28.224490 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.224401    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bjhvn\""
Jul 21 20:40:28.224490 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.224441    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"]
Jul 21 20:40:28.224588 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.224571    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"
Jul 21 20:40:28.226291 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.226274    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:40:28.226537 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.226515    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 21 20:40:28.227269 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.227176    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rc7qt\""
Jul 21 20:40:28.227269 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.227218    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 21 20:40:28.227402 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.227243    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:40:28.227402 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.227252    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 21 20:40:28.228412 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.228387    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 21 20:40:28.228634 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.228617    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:40:28.228847 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.228832    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 21 20:40:28.229128 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.229114    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v29tp\""
Jul 21 20:40:28.232864 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.232845    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k7k2l"]
Jul 21 20:40:28.237399 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.237378    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"]
Jul 21 20:40:28.238294 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.238275    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"]
Jul 21 20:40:28.317785 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.317758    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8ca0682-3f4e-422a-943b-7f345b0716e2-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-cjgjq\" (UID: \"d8ca0682-3f4e-422a-943b-7f345b0716e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"
Jul 21 20:40:28.317940 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.317814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwwmc\" (UniqueName: \"kubernetes.io/projected/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-kube-api-access-wwwmc\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:40:28.317940 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.317844    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:40:28.317940 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.317862    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8ca0682-3f4e-422a-943b-7f345b0716e2-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-cjgjq\" (UID: \"d8ca0682-3f4e-422a-943b-7f345b0716e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"
Jul 21 20:40:28.317940 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.317888    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkjmn\" (UniqueName: \"kubernetes.io/projected/6a47c153-818b-49de-9cde-ccb74a18f9b0-kube-api-access-pkjmn\") pod \"volume-data-source-validator-78cf4c6f6-k7k2l\" (UID: \"6a47c153-818b-49de-9cde-ccb74a18f9b0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k7k2l"
Jul 21 20:40:28.317940 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.317931    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rx2w\" (UniqueName: \"kubernetes.io/projected/d8ca0682-3f4e-422a-943b-7f345b0716e2-kube-api-access-8rx2w\") pod \"kube-storage-version-migrator-operator-7658d9b749-cjgjq\" (UID: \"d8ca0682-3f4e-422a-943b-7f345b0716e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"
Jul 21 20:40:28.418692 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.418667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:40:28.418927 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.418697    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8ca0682-3f4e-422a-943b-7f345b0716e2-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-cjgjq\" (UID: \"d8ca0682-3f4e-422a-943b-7f345b0716e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"
Jul 21 20:40:28.418927 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.418721    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkjmn\" (UniqueName: \"kubernetes.io/projected/6a47c153-818b-49de-9cde-ccb74a18f9b0-kube-api-access-pkjmn\") pod \"volume-data-source-validator-78cf4c6f6-k7k2l\" (UID: \"6a47c153-818b-49de-9cde-ccb74a18f9b0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k7k2l"
Jul 21 20:40:28.418927 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.418741    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rx2w\" (UniqueName: \"kubernetes.io/projected/d8ca0682-3f4e-422a-943b-7f345b0716e2-kube-api-access-8rx2w\") pod \"kube-storage-version-migrator-operator-7658d9b749-cjgjq\" (UID: \"d8ca0682-3f4e-422a-943b-7f345b0716e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"
Jul 21 20:40:28.418927 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.418792    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8ca0682-3f4e-422a-943b-7f345b0716e2-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-cjgjq\" (UID: \"d8ca0682-3f4e-422a-943b-7f345b0716e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"
Jul 21 20:40:28.418927 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:28.418807    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 20:40:28.418927 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.418860    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwwmc\" (UniqueName: \"kubernetes.io/projected/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-kube-api-access-wwwmc\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:40:28.418927 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:28.418917    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls podName:21b282ab-d1b5-41ca-ae2a-15148fd35fa8 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:28.918899505 +0000 UTC m=+54.939307946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2dm9d" (UID: "21b282ab-d1b5-41ca-ae2a-15148fd35fa8") : secret "samples-operator-tls" not found
Jul 21 20:40:28.419404 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.419381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d8ca0682-3f4e-422a-943b-7f345b0716e2-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-cjgjq\" (UID: \"d8ca0682-3f4e-422a-943b-7f345b0716e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"
Jul 21 20:40:28.422819 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.422796    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8ca0682-3f4e-422a-943b-7f345b0716e2-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-cjgjq\" (UID: \"d8ca0682-3f4e-422a-943b-7f345b0716e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"
Jul 21 20:40:28.424963 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.424942    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-clm54"]
Jul 21 20:40:28.426803 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.426782    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.428697 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.428676    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-858667f5f4-smlg6"]
Jul 21 20:40:28.430389 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.430369    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.431570 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.431550    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkjmn\" (UniqueName: \"kubernetes.io/projected/6a47c153-818b-49de-9cde-ccb74a18f9b0-kube-api-access-pkjmn\") pod \"volume-data-source-validator-78cf4c6f6-k7k2l\" (UID: \"6a47c153-818b-49de-9cde-ccb74a18f9b0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k7k2l"
Jul 21 20:40:28.433796 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.433778    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 21 20:40:28.433796 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.433790    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 21 20:40:28.434454 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.434433    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 21 20:40:28.434543 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.434508    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 20:40:28.434765 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.434740    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5xlxn\""
Jul 21 20:40:28.434865 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.434847    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 21 20:40:28.434930 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.434910    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:40:28.435138 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.435119    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 20:40:28.435493 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.435354    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 21 20:40:28.435493 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.435367    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 21 20:40:28.435493 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.435394    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwwmc\" (UniqueName: \"kubernetes.io/projected/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-kube-api-access-wwwmc\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:40:28.435779 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.435497    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nhbhr\""
Jul 21 20:40:28.435779 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.435514    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 21 20:40:28.436774 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.436752    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rx2w\" (UniqueName: \"kubernetes.io/projected/d8ca0682-3f4e-422a-943b-7f345b0716e2-kube-api-access-8rx2w\") pod \"kube-storage-version-migrator-operator-7658d9b749-cjgjq\" (UID: \"d8ca0682-3f4e-422a-943b-7f345b0716e2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"
Jul 21 20:40:28.444172 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.444151    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 21 20:40:28.454143 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.454122    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-858667f5f4-smlg6"]
Jul 21 20:40:28.455009 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.454989    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-clm54"]
Jul 21 20:40:28.519904 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.519845    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzcgk\" (UniqueName: \"kubernetes.io/projected/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-kube-api-access-rzcgk\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.519904 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.519898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6svs\" (UniqueName: \"kubernetes.io/projected/3406f6f7-46e6-481a-9a7d-3d30ce70130d-kube-api-access-p6svs\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.520043 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.519914    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.520043 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.519998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-default-certificate\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.520043 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.520040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3406f6f7-46e6-481a-9a7d-3d30ce70130d-config\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.520160 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.520060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3406f6f7-46e6-481a-9a7d-3d30ce70130d-serving-cert\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.520160 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.520076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.520160 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.520100    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3406f6f7-46e6-481a-9a7d-3d30ce70130d-trusted-ca\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.520160 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.520114    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-stats-auth\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.526910 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.526891    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54dc6bbdc5-66wmw"]
Jul 21 20:40:28.528730 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.528717    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.531086 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.531068    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 20:40:28.531168 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.531068    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 20:40:28.531671 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.531658    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 20:40:28.532218 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.532197    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9scjn\""
Jul 21 20:40:28.532699 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.532687    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k7k2l"
Jul 21 20:40:28.537110 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.537090    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 20:40:28.540526 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.540507    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"
Jul 21 20:40:28.548127 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.548105    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54dc6bbdc5-66wmw"]
Jul 21 20:40:28.620790 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.620767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-trusted-ca\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.620889 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.620802    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-bound-sa-token\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.620889 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.620837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzcgk\" (UniqueName: \"kubernetes.io/projected/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-kube-api-access-rzcgk\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.620889 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.620864    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-installation-pull-secrets\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.621054 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.620909    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6svs\" (UniqueName: \"kubernetes.io/projected/3406f6f7-46e6-481a-9a7d-3d30ce70130d-kube-api-access-p6svs\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.621054 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.620976    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.621054 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.621024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg6jc\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-kube-api-access-hg6jc\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.621213 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.621059    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-image-registry-private-configuration\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.621213 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.621102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.621213 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.621131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3406f6f7-46e6-481a-9a7d-3d30ce70130d-trusted-ca\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.621213 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:28.621168    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:29.121146284 +0000 UTC m=+55.141554752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : configmap references non-existent config key: service-ca.crt
Jul 21 20:40:28.621213 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.621210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-stats-auth\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.621458 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:28.621240    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 20:40:28.621458 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.621241    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-registry-certificates\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.621458 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.621336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b965d141-aad3-42c0-8032-1d092dcbeada-ca-trust-extracted\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.621458 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.621405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-default-certificate\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.621458 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.621430    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.621752 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:28.621513    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:29.121493475 +0000 UTC m=+55.141901931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : secret "router-metrics-certs-default" not found
Jul 21 20:40:28.621752 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.621614    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3406f6f7-46e6-481a-9a7d-3d30ce70130d-config\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.621752 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.621648    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3406f6f7-46e6-481a-9a7d-3d30ce70130d-serving-cert\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.622294 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.622242    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3406f6f7-46e6-481a-9a7d-3d30ce70130d-trusted-ca\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.622400 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.622325    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3406f6f7-46e6-481a-9a7d-3d30ce70130d-config\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.623922 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.623891    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-default-certificate\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.624049 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.624032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3406f6f7-46e6-481a-9a7d-3d30ce70130d-serving-cert\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.624222 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.624207    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-stats-auth\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.629388 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.629365    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6svs\" (UniqueName: \"kubernetes.io/projected/3406f6f7-46e6-481a-9a7d-3d30ce70130d-kube-api-access-p6svs\") pod \"console-operator-565b7b569d-clm54\" (UID: \"3406f6f7-46e6-481a-9a7d-3d30ce70130d\") " pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.629950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.629934    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzcgk\" (UniqueName: \"kubernetes.io/projected/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-kube-api-access-rzcgk\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:28.664219 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.664170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k7k2l"]
Jul 21 20:40:28.670005 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:40:28.669978    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a47c153_818b_49de_9cde_ccb74a18f9b0.slice/crio-b542340ae279365016264ae620138785e9ae424fc0eb2e9fa1f4c06b2fb91e05 WatchSource:0}: Error finding container b542340ae279365016264ae620138785e9ae424fc0eb2e9fa1f4c06b2fb91e05: Status 404 returned error can't find the container with id b542340ae279365016264ae620138785e9ae424fc0eb2e9fa1f4c06b2fb91e05
Jul 21 20:40:28.682430 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.682393    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq"]
Jul 21 20:40:28.685253 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:40:28.685232    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ca0682_3f4e_422a_943b_7f345b0716e2.slice/crio-a9c442adf8e5b66ba6ecdbb155e29d4f21101d1d907451cf76a1661ba291e006 WatchSource:0}: Error finding container a9c442adf8e5b66ba6ecdbb155e29d4f21101d1d907451cf76a1661ba291e006: Status 404 returned error can't find the container with id a9c442adf8e5b66ba6ecdbb155e29d4f21101d1d907451cf76a1661ba291e006
Jul 21 20:40:28.722628 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.722601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-registry-certificates\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.722719 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.722644    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b965d141-aad3-42c0-8032-1d092dcbeada-ca-trust-extracted\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.722719 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.722691    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.722800 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.722735    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-trusted-ca\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.722800 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.722760    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-bound-sa-token\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.722800 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.722789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-installation-pull-secrets\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.722952 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:28.722903    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 20:40:28.722952 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:28.722919    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dc6bbdc5-66wmw: secret "image-registry-tls" not found
Jul 21 20:40:28.723027 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:28.722970    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls podName:b965d141-aad3-42c0-8032-1d092dcbeada nodeName:}" failed. No retries permitted until 2026-07-21 20:40:29.222951071 +0000 UTC m=+55.243359526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls") pod "image-registry-54dc6bbdc5-66wmw" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada") : secret "image-registry-tls" not found
Jul 21 20:40:28.723027 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.723013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg6jc\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-kube-api-access-hg6jc\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.723133 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.723045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-image-registry-private-configuration\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.723133 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.723055    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b965d141-aad3-42c0-8032-1d092dcbeada-ca-trust-extracted\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.723260 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.723219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-registry-certificates\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.723663 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.723645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-trusted-ca\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.725176 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.725154    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-installation-pull-secrets\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.725352 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.725333    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-image-registry-private-configuration\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.732121 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.732101    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-bound-sa-token\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.732427 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.732411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg6jc\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-kube-api-access-hg6jc\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:28.750805 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.750790    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:28.824347 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.823728    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq" event={"ID":"d8ca0682-3f4e-422a-943b-7f345b0716e2","Type":"ContainerStarted","Data":"a9c442adf8e5b66ba6ecdbb155e29d4f21101d1d907451cf76a1661ba291e006"}
Jul 21 20:40:28.827664 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.827635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k7k2l" event={"ID":"6a47c153-818b-49de-9cde-ccb74a18f9b0","Type":"ContainerStarted","Data":"b542340ae279365016264ae620138785e9ae424fc0eb2e9fa1f4c06b2fb91e05"}
Jul 21 20:40:28.890023 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.889992    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-clm54"]
Jul 21 20:40:28.893519 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:40:28.893492    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3406f6f7_46e6_481a_9a7d_3d30ce70130d.slice/crio-c9caf6de4118446cb8b3beba7b5a78fe7a26546461b2c6bf431afcd45f42fb88 WatchSource:0}: Error finding container c9caf6de4118446cb8b3beba7b5a78fe7a26546461b2c6bf431afcd45f42fb88: Status 404 returned error can't find the container with id c9caf6de4118446cb8b3beba7b5a78fe7a26546461b2c6bf431afcd45f42fb88
Jul 21 20:40:28.926512 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:28.926489    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:40:28.926656 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:28.926637    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 20:40:28.926708 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:28.926696    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls podName:21b282ab-d1b5-41ca-ae2a-15148fd35fa8 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:29.926682846 +0000 UTC m=+55.947091292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2dm9d" (UID: "21b282ab-d1b5-41ca-ae2a-15148fd35fa8") : secret "samples-operator-tls" not found
Jul 21 20:40:29.128469 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:29.128427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:29.128469 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:29.128477    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:29.128667 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:29.128565    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 20:40:29.128667 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:29.128592    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:30.128575568 +0000 UTC m=+56.148984009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : configmap references non-existent config key: service-ca.crt
Jul 21 20:40:29.128667 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:29.128612    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:30.128606073 +0000 UTC m=+56.149014514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : secret "router-metrics-certs-default" not found
Jul 21 20:40:29.229180 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:29.229155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:29.229514 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:29.229287    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 20:40:29.229514 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:29.229304    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dc6bbdc5-66wmw: secret "image-registry-tls" not found
Jul 21 20:40:29.229514 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:29.229353    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls podName:b965d141-aad3-42c0-8032-1d092dcbeada nodeName:}" failed. No retries permitted until 2026-07-21 20:40:30.229337946 +0000 UTC m=+56.249746388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls") pod "image-registry-54dc6bbdc5-66wmw" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada") : secret "image-registry-tls" not found
Jul 21 20:40:29.831988 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:29.831928    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-clm54" event={"ID":"3406f6f7-46e6-481a-9a7d-3d30ce70130d","Type":"ContainerStarted","Data":"c9caf6de4118446cb8b3beba7b5a78fe7a26546461b2c6bf431afcd45f42fb88"}
Jul 21 20:40:29.937416 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:29.937383    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:40:29.937595 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:29.937564    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 20:40:29.937657 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:29.937647    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls podName:21b282ab-d1b5-41ca-ae2a-15148fd35fa8 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:31.937625677 +0000 UTC m=+57.958034133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2dm9d" (UID: "21b282ab-d1b5-41ca-ae2a-15148fd35fa8") : secret "samples-operator-tls" not found
Jul 21 20:40:30.139244 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:30.139205    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:30.139404 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:30.139270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:30.139404 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:30.139383    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:32.139360616 +0000 UTC m=+58.159769072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : configmap references non-existent config key: service-ca.crt
Jul 21 20:40:30.139528 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:30.139431    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 20:40:30.139528 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:30.139498    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:32.13947948 +0000 UTC m=+58.159887935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : secret "router-metrics-certs-default" not found
Jul 21 20:40:30.240636 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:30.240595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:30.241116 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:30.240761    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 20:40:30.241116 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:30.240782    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dc6bbdc5-66wmw: secret "image-registry-tls" not found
Jul 21 20:40:30.241116 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:30.240845    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls podName:b965d141-aad3-42c0-8032-1d092dcbeada nodeName:}" failed. No retries permitted until 2026-07-21 20:40:32.24082281 +0000 UTC m=+58.261231260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls") pod "image-registry-54dc6bbdc5-66wmw" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada") : secret "image-registry-tls" not found
Jul 21 20:40:30.836450 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:30.836415    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k7k2l" event={"ID":"6a47c153-818b-49de-9cde-ccb74a18f9b0","Type":"ContainerStarted","Data":"e71b50b90acb61587c2d95e43b8ca0db459885d0fa3d901b894a69b82fc2571f"}
Jul 21 20:40:30.853556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:30.853493    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-k7k2l" podStartSLOduration=1.48621394 podStartE2EDuration="2.85347091s" totalImagesPullingTime="1.36725697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:30.853322236 +0000 UTC m=+56.873730699" watchObservedRunningTime="2026-07-21 20:40:30.85347091 +0000 UTC m=+56.873879374"
Jul 21 20:40:31.840836 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:31.840810    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/0.log"
Jul 21 20:40:31.841336 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:31.840851    2560 generic.go:356] "Generic (PLEG): container finished" podID="3406f6f7-46e6-481a-9a7d-3d30ce70130d" containerID="3b05fe67de8d58b99835b69d1d170d6352bdbf92d57d00f568fbb01114fd4dfc" exitCode=255
Jul 21 20:40:31.841336 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:31.840884    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-clm54" event={"ID":"3406f6f7-46e6-481a-9a7d-3d30ce70130d","Type":"ContainerDied","Data":"3b05fe67de8d58b99835b69d1d170d6352bdbf92d57d00f568fbb01114fd4dfc"}
Jul 21 20:40:31.841336 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:31.841145    2560 scope.go:117] "RemoveContainer" containerID="3b05fe67de8d58b99835b69d1d170d6352bdbf92d57d00f568fbb01114fd4dfc"
Jul 21 20:40:31.842543 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:31.842518    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq" event={"ID":"d8ca0682-3f4e-422a-943b-7f345b0716e2","Type":"ContainerStarted","Data":"b5879d7fbb5a60e8f095fe7a56f1fdc787af5a1bbc19966c016b52a968b85d61"}
Jul 21 20:40:31.882077 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:31.882028    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq" podStartSLOduration=1.244943484 podStartE2EDuration="3.88201432s" totalImagesPullingTime="2.637070836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:31.881162025 +0000 UTC m=+57.901570490" watchObservedRunningTime="2026-07-21 20:40:31.88201432 +0000 UTC m=+57.902422783"
Jul 21 20:40:31.957381 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:31.957353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:40:31.957541 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:31.957519    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 20:40:31.957615 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:31.957590    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls podName:21b282ab-d1b5-41ca-ae2a-15148fd35fa8 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:35.957572148 +0000 UTC m=+61.977980607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2dm9d" (UID: "21b282ab-d1b5-41ca-ae2a-15148fd35fa8") : secret "samples-operator-tls" not found
Jul 21 20:40:32.159992 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.159910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:32.159992 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.159948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:32.160209 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:32.160064    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 20:40:32.160209 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:32.160122    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:36.16009663 +0000 UTC m=+62.180505082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : configmap references non-existent config key: service-ca.crt
Jul 21 20:40:32.160209 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:32.160156    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:36.160145537 +0000 UTC m=+62.180553984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : secret "router-metrics-certs-default" not found
Jul 21 20:40:32.261321 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.261288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:32.261454 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:32.261424    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 20:40:32.261454 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:32.261442    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dc6bbdc5-66wmw: secret "image-registry-tls" not found
Jul 21 20:40:32.261523 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:32.261500    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls podName:b965d141-aad3-42c0-8032-1d092dcbeada nodeName:}" failed. No retries permitted until 2026-07-21 20:40:36.261485367 +0000 UTC m=+62.281893825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls") pod "image-registry-54dc6bbdc5-66wmw" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada") : secret "image-registry-tls" not found
Jul 21 20:40:32.685456 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.685417    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hbxk8"]
Jul 21 20:40:32.688971 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.688943    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.692250 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.692089    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 20:40:32.692371 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.692289    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 20:40:32.692771 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.692744    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qwsp9\""
Jul 21 20:40:32.695209 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.693153    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 20:40:32.695800 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.695779    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 20:40:32.707803 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.707783    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hbxk8"]
Jul 21 20:40:32.847065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.847042    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 20:40:32.847457 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.847445    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/0.log"
Jul 21 20:40:32.847496 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.847478    2560 generic.go:356] "Generic (PLEG): container finished" podID="3406f6f7-46e6-481a-9a7d-3d30ce70130d" containerID="ed4e72656f7a86e10f3fb4b5a89c842edc27274e68888bbb92fe7c1baf3e3aae" exitCode=255
Jul 21 20:40:32.847564 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.847550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-clm54" event={"ID":"3406f6f7-46e6-481a-9a7d-3d30ce70130d","Type":"ContainerDied","Data":"ed4e72656f7a86e10f3fb4b5a89c842edc27274e68888bbb92fe7c1baf3e3aae"}
Jul 21 20:40:32.847604 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.847594    2560 scope.go:117] "RemoveContainer" containerID="3b05fe67de8d58b99835b69d1d170d6352bdbf92d57d00f568fbb01114fd4dfc"
Jul 21 20:40:32.847828 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.847812    2560 scope.go:117] "RemoveContainer" containerID="ed4e72656f7a86e10f3fb4b5a89c842edc27274e68888bbb92fe7c1baf3e3aae"
Jul 21 20:40:32.848008 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:32.847989    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-clm54_openshift-console-operator(3406f6f7-46e6-481a-9a7d-3d30ce70130d)\"" pod="openshift-console-operator/console-operator-565b7b569d-clm54" podUID="3406f6f7-46e6-481a-9a7d-3d30ce70130d"
Jul 21 20:40:32.864860 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.864838    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.864956 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.864874    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-crio-socket\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.865004 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.864955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-data-volume\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.865095 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.865007    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpc6d\" (UniqueName: \"kubernetes.io/projected/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-api-access-vpc6d\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.865095 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.865056    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.966175 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.966087    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.966175 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.966146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-crio-socket\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.966333 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.966229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-crio-socket\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.966333 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:32.966272    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:32.966425 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.966272    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-data-volume\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.966425 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:32.966342    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls podName:e9cddf20-eb0c-4623-b217-7b1fc6aee91b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:33.466321183 +0000 UTC m=+59.486729643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbxk8" (UID: "e9cddf20-eb0c-4623-b217-7b1fc6aee91b") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:32.966425 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.966387    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpc6d\" (UniqueName: \"kubernetes.io/projected/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-api-access-vpc6d\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.966570 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.966468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.966570 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.966535    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-data-volume\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:32.966682 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:32.966606    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:40:32.966682 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:32.966659    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm podName:e9cddf20-eb0c-4623-b217-7b1fc6aee91b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:33.466640097 +0000 UTC m=+59.487048539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hbxk8" (UID: "e9cddf20-eb0c-4623-b217-7b1fc6aee91b") : configmap "kube-rbac-proxy" not found
Jul 21 20:40:32.986124 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:32.986096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpc6d\" (UniqueName: \"kubernetes.io/projected/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-api-access-vpc6d\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:33.472556 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:33.472518    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:33.472705 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:33.472591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:33.472705 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:33.472664    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:33.472789 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:33.472703    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:40:33.472789 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:33.472729    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls podName:e9cddf20-eb0c-4623-b217-7b1fc6aee91b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:34.472713222 +0000 UTC m=+60.493121663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbxk8" (UID: "e9cddf20-eb0c-4623-b217-7b1fc6aee91b") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:33.472789 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:33.472751    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm podName:e9cddf20-eb0c-4623-b217-7b1fc6aee91b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:34.472739239 +0000 UTC m=+60.493147684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hbxk8" (UID: "e9cddf20-eb0c-4623-b217-7b1fc6aee91b") : configmap "kube-rbac-proxy" not found
Jul 21 20:40:33.851903 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:33.851872    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 20:40:33.852278 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:33.852238    2560 scope.go:117] "RemoveContainer" containerID="ed4e72656f7a86e10f3fb4b5a89c842edc27274e68888bbb92fe7c1baf3e3aae"
Jul 21 20:40:33.852426 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:33.852407    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-clm54_openshift-console-operator(3406f6f7-46e6-481a-9a7d-3d30ce70130d)\"" pod="openshift-console-operator/console-operator-565b7b569d-clm54" podUID="3406f6f7-46e6-481a-9a7d-3d30ce70130d"
Jul 21 20:40:34.463950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:34.463925    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhm2n_23a0b2eb-4908-4197-acb7-11dfe462f642/dns-node-resolver/0.log"
Jul 21 20:40:34.479959 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:34.479930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:34.480102 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:34.480052    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:40:34.480102 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:34.480061    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:34.480223 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:34.480110    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm podName:e9cddf20-eb0c-4623-b217-7b1fc6aee91b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:36.480093645 +0000 UTC m=+62.500502086 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hbxk8" (UID: "e9cddf20-eb0c-4623-b217-7b1fc6aee91b") : configmap "kube-rbac-proxy" not found
Jul 21 20:40:34.480223 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:34.480158    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:34.480223 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:34.480221    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls podName:e9cddf20-eb0c-4623-b217-7b1fc6aee91b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:36.480205284 +0000 UTC m=+62.500613727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbxk8" (UID: "e9cddf20-eb0c-4623-b217-7b1fc6aee91b") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:35.067268 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:35.067243    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4mcr8_ad08e483-50bc-440d-8a37-7b47614c25aa/node-ca/0.log"
Jul 21 20:40:35.759925 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:35.759902    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqbp6"
Jul 21 20:40:35.864755 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:35.864729    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ckl2m_7f7626cf-986d-42d3-8614-28c140d2491f/serve-healthcheck-canary/0.log"
Jul 21 20:40:35.989962 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:35.989931    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:40:35.990121 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:35.990075    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 20:40:35.990161 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:35.990147    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls podName:21b282ab-d1b5-41ca-ae2a-15148fd35fa8 nodeName:}" failed. No retries permitted until 2026-07-21 20:40:43.990130469 +0000 UTC m=+70.010538913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2dm9d" (UID: "21b282ab-d1b5-41ca-ae2a-15148fd35fa8") : secret "samples-operator-tls" not found
Jul 21 20:40:36.191277 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.191241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:36.191673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.191290    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:36.191673 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:36.191391    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:44.191375933 +0000 UTC m=+70.211784375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : configmap references non-existent config key: service-ca.crt
Jul 21 20:40:36.191673 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:36.191414    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 20:40:36.191673 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:36.191468    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:44.19145628 +0000 UTC m=+70.211864721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : secret "router-metrics-certs-default" not found
Jul 21 20:40:36.260140 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.260113    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-w8r2d"]
Jul 21 20:40:36.262714 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.262699    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w8r2d"
Jul 21 20:40:36.264834 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.264811    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-s4d2m\""
Jul 21 20:40:36.273324 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.273302    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-w8r2d"]
Jul 21 20:40:36.292332 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.292308    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btmqk\" (UniqueName: \"kubernetes.io/projected/de0695c6-49af-4cbd-be34-292417e5b840-kube-api-access-btmqk\") pod \"network-check-source-7bc5b6bf85-w8r2d\" (UID: \"de0695c6-49af-4cbd-be34-292417e5b840\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w8r2d"
Jul 21 20:40:36.292419 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.292365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:36.292500 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:36.292489    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 20:40:36.292543 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:36.292502    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dc6bbdc5-66wmw: secret "image-registry-tls" not found
Jul 21 20:40:36.292543 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:36.292540    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls podName:b965d141-aad3-42c0-8032-1d092dcbeada nodeName:}" failed. No retries permitted until 2026-07-21 20:40:44.292528735 +0000 UTC m=+70.312937176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls") pod "image-registry-54dc6bbdc5-66wmw" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada") : secret "image-registry-tls" not found
Jul 21 20:40:36.392723 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.392690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btmqk\" (UniqueName: \"kubernetes.io/projected/de0695c6-49af-4cbd-be34-292417e5b840-kube-api-access-btmqk\") pod \"network-check-source-7bc5b6bf85-w8r2d\" (UID: \"de0695c6-49af-4cbd-be34-292417e5b840\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w8r2d"
Jul 21 20:40:36.401222 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.401179    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 20:40:36.410967 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.410947    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 20:40:36.421811 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.421793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btmqk\" (UniqueName: \"kubernetes.io/projected/de0695c6-49af-4cbd-be34-292417e5b840-kube-api-access-btmqk\") pod \"network-check-source-7bc5b6bf85-w8r2d\" (UID: \"de0695c6-49af-4cbd-be34-292417e5b840\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w8r2d"
Jul 21 20:40:36.493680 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.493617    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:36.493787 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:36.493722    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:40:36.493787 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.493744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:36.493787 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:36.493781    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm podName:e9cddf20-eb0c-4623-b217-7b1fc6aee91b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:40.493765804 +0000 UTC m=+66.514174246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hbxk8" (UID: "e9cddf20-eb0c-4623-b217-7b1fc6aee91b") : configmap "kube-rbac-proxy" not found
Jul 21 20:40:36.493941 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:36.493875    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:36.493941 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:36.493930    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls podName:e9cddf20-eb0c-4623-b217-7b1fc6aee91b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:40.49391423 +0000 UTC m=+66.514322675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbxk8" (UID: "e9cddf20-eb0c-4623-b217-7b1fc6aee91b") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:36.571719 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.571693    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w8r2d"
Jul 21 20:40:36.694394 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.694341    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-w8r2d"]
Jul 21 20:40:36.859516 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:36.859483    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w8r2d" event={"ID":"de0695c6-49af-4cbd-be34-292417e5b840","Type":"ContainerStarted","Data":"474db75b08caee7f9c5fa98f3244be1895511b9300d38f5ac6d8ac7a2020ee49"}
Jul 21 20:40:38.751502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:38.751462    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:38.751892 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:38.751516    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:38.751892 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:38.751845    2560 scope.go:117] "RemoveContainer" containerID="ed4e72656f7a86e10f3fb4b5a89c842edc27274e68888bbb92fe7c1baf3e3aae"
Jul 21 20:40:38.752014 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:38.751988    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-clm54_openshift-console-operator(3406f6f7-46e6-481a-9a7d-3d30ce70130d)\"" pod="openshift-console-operator/console-operator-565b7b569d-clm54" podUID="3406f6f7-46e6-481a-9a7d-3d30ce70130d"
Jul 21 20:40:39.220667 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.220628    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:40:39.225454 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.225426    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 20:40:39.231722 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:39.231698    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 20:40:39.231839 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:39.231783    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs podName:0b527024-4b36-41f9-844e-c932757f0b46 nodeName:}" failed. No retries permitted until 2026-07-21 20:41:43.231763558 +0000 UTC m=+129.252171999 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs") pod "network-metrics-daemon-c6mdf" (UID: "0b527024-4b36-41f9-844e-c932757f0b46") : secret "metrics-daemon-secret" not found
Jul 21 20:40:39.321763 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.321725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:40:39.321933 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.321803    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdwwd\" (UniqueName: \"kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd\") pod \"network-check-target-zb77t\" (UID: \"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c\") " pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:40:39.324629 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.324606    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 20:40:39.324747 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.324688    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdwwd\" (UniqueName: \"kubernetes.io/projected/feb7dcaa-7396-4fb6-80d9-5ee6a08b236c-kube-api-access-kdwwd\") pod \"network-check-target-zb77t\" (UID: \"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c\") " pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:40:39.334841 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.334818    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/734e584c-d5a4-47a4-b073-00fe97a35f37-original-pull-secret\") pod \"global-pull-secret-syncer-qs2qx\" (UID: \"734e584c-d5a4-47a4-b073-00fe97a35f37\") " pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:40:39.612935 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.612904    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zdqrl\""
Jul 21 20:40:39.616505 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.616479    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qs2qx"
Jul 21 20:40:39.620923 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.620770    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:40:39.776373 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.776339    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zb77t"]
Jul 21 20:40:39.779590 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:40:39.779562    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb7dcaa_7396_4fb6_80d9_5ee6a08b236c.slice/crio-a4d49bee9767cd0254fc075962a00b307c809452c6da9b7667c4bb4d66a024a4 WatchSource:0}: Error finding container a4d49bee9767cd0254fc075962a00b307c809452c6da9b7667c4bb4d66a024a4: Status 404 returned error can't find the container with id a4d49bee9767cd0254fc075962a00b307c809452c6da9b7667c4bb4d66a024a4
Jul 21 20:40:39.786671 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.786648    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qs2qx"]
Jul 21 20:40:39.789538 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:40:39.789512    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734e584c_d5a4_47a4_b073_00fe97a35f37.slice/crio-6cb1f039f3c18d1293f833f0f23f3617b1287739422cfa1a0c5bfbf348155962 WatchSource:0}: Error finding container 6cb1f039f3c18d1293f833f0f23f3617b1287739422cfa1a0c5bfbf348155962: Status 404 returned error can't find the container with id 6cb1f039f3c18d1293f833f0f23f3617b1287739422cfa1a0c5bfbf348155962
Jul 21 20:40:39.869224 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.869181    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qs2qx" event={"ID":"734e584c-d5a4-47a4-b073-00fe97a35f37","Type":"ContainerStarted","Data":"6cb1f039f3c18d1293f833f0f23f3617b1287739422cfa1a0c5bfbf348155962"}
Jul 21 20:40:39.870608 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.870575    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w8r2d" event={"ID":"de0695c6-49af-4cbd-be34-292417e5b840","Type":"ContainerStarted","Data":"0836225497d30f380538f3482ccb90f0bc62a8d4966d983c3645fd93dec84558"}
Jul 21 20:40:39.872078 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.872053    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zb77t" event={"ID":"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c","Type":"ContainerStarted","Data":"b723ccf0ed2a064aa0fa10fc3477b62914ae0d2d3203c281f55fc0035e3089f5"}
Jul 21 20:40:39.872178 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.872098    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zb77t" event={"ID":"feb7dcaa-7396-4fb6-80d9-5ee6a08b236c","Type":"ContainerStarted","Data":"a4d49bee9767cd0254fc075962a00b307c809452c6da9b7667c4bb4d66a024a4"}
Jul 21 20:40:39.872178 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.872136    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:40:39.912082 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.912038    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-w8r2d" podStartSLOduration=1.066031097 podStartE2EDuration="3.912023662s" totalImagesPullingTime="2.845992565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:39.909205725 +0000 UTC m=+65.929614181" watchObservedRunningTime="2026-07-21 20:40:39.912023662 +0000 UTC m=+65.932432125"
Jul 21 20:40:39.947953 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:39.947904    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zb77t" podStartSLOduration=65.947888595 podStartE2EDuration="1m5.947888595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:39.946413445 +0000 UTC m=+65.966821918" watchObservedRunningTime="2026-07-21 20:40:39.947888595 +0000 UTC m=+65.968297058"
Jul 21 20:40:40.534690 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:40.534651    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:40.534897 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:40.534717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:40.534897 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:40.534791    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 20:40:40.534897 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:40.534823    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:40.534897 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:40.534865    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm podName:e9cddf20-eb0c-4623-b217-7b1fc6aee91b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:48.534844459 +0000 UTC m=+74.555252904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hbxk8" (UID: "e9cddf20-eb0c-4623-b217-7b1fc6aee91b") : configmap "kube-rbac-proxy" not found
Jul 21 20:40:40.534897 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:40.534883    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls podName:e9cddf20-eb0c-4623-b217-7b1fc6aee91b nodeName:}" failed. No retries permitted until 2026-07-21 20:40:48.534876159 +0000 UTC m=+74.555284600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbxk8" (UID: "e9cddf20-eb0c-4623-b217-7b1fc6aee91b") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:41.241130 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:41.241089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:40:41.241590 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:41.241282    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 20:40:41.241590 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:41.241356    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls podName:790e4ae8-009b-4a5d-8cb4-7eea0cb22d41 nodeName:}" failed. No retries permitted until 2026-07-21 20:41:13.241334381 +0000 UTC m=+99.261742824 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls") pod "dns-default-p2mfz" (UID: "790e4ae8-009b-4a5d-8cb4-7eea0cb22d41") : secret "dns-default-metrics-tls" not found
Jul 21 20:40:43.887975 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:43.887940    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qs2qx" event={"ID":"734e584c-d5a4-47a4-b073-00fe97a35f37","Type":"ContainerStarted","Data":"99c8638aafab9444e308b71ff60b61ce1d5b8bfd36663462496b93a95e966256"}
Jul 21 20:40:43.907816 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:43.907770    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qs2qx" podStartSLOduration=65.33163859 podStartE2EDuration="1m8.907753365s" totalImagesPullingTime="3.576114775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:39:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:43.907003598 +0000 UTC m=+69.927412062" watchObservedRunningTime="2026-07-21 20:40:43.907753365 +0000 UTC m=+69.928161828"
Jul 21 20:40:44.066342 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:44.066299    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:40:44.066517 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:44.066445    2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 21 20:40:44.066563 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:44.066520    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls podName:21b282ab-d1b5-41ca-ae2a-15148fd35fa8 nodeName:}" failed. No retries permitted until 2026-07-21 20:41:00.066504018 +0000 UTC m=+86.086912459 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-2dm9d" (UID: "21b282ab-d1b5-41ca-ae2a-15148fd35fa8") : secret "samples-operator-tls" not found
Jul 21 20:40:44.268123 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:44.268031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:44.268123 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:44.268083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:40:44.268364 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:44.268209    2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 20:40:44.268364 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:44.268276    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:41:00.268257691 +0000 UTC m=+86.288666146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : secret "router-metrics-certs-default" not found
Jul 21 20:40:44.268364 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:44.268301    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle podName:ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b nodeName:}" failed. No retries permitted until 2026-07-21 20:41:00.268282731 +0000 UTC m=+86.288691176 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle") pod "router-default-858667f5f4-smlg6" (UID: "ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b") : configmap references non-existent config key: service-ca.crt
Jul 21 20:40:44.369342 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:44.369313    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:40:44.369482 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:44.369441    2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 21 20:40:44.369482 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:44.369456    2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dc6bbdc5-66wmw: secret "image-registry-tls" not found
Jul 21 20:40:44.369569 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:44.369498    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls podName:b965d141-aad3-42c0-8032-1d092dcbeada nodeName:}" failed. No retries permitted until 2026-07-21 20:41:00.369486237 +0000 UTC m=+86.389894681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls") pod "image-registry-54dc6bbdc5-66wmw" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada") : secret "image-registry-tls" not found
Jul 21 20:40:48.605769 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:48.605729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:48.606325 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:48.605804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:48.606325 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:48.605862    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:48.606325 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:40:48.605923    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls podName:e9cddf20-eb0c-4623-b217-7b1fc6aee91b nodeName:}" failed. No retries permitted until 2026-07-21 20:41:04.605907159 +0000 UTC m=+90.626315601 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hbxk8" (UID: "e9cddf20-eb0c-4623-b217-7b1fc6aee91b") : secret "insights-runtime-extractor-tls" not found
Jul 21 20:40:48.606519 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:48.606470    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:40:53.492200 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:53.492155    2560 scope.go:117] "RemoveContainer" containerID="ed4e72656f7a86e10f3fb4b5a89c842edc27274e68888bbb92fe7c1baf3e3aae"
Jul 21 20:40:53.923725 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:53.923701    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 20:40:53.923883 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:53.923755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-clm54" event={"ID":"3406f6f7-46e6-481a-9a7d-3d30ce70130d","Type":"ContainerStarted","Data":"8f2505844f5d6d68447b31416021941fe98f8a58297132874a38b32af7ca6317"}
Jul 21 20:40:53.924036 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:53.924009    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:40:53.941350 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:53.941303    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-clm54" podStartSLOduration=23.514533669 podStartE2EDuration="25.941291451s" totalImagesPullingTime="2.426757782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:40:53.941041052 +0000 UTC m=+79.961449519" watchObservedRunningTime="2026-07-21 20:40:53.941291451 +0000 UTC m=+79.961699914"
Jul 21 20:40:54.271317 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:40:54.271233    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-clm54"
Jul 21 20:41:00.097302 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.097141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:41:00.099636 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.099610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/21b282ab-d1b5-41ca-ae2a-15148fd35fa8-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-2dm9d\" (UID: \"21b282ab-d1b5-41ca-ae2a-15148fd35fa8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:41:00.298141 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.298107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:41:00.298141 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.298147    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:41:00.298735 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.298710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-service-ca-bundle\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:41:00.300580 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.300558    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b-metrics-certs\") pod \"router-default-858667f5f4-smlg6\" (UID: \"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b\") " pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:41:00.348697 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.348625    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-v29tp\""
Jul 21 20:41:00.356573 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.356555    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"
Jul 21 20:41:00.378774 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.378747    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54dc6bbdc5-66wmw"]
Jul 21 20:41:00.378980 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:41:00.378961    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw" podUID="b965d141-aad3-42c0-8032-1d092dcbeada"
Jul 21 20:41:00.398872 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.398841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:41:00.401252 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.401230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls\") pod \"image-registry-54dc6bbdc5-66wmw\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") " pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:41:00.453565 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.452648    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-fljcg"]
Jul 21 20:41:00.456631 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.456612    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fljcg"
Jul 21 20:41:00.459489 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.459452    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 20:41:00.459715 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.459699    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 20:41:00.459951 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.459932    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-69stj\""
Jul 21 20:41:00.485458 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.485426    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fljcg"]
Jul 21 20:41:00.519078 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.519052    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d"]
Jul 21 20:41:00.561082 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.561061    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nhbhr\""
Jul 21 20:41:00.566746 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.566727    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:41:00.600474 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.600415    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2cfn\" (UniqueName: \"kubernetes.io/projected/e6930338-b310-4e27-a51d-353a3df90ffc-kube-api-access-n2cfn\") pod \"downloads-5bc67dcd46-fljcg\" (UID: \"e6930338-b310-4e27-a51d-353a3df90ffc\") " pod="openshift-console/downloads-5bc67dcd46-fljcg"
Jul 21 20:41:00.694928 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.694898    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-858667f5f4-smlg6"]
Jul 21 20:41:00.698392 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:00.698365    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea61a2d0_1cb4_49a1_9ce7_a6d7d66ea13b.slice/crio-bdc6c943f93280cf96b1a07e84c604cf6d1d921d7c435416b5b1c2a245a06d57 WatchSource:0}: Error finding container bdc6c943f93280cf96b1a07e84c604cf6d1d921d7c435416b5b1c2a245a06d57: Status 404 returned error can't find the container with id bdc6c943f93280cf96b1a07e84c604cf6d1d921d7c435416b5b1c2a245a06d57
Jul 21 20:41:00.700726 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.700706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2cfn\" (UniqueName: \"kubernetes.io/projected/e6930338-b310-4e27-a51d-353a3df90ffc-kube-api-access-n2cfn\") pod \"downloads-5bc67dcd46-fljcg\" (UID: \"e6930338-b310-4e27-a51d-353a3df90ffc\") " pod="openshift-console/downloads-5bc67dcd46-fljcg"
Jul 21 20:41:00.712478 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.712459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2cfn\" (UniqueName: \"kubernetes.io/projected/e6930338-b310-4e27-a51d-353a3df90ffc-kube-api-access-n2cfn\") pod \"downloads-5bc67dcd46-fljcg\" (UID: \"e6930338-b310-4e27-a51d-353a3df90ffc\") " pod="openshift-console/downloads-5bc67dcd46-fljcg"
Jul 21 20:41:00.769006 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.767061    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fljcg"
Jul 21 20:41:00.900084 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.900060    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fljcg"]
Jul 21 20:41:00.902400 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:00.902370    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6930338_b310_4e27_a51d_353a3df90ffc.slice/crio-f47a91cfb49462e6db73e3a0314259801ec0d26cdca6cf676d7e923fc0da152b WatchSource:0}: Error finding container f47a91cfb49462e6db73e3a0314259801ec0d26cdca6cf676d7e923fc0da152b: Status 404 returned error can't find the container with id f47a91cfb49462e6db73e3a0314259801ec0d26cdca6cf676d7e923fc0da152b
Jul 21 20:41:00.944645 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.944607    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fljcg" event={"ID":"e6930338-b310-4e27-a51d-353a3df90ffc","Type":"ContainerStarted","Data":"f47a91cfb49462e6db73e3a0314259801ec0d26cdca6cf676d7e923fc0da152b"}
Jul 21 20:41:00.946023 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.946001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-858667f5f4-smlg6" event={"ID":"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b","Type":"ContainerStarted","Data":"d18271933d720ff6f5aaf6a45d12e067723d12247b04c1a81c5dd0e7ddb7d3aa"}
Jul 21 20:41:00.946133 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.946038    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-858667f5f4-smlg6" event={"ID":"ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b","Type":"ContainerStarted","Data":"bdc6c943f93280cf96b1a07e84c604cf6d1d921d7c435416b5b1c2a245a06d57"}
Jul 21 20:41:00.947111 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.947091    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:41:00.947221 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.947106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d" event={"ID":"21b282ab-d1b5-41ca-ae2a-15148fd35fa8","Type":"ContainerStarted","Data":"95701e2660783c1ca9b95f6dac705ae29e73df3162b839a2a32e312088cb359a"}
Jul 21 20:41:00.954661 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.954644    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:41:00.975900 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:00.975860    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-858667f5f4-smlg6" podStartSLOduration=32.975849728 podStartE2EDuration="32.975849728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:00.975661795 +0000 UTC m=+86.996070257" watchObservedRunningTime="2026-07-21 20:41:00.975849728 +0000 UTC m=+86.996258200"
Jul 21 20:41:01.104497 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.104464    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-registry-certificates\") pod \"b965d141-aad3-42c0-8032-1d092dcbeada\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") "
Jul 21 20:41:01.104497 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.104502    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-installation-pull-secrets\") pod \"b965d141-aad3-42c0-8032-1d092dcbeada\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") "
Jul 21 20:41:01.104950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.104539    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-bound-sa-token\") pod \"b965d141-aad3-42c0-8032-1d092dcbeada\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") "
Jul 21 20:41:01.104950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.104572    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b965d141-aad3-42c0-8032-1d092dcbeada-ca-trust-extracted\") pod \"b965d141-aad3-42c0-8032-1d092dcbeada\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") "
Jul 21 20:41:01.104950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.104623    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls\") pod \"b965d141-aad3-42c0-8032-1d092dcbeada\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") "
Jul 21 20:41:01.104950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.104647    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-trusted-ca\") pod \"b965d141-aad3-42c0-8032-1d092dcbeada\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") "
Jul 21 20:41:01.104950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.104693    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-image-registry-private-configuration\") pod \"b965d141-aad3-42c0-8032-1d092dcbeada\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") "
Jul 21 20:41:01.104950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.104717    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg6jc\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-kube-api-access-hg6jc\") pod \"b965d141-aad3-42c0-8032-1d092dcbeada\" (UID: \"b965d141-aad3-42c0-8032-1d092dcbeada\") "
Jul 21 20:41:01.104950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.104862    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b965d141-aad3-42c0-8032-1d092dcbeada" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:41:01.105383 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.105052    2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-registry-certificates\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:01.105383 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.105135    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b965d141-aad3-42c0-8032-1d092dcbeada" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:41:01.106009 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.105932    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b965d141-aad3-42c0-8032-1d092dcbeada-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b965d141-aad3-42c0-8032-1d092dcbeada" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 20:41:01.107283 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.107256    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b965d141-aad3-42c0-8032-1d092dcbeada" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:41:01.107436 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.107416    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b965d141-aad3-42c0-8032-1d092dcbeada" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:41:01.107501 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.107443    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b965d141-aad3-42c0-8032-1d092dcbeada" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:41:01.107688 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.107666    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b965d141-aad3-42c0-8032-1d092dcbeada" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:41:01.107917 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.107901    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-kube-api-access-hg6jc" (OuterVolumeSpecName: "kube-api-access-hg6jc") pod "b965d141-aad3-42c0-8032-1d092dcbeada" (UID: "b965d141-aad3-42c0-8032-1d092dcbeada"). InnerVolumeSpecName "kube-api-access-hg6jc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:41:01.206462 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.206375    2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-installation-pull-secrets\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:01.206462 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.206412    2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-bound-sa-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:01.206462 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.206427    2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b965d141-aad3-42c0-8032-1d092dcbeada-ca-trust-extracted\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:01.206462 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.206442    2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-registry-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:01.206462 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.206455    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b965d141-aad3-42c0-8032-1d092dcbeada-trusted-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:01.206955 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.206467    2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b965d141-aad3-42c0-8032-1d092dcbeada-image-registry-private-configuration\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:01.206955 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.206482    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg6jc\" (UniqueName: \"kubernetes.io/projected/b965d141-aad3-42c0-8032-1d092dcbeada-kube-api-access-hg6jc\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:01.567429 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.567394    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:41:01.570038 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.570015    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:41:01.951111 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.951023    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dc6bbdc5-66wmw"
Jul 21 20:41:01.951622 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.951571    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:41:01.952967 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:01.952943    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-858667f5f4-smlg6"
Jul 21 20:41:02.013745 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.013711    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-668cf55fb5-xllvv"]
Jul 21 20:41:02.017166 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.017144    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.019973 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.019949    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 20:41:02.020283 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.020263    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 20:41:02.020371 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.020294    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gqjdc\""
Jul 21 20:41:02.020618 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.020594    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 20:41:02.021036 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.020792    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 20:41:02.021036 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.020841    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 20:41:02.026353 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.026333    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54dc6bbdc5-66wmw"]
Jul 21 20:41:02.027395 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.027362    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54dc6bbdc5-66wmw"]
Jul 21 20:41:02.032412 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.032392    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668cf55fb5-xllvv"]
Jul 21 20:41:02.114116 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.114076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-serving-cert\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.114553 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.114176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-config\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.114553 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.114228    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-service-ca\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.114553 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.114375    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-oauth-config\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.114553 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.114446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-oauth-serving-cert\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.114553 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.114501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtnqf\" (UniqueName: \"kubernetes.io/projected/0ccb5ac9-5026-45af-955e-4947c6923b9a-kube-api-access-wtnqf\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.215961 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.215208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-config\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.215961 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.215270    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-service-ca\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.215961 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.215307    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-oauth-config\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.215961 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.215368    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-oauth-serving-cert\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.215961 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.215399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtnqf\" (UniqueName: \"kubernetes.io/projected/0ccb5ac9-5026-45af-955e-4947c6923b9a-kube-api-access-wtnqf\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.215961 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.215459    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-serving-cert\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.216433 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.216290    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-config\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.216916 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.216858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-oauth-serving-cert\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.217616 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.217574    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-service-ca\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.219045 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.219025    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-oauth-config\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.219473 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.219447    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-serving-cert\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.224865 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.224841    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtnqf\" (UniqueName: \"kubernetes.io/projected/0ccb5ac9-5026-45af-955e-4947c6923b9a-kube-api-access-wtnqf\") pod \"console-668cf55fb5-xllvv\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") " pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.329158 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.329119    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:02.496104 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.496023    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b965d141-aad3-42c0-8032-1d092dcbeada" path="/var/lib/kubelet/pods/b965d141-aad3-42c0-8032-1d092dcbeada/volumes"
Jul 21 20:41:02.788067 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.787883    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668cf55fb5-xllvv"]
Jul 21 20:41:02.790870 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:02.790846    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ccb5ac9_5026_45af_955e_4947c6923b9a.slice/crio-a7b67a97256b26937b7106b606c44875207a37ade8c878b6f3cd1c9e9fd6246b WatchSource:0}: Error finding container a7b67a97256b26937b7106b606c44875207a37ade8c878b6f3cd1c9e9fd6246b: Status 404 returned error can't find the container with id a7b67a97256b26937b7106b606c44875207a37ade8c878b6f3cd1c9e9fd6246b
Jul 21 20:41:02.956388 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.956349    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cf55fb5-xllvv" event={"ID":"0ccb5ac9-5026-45af-955e-4947c6923b9a","Type":"ContainerStarted","Data":"a7b67a97256b26937b7106b606c44875207a37ade8c878b6f3cd1c9e9fd6246b"}
Jul 21 20:41:02.958563 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.958512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d" event={"ID":"21b282ab-d1b5-41ca-ae2a-15148fd35fa8","Type":"ContainerStarted","Data":"d9f46600bf51a67c4663051239f557c2b342377d159e93110c9ddd793fb83956"}
Jul 21 20:41:02.958799 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.958584    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d" event={"ID":"21b282ab-d1b5-41ca-ae2a-15148fd35fa8","Type":"ContainerStarted","Data":"8baff41205a48b86228595a2ac93cd540a5520a56746493e81e46bf6c1d4a2cc"}
Jul 21 20:41:02.980845 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:02.980796    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-2dm9d" podStartSLOduration=32.836232865 podStartE2EDuration="34.980779812s" totalImagesPullingTime="2.144546947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:02.978934387 +0000 UTC m=+88.999342841" watchObservedRunningTime="2026-07-21 20:41:02.980779812 +0000 UTC m=+89.001188277"
Jul 21 20:41:03.985141 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:03.985085    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7679bdf-mmkdd"]
Jul 21 20:41:04.000365 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.000333    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.006031 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.006004    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7679bdf-mmkdd"]
Jul 21 20:41:04.009730 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.009699    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 20:41:04.131726 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.131690    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6trwc\" (UniqueName: \"kubernetes.io/projected/2922e731-01bf-4138-adcf-fc36405dc4d3-kube-api-access-6trwc\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.131908 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.131759    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-console-config\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.131908 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.131793    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-trusted-ca-bundle\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.131908 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.131868    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-serving-cert\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.132067 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.131964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-service-ca\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.132067 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.132006    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-oauth-serving-cert\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.132067 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.132038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-oauth-config\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.233312 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.233265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-oauth-serving-cert\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.233494 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.233322    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-oauth-config\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.233494 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.233357    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6trwc\" (UniqueName: \"kubernetes.io/projected/2922e731-01bf-4138-adcf-fc36405dc4d3-kube-api-access-6trwc\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.233610 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.233493    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-console-config\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.233610 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.233530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-trusted-ca-bundle\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.233610 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.233587    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-serving-cert\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.233765 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.233644    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-service-ca\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.234135 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.234100    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-oauth-serving-cert\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.234351 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.234326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-service-ca\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.234437 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.234409    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-trusted-ca-bundle\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.234759 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.234736    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-console-config\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.236788 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.236718    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-serving-cert\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.237332 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.237308    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-oauth-config\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.242266 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.242247    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6trwc\" (UniqueName: \"kubernetes.io/projected/2922e731-01bf-4138-adcf-fc36405dc4d3-kube-api-access-6trwc\") pod \"console-7679bdf-mmkdd\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") " pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.314094 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.313878    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:04.465660 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.465614    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7679bdf-mmkdd"]
Jul 21 20:41:04.469790 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:04.469751    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2922e731_01bf_4138_adcf_fc36405dc4d3.slice/crio-0479c747a3570078bd3b0ab379d65501b0f74736db1919e6fb7fe56db59409b9 WatchSource:0}: Error finding container 0479c747a3570078bd3b0ab379d65501b0f74736db1919e6fb7fe56db59409b9: Status 404 returned error can't find the container with id 0479c747a3570078bd3b0ab379d65501b0f74736db1919e6fb7fe56db59409b9
Jul 21 20:41:04.636994 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.636952    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:41:04.640885 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.640856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e9cddf20-eb0c-4623-b217-7b1fc6aee91b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hbxk8\" (UID: \"e9cddf20-eb0c-4623-b217-7b1fc6aee91b\") " pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:41:04.804664 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.804627    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qwsp9\""
Jul 21 20:41:04.812653 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.812623    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hbxk8"
Jul 21 20:41:04.968009 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:04.967923    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7679bdf-mmkdd" event={"ID":"2922e731-01bf-4138-adcf-fc36405dc4d3","Type":"ContainerStarted","Data":"0479c747a3570078bd3b0ab379d65501b0f74736db1919e6fb7fe56db59409b9"}
Jul 21 20:41:05.465652 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:05.465622    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx"]
Jul 21 20:41:05.468613 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:05.468586    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx"
Jul 21 20:41:05.474545 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:05.471279    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 21 20:41:05.474545 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:05.471554    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hmqzj\""
Jul 21 20:41:05.481825 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:05.481346    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx"]
Jul 21 20:41:05.546578 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:05.546522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d85b877-8d6c-40d5-98e4-77128dd846ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2d2qx\" (UID: \"8d85b877-8d6c-40d5-98e4-77128dd846ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx"
Jul 21 20:41:05.646999 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:05.646963    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d85b877-8d6c-40d5-98e4-77128dd846ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2d2qx\" (UID: \"8d85b877-8d6c-40d5-98e4-77128dd846ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx"
Jul 21 20:41:05.647161 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:41:05.647100    2560 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 20:41:05.647239 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:41:05.647175    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d85b877-8d6c-40d5-98e4-77128dd846ef-tls-certificates podName:8d85b877-8d6c-40d5-98e4-77128dd846ef nodeName:}" failed. No retries permitted until 2026-07-21 20:41:06.147154942 +0000 UTC m=+92.167563383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8d85b877-8d6c-40d5-98e4-77128dd846ef-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-2d2qx" (UID: "8d85b877-8d6c-40d5-98e4-77128dd846ef") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 21 20:41:06.147409 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:06.147283    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hbxk8"]
Jul 21 20:41:06.152374 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:06.151898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d85b877-8d6c-40d5-98e4-77128dd846ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2d2qx\" (UID: \"8d85b877-8d6c-40d5-98e4-77128dd846ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx"
Jul 21 20:41:06.152593 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:06.152541    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9cddf20_eb0c_4623_b217_7b1fc6aee91b.slice/crio-a10b1f4092f3379aac6c69c2156ef39ee6689eb2b8139fd96302e6b05b2b976a WatchSource:0}: Error finding container a10b1f4092f3379aac6c69c2156ef39ee6689eb2b8139fd96302e6b05b2b976a: Status 404 returned error can't find the container with id a10b1f4092f3379aac6c69c2156ef39ee6689eb2b8139fd96302e6b05b2b976a
Jul 21 20:41:06.154786 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:06.154725    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d85b877-8d6c-40d5-98e4-77128dd846ef-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-2d2qx\" (UID: \"8d85b877-8d6c-40d5-98e4-77128dd846ef\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx"
Jul 21 20:41:06.382489 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:06.382440    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx"
Jul 21 20:41:06.528952 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:06.528819    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx"]
Jul 21 20:41:06.532671 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:06.532639    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d85b877_8d6c_40d5_98e4_77128dd846ef.slice/crio-ec5d7592631543bd836f8a74e97ef57b7175dc03d84771cb354b7e5a4fa20b73 WatchSource:0}: Error finding container ec5d7592631543bd836f8a74e97ef57b7175dc03d84771cb354b7e5a4fa20b73: Status 404 returned error can't find the container with id ec5d7592631543bd836f8a74e97ef57b7175dc03d84771cb354b7e5a4fa20b73
Jul 21 20:41:06.985808 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:06.985389    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cf55fb5-xllvv" event={"ID":"0ccb5ac9-5026-45af-955e-4947c6923b9a","Type":"ContainerStarted","Data":"ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4"}
Jul 21 20:41:06.987206 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:06.987146    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbxk8" event={"ID":"e9cddf20-eb0c-4623-b217-7b1fc6aee91b","Type":"ContainerStarted","Data":"a10b1f4092f3379aac6c69c2156ef39ee6689eb2b8139fd96302e6b05b2b976a"}
Jul 21 20:41:06.989416 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:06.989383    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7679bdf-mmkdd" event={"ID":"2922e731-01bf-4138-adcf-fc36405dc4d3","Type":"ContainerStarted","Data":"574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a"}
Jul 21 20:41:06.990883 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:06.990862    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx" event={"ID":"8d85b877-8d6c-40d5-98e4-77128dd846ef","Type":"ContainerStarted","Data":"ec5d7592631543bd836f8a74e97ef57b7175dc03d84771cb354b7e5a4fa20b73"}
Jul 21 20:41:07.030301 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:07.030242    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7679bdf-mmkdd" podStartSLOduration=2.49653411 podStartE2EDuration="4.030222344s" totalImagesPullingTime="1.533688234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:07.027896159 +0000 UTC m=+93.048304623" watchObservedRunningTime="2026-07-21 20:41:07.030222344 +0000 UTC m=+93.050630808"
Jul 21 20:41:07.030479 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:07.030400    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-668cf55fb5-xllvv" podStartSLOduration=2.8179248660000003 podStartE2EDuration="6.030387939s" totalImagesPullingTime="3.212463073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:41:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:07.00775008 +0000 UTC m=+93.028158545" watchObservedRunningTime="2026-07-21 20:41:07.030387939 +0000 UTC m=+93.050796406"
Jul 21 20:41:09.001180 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.001140    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx" event={"ID":"8d85b877-8d6c-40d5-98e4-77128dd846ef","Type":"ContainerStarted","Data":"affa64af5926989614a1f694f204b2991f9d5a383cdcea10fbff7fc7edcf5767"}
Jul 21 20:41:09.001633 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.001323    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx"
Jul 21 20:41:09.007339 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.007303    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx"
Jul 21 20:41:09.021955 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.021894    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-2d2qx" podStartSLOduration=2.618080709 podStartE2EDuration="4.021874261s" totalImagesPullingTime="1.403793552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:09.021530165 +0000 UTC m=+95.041938628" watchObservedRunningTime="2026-07-21 20:41:09.021874261 +0000 UTC m=+95.042282725"
Jul 21 20:41:09.532309 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.532244    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"]
Jul 21 20:41:09.551574 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.551545    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.555756 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.555731    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 21 20:41:09.556680 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.556563    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 21 20:41:09.556808 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.556045    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w64jz\""
Jul 21 20:41:09.556808 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.555972    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"]
Jul 21 20:41:09.556921 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.556489    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 20:41:09.556921 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.556245    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 20:41:09.556921 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.556505    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 20:41:09.687574 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.687534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9b1384b-6791-4ea2-a913-866e5fb4eeff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.687753 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.687586    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9b1384b-6791-4ea2-a913-866e5fb4eeff-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.687753 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.687645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9b1384b-6791-4ea2-a913-866e5fb4eeff-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.687753 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.687677    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c85gz\" (UniqueName: \"kubernetes.io/projected/d9b1384b-6791-4ea2-a913-866e5fb4eeff-kube-api-access-c85gz\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.788982 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.788900    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c85gz\" (UniqueName: \"kubernetes.io/projected/d9b1384b-6791-4ea2-a913-866e5fb4eeff-kube-api-access-c85gz\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.789143 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.789012    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9b1384b-6791-4ea2-a913-866e5fb4eeff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.789143 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.789044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9b1384b-6791-4ea2-a913-866e5fb4eeff-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.789143 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.789089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9b1384b-6791-4ea2-a913-866e5fb4eeff-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.789897 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.789844    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9b1384b-6791-4ea2-a913-866e5fb4eeff-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.792389 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.792349    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9b1384b-6791-4ea2-a913-866e5fb4eeff-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.793167 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.793142    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9b1384b-6791-4ea2-a913-866e5fb4eeff-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.804854 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.804830    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c85gz\" (UniqueName: \"kubernetes.io/projected/d9b1384b-6791-4ea2-a913-866e5fb4eeff-kube-api-access-c85gz\") pod \"prometheus-operator-5945b5cfd-pwp2c\" (UID: \"d9b1384b-6791-4ea2-a913-866e5fb4eeff\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:09.867825 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:09.867788    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"
Jul 21 20:41:10.880360 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:10.880327    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zb77t"
Jul 21 20:41:11.907745 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:11.907714    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c"]
Jul 21 20:41:11.910830 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:11.910804    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b1384b_6791_4ea2_a913_866e5fb4eeff.slice/crio-9049ba610d7f9e96efb1cac1bbd7de6df2241fcddcda76a23a40fed1131b95c1 WatchSource:0}: Error finding container 9049ba610d7f9e96efb1cac1bbd7de6df2241fcddcda76a23a40fed1131b95c1: Status 404 returned error can't find the container with id 9049ba610d7f9e96efb1cac1bbd7de6df2241fcddcda76a23a40fed1131b95c1
Jul 21 20:41:12.015057 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:12.015020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbxk8" event={"ID":"e9cddf20-eb0c-4623-b217-7b1fc6aee91b","Type":"ContainerStarted","Data":"4ee9937f32529d583cbe3d9ebda5c97c9395aeb9dc5f97b80c82af5bd8a37e1e"}
Jul 21 20:41:12.016358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:12.016329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c" event={"ID":"d9b1384b-6791-4ea2-a913-866e5fb4eeff","Type":"ContainerStarted","Data":"9049ba610d7f9e96efb1cac1bbd7de6df2241fcddcda76a23a40fed1131b95c1"}
Jul 21 20:41:12.329540 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:12.329499    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:12.329739 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:12.329578    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:12.335226 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:12.335205    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:13.025365 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:13.025335    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:13.320568 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:13.320533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:41:13.323017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:13.322988    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/790e4ae8-009b-4a5d-8cb4-7eea0cb22d41-metrics-tls\") pod \"dns-default-p2mfz\" (UID: \"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41\") " pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:41:13.544843 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:13.544811    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lm6sh\""
Jul 21 20:41:13.552031 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:13.552002    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:41:14.314477 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:14.314444    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:14.314928 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:14.314509    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:14.319885 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:14.319861    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:15.033368 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:15.033335    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:41:15.078534 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:15.078499    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668cf55fb5-xllvv"]
Jul 21 20:41:19.007052 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:19.006541    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p2mfz"]
Jul 21 20:41:19.010089 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:19.009905    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790e4ae8_009b_4a5d_8cb4_7eea0cb22d41.slice/crio-d2b13647a0a86bcacf6d819af556143c7459c834153aad676cbf568b1873556b WatchSource:0}: Error finding container d2b13647a0a86bcacf6d819af556143c7459c834153aad676cbf568b1873556b: Status 404 returned error can't find the container with id d2b13647a0a86bcacf6d819af556143c7459c834153aad676cbf568b1873556b
Jul 21 20:41:19.056089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:19.052454    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p2mfz" event={"ID":"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41","Type":"ContainerStarted","Data":"d2b13647a0a86bcacf6d819af556143c7459c834153aad676cbf568b1873556b"}
Jul 21 20:41:20.063758 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:20.063717    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fljcg" event={"ID":"e6930338-b310-4e27-a51d-353a3df90ffc","Type":"ContainerStarted","Data":"2023e4efaed2ff987dc52725352b3d30f7bfe88cf9cde18376ce1b895bd7da4e"}
Jul 21 20:41:20.065065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:20.064457    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-fljcg"
Jul 21 20:41:20.070216 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:20.070174    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-fljcg"
Jul 21 20:41:20.147807 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:20.147297    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-fljcg" podStartSLOduration=2.082955599 podStartE2EDuration="20.147274464s" totalImagesPullingTime="18.064318865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:20.098272324 +0000 UTC m=+106.118680787" watchObservedRunningTime="2026-07-21 20:41:20.147274464 +0000 UTC m=+106.167682930"
Jul 21 20:41:25.091055 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:25.091015    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbxk8" event={"ID":"e9cddf20-eb0c-4623-b217-7b1fc6aee91b","Type":"ContainerStarted","Data":"43370daebc2a352ac3de17d15e97e7241a204c7a9fe67b9443489ad98950e79d"}
Jul 21 20:41:25.093300 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:25.093269    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p2mfz" event={"ID":"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41","Type":"ContainerStarted","Data":"c3ba663c49e332a3726e0f044b16a17676b32639215137fbb90473e1b8b1d15e"}
Jul 21 20:41:25.093436 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:25.093321    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p2mfz" event={"ID":"790e4ae8-009b-4a5d-8cb4-7eea0cb22d41","Type":"ContainerStarted","Data":"de2121de00ef7c1fb6a7cf1fb14d8a0c786c4a94fbcbb89c1a02896f81c3919a"}
Jul 21 20:41:25.093436 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:25.093375    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:41:25.095672 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:25.095643    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c" event={"ID":"d9b1384b-6791-4ea2-a913-866e5fb4eeff","Type":"ContainerStarted","Data":"ef93ddcc8babdcd74ab4cea361ee01016dfadcd26a0f05163c2071d0e7d12f50"}
Jul 21 20:41:25.095753 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:25.095688    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c" event={"ID":"d9b1384b-6791-4ea2-a913-866e5fb4eeff","Type":"ContainerStarted","Data":"67900e2cb6fca590c4440d8e2a4c597c4a6b22502afda875c5df9e0d8156c500"}
Jul 21 20:41:25.127884 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:25.127824    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p2mfz" podStartSLOduration=70.454424578 podStartE2EDuration="1m16.127804219s" totalImagesPullingTime="5.673379641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:25.126700422 +0000 UTC m=+111.147108896" watchObservedRunningTime="2026-07-21 20:41:25.127804219 +0000 UTC m=+111.148212683"
Jul 21 20:41:26.915677 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.915613    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-pwp2c" podStartSLOduration=5.150246039 podStartE2EDuration="17.915590691s" totalImagesPullingTime="12.765344652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:25.162294131 +0000 UTC m=+111.182702595" watchObservedRunningTime="2026-07-21 20:41:26.915590691 +0000 UTC m=+112.935999155"
Jul 21 20:41:26.916273 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.916078    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-627hl"]
Jul 21 20:41:26.938950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.938906    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-627hl"]
Jul 21 20:41:26.939109 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.939034    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:26.942882 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.942854    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 21 20:41:26.943105 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.943089    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7hqdv\""
Jul 21 20:41:26.943485 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.943385    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 21 20:41:26.943644 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.943625    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 21 20:41:26.959994 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.959943    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7s7hw"]
Jul 21 20:41:26.980430 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.980405    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:26.982553 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.982532    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j5gnj\""
Jul 21 20:41:26.983312 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.983240    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 20:41:26.984021 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.983599    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 20:41:26.984021 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:26.983832    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 20:41:27.050967 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.050931    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2aff829-77be-4510-bca7-37840fc5e7b2-sys\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.051162 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.050985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.051162 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.051162 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051049    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2aff829-77be-4510-bca7-37840fc5e7b2-root\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.051162 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051086    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.051162 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051110    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.051162 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051140    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmrls\" (UniqueName: \"kubernetes.io/projected/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-api-access-mmrls\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.051162 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051163    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-textfile\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.051654 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051210    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.051654 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051241    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6ceef5da-a77f-4254-a857-b151c1c34c96-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.051654 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xknpd\" (UniqueName: \"kubernetes.io/projected/f2aff829-77be-4510-bca7-37840fc5e7b2-kube-api-access-xknpd\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.051654 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2aff829-77be-4510-bca7-37840fc5e7b2-metrics-client-ca\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.051654 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051382    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ceef5da-a77f-4254-a857-b151c1c34c96-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.051654 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051415    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-wtmp\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.051654 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.051464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-tls\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.152801 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.152761    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ceef5da-a77f-4254-a857-b151c1c34c96-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.152801 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.152809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-wtmp\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153032 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.152851    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-tls\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153032 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.152887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2aff829-77be-4510-bca7-37840fc5e7b2-sys\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153032 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.152915    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153032 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.152942    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153032 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.152968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2aff829-77be-4510-bca7-37840fc5e7b2-root\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153032 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153009    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.153358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153037    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-wtmp\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153358 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:41:27.153067    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 20:41:27.153358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2aff829-77be-4510-bca7-37840fc5e7b2-root\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153358 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:41:27.153140    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-tls podName:f2aff829-77be-4510-bca7-37840fc5e7b2 nodeName:}" failed. No retries permitted until 2026-07-21 20:41:27.653119257 +0000 UTC m=+113.673527703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-tls") pod "node-exporter-7s7hw" (UID: "f2aff829-77be-4510-bca7-37840fc5e7b2") : secret "node-exporter-tls" not found
Jul 21 20:41:27.153358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.153358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmrls\" (UniqueName: \"kubernetes.io/projected/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-api-access-mmrls\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.153358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153245    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-textfile\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.153358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6ceef5da-a77f-4254-a857-b151c1c34c96-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.153358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153333    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xknpd\" (UniqueName: \"kubernetes.io/projected/f2aff829-77be-4510-bca7-37840fc5e7b2-kube-api-access-xknpd\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153364    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2aff829-77be-4510-bca7-37840fc5e7b2-metrics-client-ca\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153874 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153005    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2aff829-77be-4510-bca7-37840fc5e7b2-sys\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153874 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153691    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153874 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-textfile\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.153874 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153786    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6ceef5da-a77f-4254-a857-b151c1c34c96-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.154062 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.153896    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2aff829-77be-4510-bca7-37840fc5e7b2-metrics-client-ca\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.154351 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.154327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ceef5da-a77f-4254-a857-b151c1c34c96-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.154529 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.154468    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.155936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.155911    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.156430 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.156384    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.156725 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.156684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.164893 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.164856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xknpd\" (UniqueName: \"kubernetes.io/projected/f2aff829-77be-4510-bca7-37840fc5e7b2-kube-api-access-xknpd\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.166531 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.166483    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmrls\" (UniqueName: \"kubernetes.io/projected/6ceef5da-a77f-4254-a857-b151c1c34c96-kube-api-access-mmrls\") pod \"kube-state-metrics-56c5594674-627hl\" (UID: \"6ceef5da-a77f-4254-a857-b151c1c34c96\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.252718 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.252679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl"
Jul 21 20:41:27.658836 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.658796    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-tls\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.661776 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.661619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2aff829-77be-4510-bca7-37840fc5e7b2-node-exporter-tls\") pod \"node-exporter-7s7hw\" (UID: \"f2aff829-77be-4510-bca7-37840fc5e7b2\") " pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:27.893136 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:27.893096    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7s7hw"
Jul 21 20:41:29.221890 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:29.221856    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2aff829_77be_4510_bca7_37840fc5e7b2.slice/crio-3649c5dd35b823ba375bd43feae91e9150adff4c8d0cceb11746b03314da10ae WatchSource:0}: Error finding container 3649c5dd35b823ba375bd43feae91e9150adff4c8d0cceb11746b03314da10ae: Status 404 returned error can't find the container with id 3649c5dd35b823ba375bd43feae91e9150adff4c8d0cceb11746b03314da10ae
Jul 21 20:41:29.357278 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:29.357254    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-627hl"]
Jul 21 20:41:29.359936 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:29.359903    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ceef5da_a77f_4254_a857_b151c1c34c96.slice/crio-cc8756e12779539274fc1d8e7ffc369c38722715999de8218ab60fc9ca74708d WatchSource:0}: Error finding container cc8756e12779539274fc1d8e7ffc369c38722715999de8218ab60fc9ca74708d: Status 404 returned error can't find the container with id cc8756e12779539274fc1d8e7ffc369c38722715999de8218ab60fc9ca74708d
Jul 21 20:41:30.122536 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:30.122499    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hbxk8" event={"ID":"e9cddf20-eb0c-4623-b217-7b1fc6aee91b","Type":"ContainerStarted","Data":"e1fe640399b83bad5c5ba2ad2d3b71a9d5db730ca4e8df05f9b0b111450da0bc"}
Jul 21 20:41:30.123843 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:30.123812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl" event={"ID":"6ceef5da-a77f-4254-a857-b151c1c34c96","Type":"ContainerStarted","Data":"cc8756e12779539274fc1d8e7ffc369c38722715999de8218ab60fc9ca74708d"}
Jul 21 20:41:30.125084 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:30.125058    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7s7hw" event={"ID":"f2aff829-77be-4510-bca7-37840fc5e7b2","Type":"ContainerStarted","Data":"3649c5dd35b823ba375bd43feae91e9150adff4c8d0cceb11746b03314da10ae"}
Jul 21 20:41:30.173809 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:30.173769    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hbxk8" podStartSLOduration=35.001766553 podStartE2EDuration="58.173756094s" totalImagesPullingTime="23.171989541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 20:40:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:30.172405418 +0000 UTC m=+116.192813880" watchObservedRunningTime="2026-07-21 20:41:30.173756094 +0000 UTC m=+116.194164557"
Jul 21 20:41:31.130844 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.130802    2560 generic.go:356] "Generic (PLEG): container finished" podID="f2aff829-77be-4510-bca7-37840fc5e7b2" containerID="751df416e2fdcf6ea49f05f778d2e4736c20ceba7427a3859cfc827cfdb68b01" exitCode=0
Jul 21 20:41:31.131320 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.130898    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7s7hw" event={"ID":"f2aff829-77be-4510-bca7-37840fc5e7b2","Type":"ContainerDied","Data":"751df416e2fdcf6ea49f05f778d2e4736c20ceba7427a3859cfc827cfdb68b01"}
Jul 21 20:41:31.460167 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.460094    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-87764c7ff-zdfk6"]
Jul 21 20:41:31.478222 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.478169    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-87764c7ff-zdfk6"]
Jul 21 20:41:31.478387 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.478297    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.481605 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.481419    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 21 20:41:31.481605 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.481455    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 21 20:41:31.481605 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.481493    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 20:41:31.481910 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.481635    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 21 20:41:31.481910 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.481789    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cv40hk6hs6a76\""
Jul 21 20:41:31.482294 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.482272    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q6kd6\""
Jul 21 20:41:31.597965 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.597938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nhcx\" (UniqueName: \"kubernetes.io/projected/15e98367-9089-48e7-9b19-84258f2f995d-kube-api-access-9nhcx\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.598106 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.597975    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/15e98367-9089-48e7-9b19-84258f2f995d-audit-log\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.598106 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.598063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/15e98367-9089-48e7-9b19-84258f2f995d-metrics-server-audit-profiles\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.598210 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.598136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/15e98367-9089-48e7-9b19-84258f2f995d-secret-metrics-server-client-certs\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.598245 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.598212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e98367-9089-48e7-9b19-84258f2f995d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.598295 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.598245    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15e98367-9089-48e7-9b19-84258f2f995d-client-ca-bundle\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.598295 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.598278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/15e98367-9089-48e7-9b19-84258f2f995d-secret-metrics-server-tls\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.699849 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.699738    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/15e98367-9089-48e7-9b19-84258f2f995d-metrics-server-audit-profiles\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.699849 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.699794    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/15e98367-9089-48e7-9b19-84258f2f995d-secret-metrics-server-client-certs\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.699849 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.699829    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e98367-9089-48e7-9b19-84258f2f995d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.700116 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.699856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15e98367-9089-48e7-9b19-84258f2f995d-client-ca-bundle\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.700116 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.699899    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/15e98367-9089-48e7-9b19-84258f2f995d-secret-metrics-server-tls\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.700116 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.699934    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nhcx\" (UniqueName: \"kubernetes.io/projected/15e98367-9089-48e7-9b19-84258f2f995d-kube-api-access-9nhcx\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.700116 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.699968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/15e98367-9089-48e7-9b19-84258f2f995d-audit-log\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.700414 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.700387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/15e98367-9089-48e7-9b19-84258f2f995d-audit-log\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.701422 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.701396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15e98367-9089-48e7-9b19-84258f2f995d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.701699 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.701676    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/15e98367-9089-48e7-9b19-84258f2f995d-metrics-server-audit-profiles\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.703458 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.703432    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/15e98367-9089-48e7-9b19-84258f2f995d-client-ca-bundle\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.703576 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.703527    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/15e98367-9089-48e7-9b19-84258f2f995d-secret-metrics-server-tls\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.704238 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.704215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/15e98367-9089-48e7-9b19-84258f2f995d-secret-metrics-server-client-certs\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.717446 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.717393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nhcx\" (UniqueName: \"kubernetes.io/projected/15e98367-9089-48e7-9b19-84258f2f995d-kube-api-access-9nhcx\") pod \"metrics-server-87764c7ff-zdfk6\" (UID: \"15e98367-9089-48e7-9b19-84258f2f995d\") " pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.763535 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.763440    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"]
Jul 21 20:41:31.779001 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.778972    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8756c84c-fcht7"]
Jul 21 20:41:31.779108 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.779075    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"
Jul 21 20:41:31.782364 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.782336    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 21 20:41:31.782480 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.782338    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-d7f9q\""
Jul 21 20:41:31.790020 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.789998    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:31.807479 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.807222    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"]
Jul 21 20:41:31.807479 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.807329    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:31.809905 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.809886    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8756c84c-fcht7"]
Jul 21 20:41:31.902373 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.902341    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d5150880-e508-4073-8e80-d288c6236d21-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rn5gr\" (UID: \"d5150880-e508-4073-8e80-d288c6236d21\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"
Jul 21 20:41:31.902373 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.902370    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-oauth-serving-cert\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:31.902532 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.902390    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85wjt\" (UniqueName: \"kubernetes.io/projected/9477d5d9-b865-412d-9064-69d18affed55-kube-api-access-85wjt\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:31.902532 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.902408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-serving-cert\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:31.902532 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.902463    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-service-ca\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:31.902532 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.902485    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f6j8\" (UniqueName: \"kubernetes.io/projected/d5150880-e508-4073-8e80-d288c6236d21-kube-api-access-2f6j8\") pod \"monitoring-plugin-7b7b7bc8bf-rn5gr\" (UID: \"d5150880-e508-4073-8e80-d288c6236d21\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"
Jul 21 20:41:31.902532 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.902502    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-oauth-config\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:31.902681 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.902543    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-trusted-ca-bundle\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:31.902681 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:31.902563    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-console-config\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.003348 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.003321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-trusted-ca-bundle\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.003494 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.003359    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-console-config\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.003494 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.003427    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d5150880-e508-4073-8e80-d288c6236d21-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rn5gr\" (UID: \"d5150880-e508-4073-8e80-d288c6236d21\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"
Jul 21 20:41:32.003494 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.003462    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-oauth-serving-cert\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.003494 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.003487    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85wjt\" (UniqueName: \"kubernetes.io/projected/9477d5d9-b865-412d-9064-69d18affed55-kube-api-access-85wjt\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.003718 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.003516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-serving-cert\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.003870 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:41:32.003847    2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 21 20:41:32.003928 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:41:32.003921    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5150880-e508-4073-8e80-d288c6236d21-monitoring-plugin-cert podName:d5150880-e508-4073-8e80-d288c6236d21 nodeName:}" failed. No retries permitted until 2026-07-21 20:41:32.503902221 +0000 UTC m=+118.524310663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d5150880-e508-4073-8e80-d288c6236d21-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-rn5gr" (UID: "d5150880-e508-4073-8e80-d288c6236d21") : secret "monitoring-plugin-cert" not found
Jul 21 20:41:32.004347 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.004298    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-trusted-ca-bundle\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.004347 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.004326    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-service-ca\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.004522 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.004372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f6j8\" (UniqueName: \"kubernetes.io/projected/d5150880-e508-4073-8e80-d288c6236d21-kube-api-access-2f6j8\") pod \"monitoring-plugin-7b7b7bc8bf-rn5gr\" (UID: \"d5150880-e508-4073-8e80-d288c6236d21\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"
Jul 21 20:41:32.004522 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.004415    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-oauth-config\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.004634 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.004561    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-oauth-serving-cert\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.004923 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.004857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-console-config\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.005249 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.005228    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-service-ca\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.006508 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.006484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-serving-cert\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.007220 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.007177    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-oauth-config\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.015760 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.015722    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f6j8\" (UniqueName: \"kubernetes.io/projected/d5150880-e508-4073-8e80-d288c6236d21-kube-api-access-2f6j8\") pod \"monitoring-plugin-7b7b7bc8bf-rn5gr\" (UID: \"d5150880-e508-4073-8e80-d288c6236d21\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"
Jul 21 20:41:32.015837 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.015807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85wjt\" (UniqueName: \"kubernetes.io/projected/9477d5d9-b865-412d-9064-69d18affed55-kube-api-access-85wjt\") pod \"console-8756c84c-fcht7\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") " pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.077551 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.077525    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-87764c7ff-zdfk6"]
Jul 21 20:41:32.080088 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:32.080046    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e98367_9089_48e7_9b19_84258f2f995d.slice/crio-8caf2eb5db8fdf7fc656ed025a4787063627ccc6d68cee68d0cf034960eb6b57 WatchSource:0}: Error finding container 8caf2eb5db8fdf7fc656ed025a4787063627ccc6d68cee68d0cf034960eb6b57: Status 404 returned error can't find the container with id 8caf2eb5db8fdf7fc656ed025a4787063627ccc6d68cee68d0cf034960eb6b57
Jul 21 20:41:32.116476 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.116433    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:32.139635 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.139607    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl" event={"ID":"6ceef5da-a77f-4254-a857-b151c1c34c96","Type":"ContainerStarted","Data":"3f98dec289b1951f7f3a6cfaf30ae314d7da870ef4d275bfe842bab0302795d3"}
Jul 21 20:41:32.141893 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.141863    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6" event={"ID":"15e98367-9089-48e7-9b19-84258f2f995d","Type":"ContainerStarted","Data":"8caf2eb5db8fdf7fc656ed025a4787063627ccc6d68cee68d0cf034960eb6b57"}
Jul 21 20:41:32.145756 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.145692    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7s7hw" event={"ID":"f2aff829-77be-4510-bca7-37840fc5e7b2","Type":"ContainerStarted","Data":"0751cc1cafb477d44e92964c37a43e1d1029bfd8e28865224a757cdeaa7bf0f5"}
Jul 21 20:41:32.145756 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.145746    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7s7hw" event={"ID":"f2aff829-77be-4510-bca7-37840fc5e7b2","Type":"ContainerStarted","Data":"774ebed681219e27a16fa3080fab17cbe164b88cafbde468525a14636e667bb5"}
Jul 21 20:41:32.168620 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.168315    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7s7hw" podStartSLOduration=4.8312000489999996 podStartE2EDuration="6.168295984s" totalImagesPullingTime="1.271169305s" totalInitContainerRuntime="65.92663ms" isStatefulPod=true podCreationTimestamp="2026-07-21 20:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:32.167458731 +0000 UTC m=+118.187867193" watchObservedRunningTime="2026-07-21 20:41:32.168295984 +0000 UTC m=+118.188704448"
Jul 21 20:41:32.309933 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.309907    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8756c84c-fcht7"]
Jul 21 20:41:32.313039 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:32.313002    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9477d5d9_b865_412d_9064_69d18affed55.slice/crio-70f797d2fe4c17cefa8ec204062f8c19f53bd7d48483c71810b4954a1e4aba43 WatchSource:0}: Error finding container 70f797d2fe4c17cefa8ec204062f8c19f53bd7d48483c71810b4954a1e4aba43: Status 404 returned error can't find the container with id 70f797d2fe4c17cefa8ec204062f8c19f53bd7d48483c71810b4954a1e4aba43
Jul 21 20:41:32.509336 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.509255    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d5150880-e508-4073-8e80-d288c6236d21-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rn5gr\" (UID: \"d5150880-e508-4073-8e80-d288c6236d21\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"
Jul 21 20:41:32.511781 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.511751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d5150880-e508-4073-8e80-d288c6236d21-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-rn5gr\" (UID: \"d5150880-e508-4073-8e80-d288c6236d21\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"
Jul 21 20:41:32.690964 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.690929    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"
Jul 21 20:41:32.844929 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:32.844899    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"]
Jul 21 20:41:32.848003 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:32.847976    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5150880_e508_4073_8e80_d288c6236d21.slice/crio-1bc301f1e94f2c7de44c0b5ada184842bbd130cb87b489be37a7e12db7dc3068 WatchSource:0}: Error finding container 1bc301f1e94f2c7de44c0b5ada184842bbd130cb87b489be37a7e12db7dc3068: Status 404 returned error can't find the container with id 1bc301f1e94f2c7de44c0b5ada184842bbd130cb87b489be37a7e12db7dc3068
Jul 21 20:41:33.151210 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.151149    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8756c84c-fcht7" event={"ID":"9477d5d9-b865-412d-9064-69d18affed55","Type":"ContainerStarted","Data":"d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f"}
Jul 21 20:41:33.151895 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.151232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8756c84c-fcht7" event={"ID":"9477d5d9-b865-412d-9064-69d18affed55","Type":"ContainerStarted","Data":"70f797d2fe4c17cefa8ec204062f8c19f53bd7d48483c71810b4954a1e4aba43"}
Jul 21 20:41:33.152348 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.152327    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr" event={"ID":"d5150880-e508-4073-8e80-d288c6236d21","Type":"ContainerStarted","Data":"1bc301f1e94f2c7de44c0b5ada184842bbd130cb87b489be37a7e12db7dc3068"}
Jul 21 20:41:33.154487 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.154457    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl" event={"ID":"6ceef5da-a77f-4254-a857-b151c1c34c96","Type":"ContainerStarted","Data":"93af1fb8a4f207b7c33f313cb00777ae2e343303d48d2c8072dc120167b069c2"}
Jul 21 20:41:33.154599 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.154511    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl" event={"ID":"6ceef5da-a77f-4254-a857-b151c1c34c96","Type":"ContainerStarted","Data":"15891ba5e2ac6fe1c62c172a693f9fb3617e2a5580747b78580b7993dfcce4f9"}
Jul 21 20:41:33.171723 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.171675    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8756c84c-fcht7" podStartSLOduration=2.171660252 podStartE2EDuration="2.171660252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:33.171532709 +0000 UTC m=+119.191941177" watchObservedRunningTime="2026-07-21 20:41:33.171660252 +0000 UTC m=+119.192068698"
Jul 21 20:41:33.196083 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.196032    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-627hl" podStartSLOduration=4.775693843 podStartE2EDuration="7.196016013s" totalImagesPullingTime="2.42032217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:33.194852157 +0000 UTC m=+119.215260646" watchObservedRunningTime="2026-07-21 20:41:33.196016013 +0000 UTC m=+119.216424477"
Jul 21 20:41:33.587271 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.586746    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:41:33.605527 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.605469    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.614145 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.613783    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 20:41:33.614838 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.614556    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 20:41:33.614838 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.614610    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gjwkw\""
Jul 21 20:41:33.618846 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.617240    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 20:41:33.622673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.619391    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 20:41:33.622673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.619488    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 20:41:33.622673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.622261    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bm2cambvjjinj\""
Jul 21 20:41:33.622673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.622461    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 20:41:33.622673 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.622663    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 20:41:33.623110 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.622760    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 20:41:33.623110 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.622886    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 20:41:33.623110 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.623028    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 20:41:33.623110 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.623081    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 20:41:33.623321 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.623302    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 20:41:33.624929 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.624827    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:41:33.628886 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.628034    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 20:41:33.628886 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.628488    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 20:41:33.723256 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723217    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-config\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723450 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723450 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723314    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm79m\" (UniqueName: \"kubernetes.io/projected/55dd9a73-4dfd-4601-926f-0fc553434e22-kube-api-access-mm79m\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723450 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723396    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723450 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55dd9a73-4dfd-4601-926f-0fc553434e22-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723450 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723448    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55dd9a73-4dfd-4601-926f-0fc553434e22-config-out\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723476    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723512    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-web-config\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723559    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723611    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.723685 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.724017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723695    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.724017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723772    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.724017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.724017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.724017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.724017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.723950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.825390 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825343    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.825602 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55dd9a73-4dfd-4601-926f-0fc553434e22-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.825682 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55dd9a73-4dfd-4601-926f-0fc553434e22-config-out\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.825682 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825638    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.825682 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825669    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-web-config\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.825830 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825693    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.825830 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.825830 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.825830 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825778    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.825830 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825801    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.826069 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.826069 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.826069 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.826069 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825921    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.826069 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.826069 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.825992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.826069 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.826019    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.826391 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.826072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-config\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.826391 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.826101    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.826391 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.826161    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm79m\" (UniqueName: \"kubernetes.io/projected/55dd9a73-4dfd-4601-926f-0fc553434e22-kube-api-access-mm79m\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.826391 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.826222    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.827065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.827038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.828197 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.828016    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.832539 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.828576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.832539 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.830843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.834502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.833067    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-config\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.834502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.833112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.834502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.833147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.834502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.833291    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.834502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.833611    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.834502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.833629    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.834502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.833883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/55dd9a73-4dfd-4601-926f-0fc553434e22-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.834502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.834004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.834502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.834463    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/55dd9a73-4dfd-4601-926f-0fc553434e22-config-out\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.835025 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.834616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-web-config\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.835025 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.834843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.835765 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.835702    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/55dd9a73-4dfd-4601-926f-0fc553434e22-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.836633 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.836608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.837111 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.837064    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/55dd9a73-4dfd-4601-926f-0fc553434e22-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.839563 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.839513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm79m\" (UniqueName: \"kubernetes.io/projected/55dd9a73-4dfd-4601-926f-0fc553434e22-kube-api-access-mm79m\") pod \"prometheus-k8s-0\" (UID: \"55dd9a73-4dfd-4601-926f-0fc553434e22\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:33.925588 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:33.925557    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:34.144681 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:34.144653    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 20:41:34.527712 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:34.527644    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55dd9a73_4dfd_4601_926f_0fc553434e22.slice/crio-6739e572ef67536ff7e6d5f09f3bc4aadae7a0f88866953b2d914972d427ea7b WatchSource:0}: Error finding container 6739e572ef67536ff7e6d5f09f3bc4aadae7a0f88866953b2d914972d427ea7b: Status 404 returned error can't find the container with id 6739e572ef67536ff7e6d5f09f3bc4aadae7a0f88866953b2d914972d427ea7b
Jul 21 20:41:35.103036 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:35.103002    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p2mfz"
Jul 21 20:41:35.166473 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:35.166438    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd9a73-4dfd-4601-926f-0fc553434e22","Type":"ContainerStarted","Data":"6739e572ef67536ff7e6d5f09f3bc4aadae7a0f88866953b2d914972d427ea7b"}
Jul 21 20:41:36.172635 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:36.172598    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr" event={"ID":"d5150880-e508-4073-8e80-d288c6236d21","Type":"ContainerStarted","Data":"ccd3a007b79e0a5bd07c0ac0951409a8c67e55546fc21d1c411df064c42a7975"}
Jul 21 20:41:36.173091 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:36.172659    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"
Jul 21 20:41:36.174291 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:36.174263    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6" event={"ID":"15e98367-9089-48e7-9b19-84258f2f995d","Type":"ContainerStarted","Data":"80aaf48f5da0d4fd14650754abd31d8336619ca2f501db09a206255972d7b539"}
Jul 21 20:41:36.178646 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:36.178629    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr"
Jul 21 20:41:36.189073 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:36.189035    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-rn5gr" podStartSLOduration=2.682784792 podStartE2EDuration="5.189013312s" totalImagesPullingTime="2.50622852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:36.188439048 +0000 UTC m=+122.208847512" watchObservedRunningTime="2026-07-21 20:41:36.189013312 +0000 UTC m=+122.209421799"
Jul 21 20:41:36.254247 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:36.253870    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6" podStartSLOduration=1.983083009 podStartE2EDuration="5.253680242s" totalImagesPullingTime="3.270597233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:36.251103725 +0000 UTC m=+122.271512188" watchObservedRunningTime="2026-07-21 20:41:36.253680242 +0000 UTC m=+122.274088705"
Jul 21 20:41:37.179966 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:37.179934    2560 generic.go:356] "Generic (PLEG): container finished" podID="55dd9a73-4dfd-4601-926f-0fc553434e22" containerID="4328b5c87fd8eba5f4c7a2869e3db093d312a12e74e8186f2f480bdedd656fd6" exitCode=0
Jul 21 20:41:37.180549 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:37.180021    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd9a73-4dfd-4601-926f-0fc553434e22","Type":"ContainerDied","Data":"4328b5c87fd8eba5f4c7a2869e3db093d312a12e74e8186f2f480bdedd656fd6"}
Jul 21 20:41:40.107988 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.107935    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-668cf55fb5-xllvv" podUID="0ccb5ac9-5026-45af-955e-4947c6923b9a" containerName="console" containerID="cri-o://ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4" gracePeriod=15
Jul 21 20:41:40.386066 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.386039    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:40.494373 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.494324    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-config\") pod \"0ccb5ac9-5026-45af-955e-4947c6923b9a\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") "
Jul 21 20:41:40.494373 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.494376    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtnqf\" (UniqueName: \"kubernetes.io/projected/0ccb5ac9-5026-45af-955e-4947c6923b9a-kube-api-access-wtnqf\") pod \"0ccb5ac9-5026-45af-955e-4947c6923b9a\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") "
Jul 21 20:41:40.494597 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.494450    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-oauth-config\") pod \"0ccb5ac9-5026-45af-955e-4947c6923b9a\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") "
Jul 21 20:41:40.494597 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.494485    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-oauth-serving-cert\") pod \"0ccb5ac9-5026-45af-955e-4947c6923b9a\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") "
Jul 21 20:41:40.494597 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.494537    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-serving-cert\") pod \"0ccb5ac9-5026-45af-955e-4947c6923b9a\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") "
Jul 21 20:41:40.494597 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.494558    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-service-ca\") pod \"0ccb5ac9-5026-45af-955e-4947c6923b9a\" (UID: \"0ccb5ac9-5026-45af-955e-4947c6923b9a\") "
Jul 21 20:41:40.494794 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.494743    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-config" (OuterVolumeSpecName: "console-config") pod "0ccb5ac9-5026-45af-955e-4947c6923b9a" (UID: "0ccb5ac9-5026-45af-955e-4947c6923b9a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:41:40.495130 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.495094    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0ccb5ac9-5026-45af-955e-4947c6923b9a" (UID: "0ccb5ac9-5026-45af-955e-4947c6923b9a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:41:40.495292 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.495154    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-service-ca" (OuterVolumeSpecName: "service-ca") pod "0ccb5ac9-5026-45af-955e-4947c6923b9a" (UID: "0ccb5ac9-5026-45af-955e-4947c6923b9a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:41:40.497370 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.497343    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0ccb5ac9-5026-45af-955e-4947c6923b9a" (UID: "0ccb5ac9-5026-45af-955e-4947c6923b9a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:41:40.497493 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.497455    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ccb5ac9-5026-45af-955e-4947c6923b9a-kube-api-access-wtnqf" (OuterVolumeSpecName: "kube-api-access-wtnqf") pod "0ccb5ac9-5026-45af-955e-4947c6923b9a" (UID: "0ccb5ac9-5026-45af-955e-4947c6923b9a"). InnerVolumeSpecName "kube-api-access-wtnqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:41:40.497493 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.497461    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0ccb5ac9-5026-45af-955e-4947c6923b9a" (UID: "0ccb5ac9-5026-45af-955e-4947c6923b9a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:41:40.596031 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.595997    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:40.596031 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.596030    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtnqf\" (UniqueName: \"kubernetes.io/projected/0ccb5ac9-5026-45af-955e-4947c6923b9a-kube-api-access-wtnqf\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:40.596253 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.596046    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-oauth-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:40.596253 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.596061    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-oauth-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:40.596253 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.596075    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0ccb5ac9-5026-45af-955e-4947c6923b9a-console-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:40.596253 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:40.596089    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0ccb5ac9-5026-45af-955e-4947c6923b9a-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:41:41.199835 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:41.199798    2560 generic.go:356] "Generic (PLEG): container finished" podID="0ccb5ac9-5026-45af-955e-4947c6923b9a" containerID="ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4" exitCode=0
Jul 21 20:41:41.200313 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:41.199859    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cf55fb5-xllvv"
Jul 21 20:41:41.200313 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:41.199861    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cf55fb5-xllvv" event={"ID":"0ccb5ac9-5026-45af-955e-4947c6923b9a","Type":"ContainerDied","Data":"ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4"}
Jul 21 20:41:41.200313 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:41.199984    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cf55fb5-xllvv" event={"ID":"0ccb5ac9-5026-45af-955e-4947c6923b9a","Type":"ContainerDied","Data":"a7b67a97256b26937b7106b606c44875207a37ade8c878b6f3cd1c9e9fd6246b"}
Jul 21 20:41:41.200313 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:41.200008    2560 scope.go:117] "RemoveContainer" containerID="ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4"
Jul 21 20:41:41.219248 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:41.219221    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668cf55fb5-xllvv"]
Jul 21 20:41:41.224519 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:41.224498    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-668cf55fb5-xllvv"]
Jul 21 20:41:41.510664 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:41.510637    2560 scope.go:117] "RemoveContainer" containerID="ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4"
Jul 21 20:41:41.511107 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:41:41.511075    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4\": container with ID starting with ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4 not found: ID does not exist" containerID="ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4"
Jul 21 20:41:41.511203 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:41.511112    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4"} err="failed to get container status \"ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4\": rpc error: code = NotFound desc = could not find container \"ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4\": container with ID starting with ff1947e69c93adf6616ec7079059a0103ccc21861f56a6c7770e5f42e30b49c4 not found: ID does not exist"
Jul 21 20:41:42.116936 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:42.116906    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:42.117047 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:42.117004    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:42.122424 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:42.122395    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:42.208447 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:42.208302    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd9a73-4dfd-4601-926f-0fc553434e22","Type":"ContainerStarted","Data":"58036007b0398e5768780f7f60edcb4b6aa53b302dd79431d0b23419fe2e028f"}
Jul 21 20:41:42.208447 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:42.208386    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd9a73-4dfd-4601-926f-0fc553434e22","Type":"ContainerStarted","Data":"2fd58286ab13ed6e1acf37fd0a800d407d737304b3be1af8ea1f991040b520c8"}
Jul 21 20:41:42.215916 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:42.215890    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:41:42.266950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:42.266916    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7679bdf-mmkdd"]
Jul 21 20:41:42.497229 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:42.497108    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ccb5ac9-5026-45af-955e-4947c6923b9a" path="/var/lib/kubelet/pods/0ccb5ac9-5026-45af-955e-4947c6923b9a/volumes"
Jul 21 20:41:43.323395 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:43.323350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:41:43.326141 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:43.326116    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0b527024-4b36-41f9-844e-c932757f0b46-metrics-certs\") pod \"network-metrics-daemon-c6mdf\" (UID: \"0b527024-4b36-41f9-844e-c932757f0b46\") " pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:41:43.507565 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:43.507534    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jpthn\""
Jul 21 20:41:43.514566 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:43.514344    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c6mdf"
Jul 21 20:41:43.681808 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:43.681698    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c6mdf"]
Jul 21 20:41:44.202312 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:41:44.202267    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b527024_4b36_41f9_844e_c932757f0b46.slice/crio-78b55bcbd1245f23ea133de81f5b3239b82650132200197bd8b22dc103c4ea2a WatchSource:0}: Error finding container 78b55bcbd1245f23ea133de81f5b3239b82650132200197bd8b22dc103c4ea2a: Status 404 returned error can't find the container with id 78b55bcbd1245f23ea133de81f5b3239b82650132200197bd8b22dc103c4ea2a
Jul 21 20:41:44.221509 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:44.221478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c6mdf" event={"ID":"0b527024-4b36-41f9-844e-c932757f0b46","Type":"ContainerStarted","Data":"78b55bcbd1245f23ea133de81f5b3239b82650132200197bd8b22dc103c4ea2a"}
Jul 21 20:41:45.232715 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:45.232626    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd9a73-4dfd-4601-926f-0fc553434e22","Type":"ContainerStarted","Data":"4e16e07a7bd4d135a8aea94013152b4aaf5f126ab592086f132134c398404703"}
Jul 21 20:41:45.233149 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:45.232752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd9a73-4dfd-4601-926f-0fc553434e22","Type":"ContainerStarted","Data":"828fd1f0480f7a1181ae1bf22a3e5f3b760fe8cdd71ae71e444ba58d4b03c17a"}
Jul 21 20:41:45.233149 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:45.232793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd9a73-4dfd-4601-926f-0fc553434e22","Type":"ContainerStarted","Data":"cb00eccbf5c424755430f000de27f27ece363f1176bd1c0b9b5bfd90d10f35e4"}
Jul 21 20:41:45.233149 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:45.232834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"55dd9a73-4dfd-4601-926f-0fc553434e22","Type":"ContainerStarted","Data":"34ee24d7e8b19bf846c9ef3279283bfedb681c7f0ae477ad1f566e4499858224"}
Jul 21 20:41:45.266008 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:45.265266    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.209389999 podStartE2EDuration="12.265245251s" totalImagesPullingTime="9.035393321s" totalInitContainerRuntime="20.461931ms" isStatefulPod=false podCreationTimestamp="2026-07-21 20:41:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:45.263023258 +0000 UTC m=+131.283431763" watchObservedRunningTime="2026-07-21 20:41:45.265245251 +0000 UTC m=+131.285653713"
Jul 21 20:41:46.237760 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:46.237727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c6mdf" event={"ID":"0b527024-4b36-41f9-844e-c932757f0b46","Type":"ContainerStarted","Data":"b2481b64b41877277331bda18d0daf1798f873888df47351148c5208347272a4"}
Jul 21 20:41:46.238238 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:46.237781    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c6mdf" event={"ID":"0b527024-4b36-41f9-844e-c932757f0b46","Type":"ContainerStarted","Data":"45762ca6df376376010d99b41350bfdf3b90048af95b4de291f8f1def3788eb4"}
Jul 21 20:41:46.257145 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:46.257099    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c6mdf" podStartSLOduration=130.726494765 podStartE2EDuration="2m12.257084104s" totalImagesPullingTime="1.530589339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:41:46.255356216 +0000 UTC m=+132.275764694" watchObservedRunningTime="2026-07-21 20:41:46.257084104 +0000 UTC m=+132.277492566"
Jul 21 20:41:48.926590 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:48.926556    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:41:51.790277 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:51.790247    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:51.790728 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:51.790305    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:41:52.263249 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:52.263215    2560 generic.go:356] "Generic (PLEG): container finished" podID="d8ca0682-3f4e-422a-943b-7f345b0716e2" containerID="b5879d7fbb5a60e8f095fe7a56f1fdc787af5a1bbc19966c016b52a968b85d61" exitCode=0
Jul 21 20:41:52.263404 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:52.263283    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq" event={"ID":"d8ca0682-3f4e-422a-943b-7f345b0716e2","Type":"ContainerDied","Data":"b5879d7fbb5a60e8f095fe7a56f1fdc787af5a1bbc19966c016b52a968b85d61"}
Jul 21 20:41:52.263620 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:52.263601    2560 scope.go:117] "RemoveContainer" containerID="b5879d7fbb5a60e8f095fe7a56f1fdc787af5a1bbc19966c016b52a968b85d61"
Jul 21 20:41:53.269441 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:41:53.269400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-cjgjq" event={"ID":"d8ca0682-3f4e-422a-943b-7f345b0716e2","Type":"ContainerStarted","Data":"d2e854b989dcc8b087862abe06c9ad9b995397b152cfb47903d6103635fbdab1"}
Jul 21 20:42:07.288598 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.288550    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7679bdf-mmkdd" podUID="2922e731-01bf-4138-adcf-fc36405dc4d3" containerName="console" containerID="cri-o://574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a" gracePeriod=15
Jul 21 20:42:07.560089 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.560065    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:42:07.633038 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633011    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-console-config\") pod \"2922e731-01bf-4138-adcf-fc36405dc4d3\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") "
Jul 21 20:42:07.633038 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633045    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6trwc\" (UniqueName: \"kubernetes.io/projected/2922e731-01bf-4138-adcf-fc36405dc4d3-kube-api-access-6trwc\") pod \"2922e731-01bf-4138-adcf-fc36405dc4d3\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") "
Jul 21 20:42:07.633260 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633078    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-serving-cert\") pod \"2922e731-01bf-4138-adcf-fc36405dc4d3\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") "
Jul 21 20:42:07.633260 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633224    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-oauth-serving-cert\") pod \"2922e731-01bf-4138-adcf-fc36405dc4d3\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") "
Jul 21 20:42:07.633337 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633269    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-trusted-ca-bundle\") pod \"2922e731-01bf-4138-adcf-fc36405dc4d3\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") "
Jul 21 20:42:07.633337 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633304    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-oauth-config\") pod \"2922e731-01bf-4138-adcf-fc36405dc4d3\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") "
Jul 21 20:42:07.633337 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633330    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-service-ca\") pod \"2922e731-01bf-4138-adcf-fc36405dc4d3\" (UID: \"2922e731-01bf-4138-adcf-fc36405dc4d3\") "
Jul 21 20:42:07.633713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633578    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2922e731-01bf-4138-adcf-fc36405dc4d3" (UID: "2922e731-01bf-4138-adcf-fc36405dc4d3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:42:07.633713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633591    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-console-config" (OuterVolumeSpecName: "console-config") pod "2922e731-01bf-4138-adcf-fc36405dc4d3" (UID: "2922e731-01bf-4138-adcf-fc36405dc4d3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:42:07.633713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633677    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-oauth-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:42:07.633713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633695    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-console-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:42:07.634040 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633749    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2922e731-01bf-4138-adcf-fc36405dc4d3" (UID: "2922e731-01bf-4138-adcf-fc36405dc4d3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:42:07.634040 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.633797    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-service-ca" (OuterVolumeSpecName: "service-ca") pod "2922e731-01bf-4138-adcf-fc36405dc4d3" (UID: "2922e731-01bf-4138-adcf-fc36405dc4d3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:42:07.635419 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.635399    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2922e731-01bf-4138-adcf-fc36405dc4d3" (UID: "2922e731-01bf-4138-adcf-fc36405dc4d3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:42:07.635661 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.635639    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2922e731-01bf-4138-adcf-fc36405dc4d3" (UID: "2922e731-01bf-4138-adcf-fc36405dc4d3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:42:07.635746 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.635671    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2922e731-01bf-4138-adcf-fc36405dc4d3-kube-api-access-6trwc" (OuterVolumeSpecName: "kube-api-access-6trwc") pod "2922e731-01bf-4138-adcf-fc36405dc4d3" (UID: "2922e731-01bf-4138-adcf-fc36405dc4d3"). InnerVolumeSpecName "kube-api-access-6trwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:42:07.734847 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.734814    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-trusted-ca-bundle\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:42:07.734847 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.734844    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-oauth-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:42:07.734847 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.734854    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2922e731-01bf-4138-adcf-fc36405dc4d3-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:42:07.735073 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.734863    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6trwc\" (UniqueName: \"kubernetes.io/projected/2922e731-01bf-4138-adcf-fc36405dc4d3-kube-api-access-6trwc\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:42:07.735073 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:07.734872    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2922e731-01bf-4138-adcf-fc36405dc4d3-console-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:42:08.332250 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:08.332207    2560 generic.go:356] "Generic (PLEG): container finished" podID="2922e731-01bf-4138-adcf-fc36405dc4d3" containerID="574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a" exitCode=0
Jul 21 20:42:08.332654 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:08.332256    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7679bdf-mmkdd"
Jul 21 20:42:08.332654 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:08.332282    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7679bdf-mmkdd" event={"ID":"2922e731-01bf-4138-adcf-fc36405dc4d3","Type":"ContainerDied","Data":"574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a"}
Jul 21 20:42:08.332654 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:08.332336    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7679bdf-mmkdd" event={"ID":"2922e731-01bf-4138-adcf-fc36405dc4d3","Type":"ContainerDied","Data":"0479c747a3570078bd3b0ab379d65501b0f74736db1919e6fb7fe56db59409b9"}
Jul 21 20:42:08.332654 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:08.332362    2560 scope.go:117] "RemoveContainer" containerID="574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a"
Jul 21 20:42:08.340833 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:08.340814    2560 scope.go:117] "RemoveContainer" containerID="574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a"
Jul 21 20:42:08.341089 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:42:08.341070    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a\": container with ID starting with 574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a not found: ID does not exist" containerID="574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a"
Jul 21 20:42:08.341130 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:08.341099    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a"} err="failed to get container status \"574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a\": rpc error: code = NotFound desc = could not find container \"574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a\": container with ID starting with 574097d1cdb8c153804025fb7664efcc984c0a92212388aa44b9a4e1e279af2a not found: ID does not exist"
Jul 21 20:42:08.353001 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:08.352976    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7679bdf-mmkdd"]
Jul 21 20:42:08.356988 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:08.356961    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7679bdf-mmkdd"]
Jul 21 20:42:08.496952 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:08.496918    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2922e731-01bf-4138-adcf-fc36405dc4d3" path="/var/lib/kubelet/pods/2922e731-01bf-4138-adcf-fc36405dc4d3/volumes"
Jul 21 20:42:11.797985 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:11.797950    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:42:11.806482 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:11.806454    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-87764c7ff-zdfk6"
Jul 21 20:42:33.926293 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:33.926213    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:42:33.941779 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:33.941743    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:42:34.460954 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:34.460929    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 20:42:56.186565 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.186533    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b4fc49f4d-n82kk"]
Jul 21 20:42:56.187141 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.187025    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2922e731-01bf-4138-adcf-fc36405dc4d3" containerName="console"
Jul 21 20:42:56.187141 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.187046    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2922e731-01bf-4138-adcf-fc36405dc4d3" containerName="console"
Jul 21 20:42:56.187141 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.187075    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ccb5ac9-5026-45af-955e-4947c6923b9a" containerName="console"
Jul 21 20:42:56.187141 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.187083    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ccb5ac9-5026-45af-955e-4947c6923b9a" containerName="console"
Jul 21 20:42:56.187375 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.187154    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ccb5ac9-5026-45af-955e-4947c6923b9a" containerName="console"
Jul 21 20:42:56.187375 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.187166    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2922e731-01bf-4138-adcf-fc36405dc4d3" containerName="console"
Jul 21 20:42:56.189173 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.189149    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.211580 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.211550    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4fc49f4d-n82kk"]
Jul 21 20:42:56.252343 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.252303    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-oauth-config\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.252343 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.252348    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-console-config\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.252541 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.252371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-oauth-serving-cert\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.252541 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.252464    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-service-ca\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.252541 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.252501    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7lrv\" (UniqueName: \"kubernetes.io/projected/53b74c4a-78ab-458a-ac52-f942452a5652-kube-api-access-f7lrv\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.252634 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.252544    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-trusted-ca-bundle\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.252634 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.252584    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-serving-cert\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.353398 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.353366    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-service-ca\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.353398 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.353402    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7lrv\" (UniqueName: \"kubernetes.io/projected/53b74c4a-78ab-458a-ac52-f942452a5652-kube-api-access-f7lrv\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.353591 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.353430    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-trusted-ca-bundle\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.353591 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.353472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-serving-cert\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.353591 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.353496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-oauth-config\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.353591 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.353549    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-console-config\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.353775 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.353594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-oauth-serving-cert\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.354278 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.354246    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-service-ca\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.354411 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.354306    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-oauth-serving-cert\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.354456 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.354431    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-trusted-ca-bundle\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.354494 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.354455    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-console-config\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.356008 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.355983    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-oauth-config\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.356156 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.356136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-serving-cert\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.362348 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.362328    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7lrv\" (UniqueName: \"kubernetes.io/projected/53b74c4a-78ab-458a-ac52-f942452a5652-kube-api-access-f7lrv\") pod \"console-b4fc49f4d-n82kk\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") " pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.500298 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.500215    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:42:56.633734 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:56.633702    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4fc49f4d-n82kk"]
Jul 21 20:42:56.635549 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:42:56.635524    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b74c4a_78ab_458a_ac52_f942452a5652.slice/crio-dc43fe42581e27af20df9a09ab896a43b2997d6f91cffe143e3fd6510a614794 WatchSource:0}: Error finding container dc43fe42581e27af20df9a09ab896a43b2997d6f91cffe143e3fd6510a614794: Status 404 returned error can't find the container with id dc43fe42581e27af20df9a09ab896a43b2997d6f91cffe143e3fd6510a614794
Jul 21 20:42:57.532110 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:57.532075    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fc49f4d-n82kk" event={"ID":"53b74c4a-78ab-458a-ac52-f942452a5652","Type":"ContainerStarted","Data":"60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380"}
Jul 21 20:42:57.532501 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:57.532127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fc49f4d-n82kk" event={"ID":"53b74c4a-78ab-458a-ac52-f942452a5652","Type":"ContainerStarted","Data":"dc43fe42581e27af20df9a09ab896a43b2997d6f91cffe143e3fd6510a614794"}
Jul 21 20:42:57.556118 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:42:57.556060    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b4fc49f4d-n82kk" podStartSLOduration=1.556041529 podStartE2EDuration="1.556041529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:42:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:42:57.554690916 +0000 UTC m=+203.575099379" watchObservedRunningTime="2026-07-21 20:42:57.556041529 +0000 UTC m=+203.576449992"
Jul 21 20:43:05.753852 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:05.753819    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4fc49f4d-n82kk"]
Jul 21 20:43:05.865117 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:05.865086    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f767c59c-9rgnf"]
Jul 21 20:43:05.867661 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:05.867641    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:05.871876 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:43:05.871844    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"console-59f767c59c-9rgnf\" is forbidden: User \"system:node:ip-10-0-134-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-134-121.ec2.internal' and this object" podUID="f6f2d180-03f2-481d-aeac-49e5979b29a4" pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:05.918911 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:05.918874    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f767c59c-9rgnf"]
Jul 21 20:43:05.938232 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:05.938179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-oauth-config\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:05.938232 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:05.938232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-oauth-serving-cert\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:05.938400 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:05.938259    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-serving-cert\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:05.938400 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:05.938321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-config\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:05.938400 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:05.938383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-service-ca\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:05.938497 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:05.938436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-trusted-ca-bundle\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:05.938497 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:05.938481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgszw\" (UniqueName: \"kubernetes.io/projected/f6f2d180-03f2-481d-aeac-49e5979b29a4-kube-api-access-zgszw\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.039207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.039102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-oauth-config\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.039207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.039146    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-oauth-serving-cert\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.039207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.039176    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-serving-cert\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.039469 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.039225    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-config\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.039469 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.039265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-service-ca\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.039469 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.039320    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-trusted-ca-bundle\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.039469 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.039378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgszw\" (UniqueName: \"kubernetes.io/projected/f6f2d180-03f2-481d-aeac-49e5979b29a4-kube-api-access-zgszw\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.040022 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.039995    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-oauth-serving-cert\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.040253 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.040229    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-config\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.040409 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.040392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-trusted-ca-bundle\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.040446 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.040396    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-service-ca\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.041622 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.041602    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-oauth-config\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.041910 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.041886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-serving-cert\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.056158 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.056135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgszw\" (UniqueName: \"kubernetes.io/projected/f6f2d180-03f2-481d-aeac-49e5979b29a4-kube-api-access-zgszw\") pod \"console-59f767c59c-9rgnf\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") " pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.181231 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.181196    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:06.314864 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.314730    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f767c59c-9rgnf"]
Jul 21 20:43:06.317595 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:43:06.317565    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f2d180_03f2_481d_aeac_49e5979b29a4.slice/crio-f825159516e17b3b7adf5823fa9ade381fdbc7d54397c8c96fb13fd4e8512177 WatchSource:0}: Error finding container f825159516e17b3b7adf5823fa9ade381fdbc7d54397c8c96fb13fd4e8512177: Status 404 returned error can't find the container with id f825159516e17b3b7adf5823fa9ade381fdbc7d54397c8c96fb13fd4e8512177
Jul 21 20:43:06.500452 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.500423    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:43:06.568732 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.568644    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f767c59c-9rgnf" event={"ID":"f6f2d180-03f2-481d-aeac-49e5979b29a4","Type":"ContainerStarted","Data":"a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865"}
Jul 21 20:43:06.568732 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.568698    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f767c59c-9rgnf" event={"ID":"f6f2d180-03f2-481d-aeac-49e5979b29a4","Type":"ContainerStarted","Data":"f825159516e17b3b7adf5823fa9ade381fdbc7d54397c8c96fb13fd4e8512177"}
Jul 21 20:43:06.588503 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:06.588452    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f767c59c-9rgnf" podStartSLOduration=1.588437764 podStartE2EDuration="1.588437764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:43:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:43:06.586368461 +0000 UTC m=+212.606776935" watchObservedRunningTime="2026-07-21 20:43:06.588437764 +0000 UTC m=+212.608846226"
Jul 21 20:43:16.181497 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:16.181453    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:16.181948 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:16.181518    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:16.186425 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:16.186399    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:16.613932 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:16.613900    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:43:16.665369 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:16.665338    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8756c84c-fcht7"]
Jul 21 20:43:30.773358 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:30.773287    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b4fc49f4d-n82kk" podUID="53b74c4a-78ab-458a-ac52-f942452a5652" containerName="console" containerID="cri-o://60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380" gracePeriod=15
Jul 21 20:43:31.019282 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.019257    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:43:31.070901 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.070878    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-oauth-serving-cert\") pod \"53b74c4a-78ab-458a-ac52-f942452a5652\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") "
Jul 21 20:43:31.071064 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.070914    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-oauth-config\") pod \"53b74c4a-78ab-458a-ac52-f942452a5652\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") "
Jul 21 20:43:31.071064 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.070936    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-service-ca\") pod \"53b74c4a-78ab-458a-ac52-f942452a5652\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") "
Jul 21 20:43:31.071064 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.071008    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-serving-cert\") pod \"53b74c4a-78ab-458a-ac52-f942452a5652\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") "
Jul 21 20:43:31.071064 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.071038    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7lrv\" (UniqueName: \"kubernetes.io/projected/53b74c4a-78ab-458a-ac52-f942452a5652-kube-api-access-f7lrv\") pod \"53b74c4a-78ab-458a-ac52-f942452a5652\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") "
Jul 21 20:43:31.071296 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.071107    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-trusted-ca-bundle\") pod \"53b74c4a-78ab-458a-ac52-f942452a5652\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") "
Jul 21 20:43:31.071296 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.071132    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-console-config\") pod \"53b74c4a-78ab-458a-ac52-f942452a5652\" (UID: \"53b74c4a-78ab-458a-ac52-f942452a5652\") "
Jul 21 20:43:31.071435 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.071411    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53b74c4a-78ab-458a-ac52-f942452a5652" (UID: "53b74c4a-78ab-458a-ac52-f942452a5652"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:43:31.071610 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.071571    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "53b74c4a-78ab-458a-ac52-f942452a5652" (UID: "53b74c4a-78ab-458a-ac52-f942452a5652"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:43:31.071721 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.071696    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-service-ca" (OuterVolumeSpecName: "service-ca") pod "53b74c4a-78ab-458a-ac52-f942452a5652" (UID: "53b74c4a-78ab-458a-ac52-f942452a5652"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:43:31.071721 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.071708    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-console-config" (OuterVolumeSpecName: "console-config") pod "53b74c4a-78ab-458a-ac52-f942452a5652" (UID: "53b74c4a-78ab-458a-ac52-f942452a5652"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:43:31.073266 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.073239    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53b74c4a-78ab-458a-ac52-f942452a5652" (UID: "53b74c4a-78ab-458a-ac52-f942452a5652"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:43:31.073662 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.073641    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53b74c4a-78ab-458a-ac52-f942452a5652" (UID: "53b74c4a-78ab-458a-ac52-f942452a5652"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:43:31.073720 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.073652    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53b74c4a-78ab-458a-ac52-f942452a5652-kube-api-access-f7lrv" (OuterVolumeSpecName: "kube-api-access-f7lrv") pod "53b74c4a-78ab-458a-ac52-f942452a5652" (UID: "53b74c4a-78ab-458a-ac52-f942452a5652"). InnerVolumeSpecName "kube-api-access-f7lrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:43:31.172148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.172111    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:31.172148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.172143    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7lrv\" (UniqueName: \"kubernetes.io/projected/53b74c4a-78ab-458a-ac52-f942452a5652-kube-api-access-f7lrv\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:31.172148 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.172154    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-trusted-ca-bundle\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:31.172394 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.172163    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-console-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:31.172394 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.172172    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-oauth-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:31.172394 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.172180    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53b74c4a-78ab-458a-ac52-f942452a5652-console-oauth-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:31.172394 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.172212    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53b74c4a-78ab-458a-ac52-f942452a5652-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:31.669607 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.669575    2560 generic.go:356] "Generic (PLEG): container finished" podID="53b74c4a-78ab-458a-ac52-f942452a5652" containerID="60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380" exitCode=0
Jul 21 20:43:31.669766 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.669614    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4fc49f4d-n82kk"
Jul 21 20:43:31.669766 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.669661    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fc49f4d-n82kk" event={"ID":"53b74c4a-78ab-458a-ac52-f942452a5652","Type":"ContainerDied","Data":"60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380"}
Jul 21 20:43:31.669766 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.669713    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4fc49f4d-n82kk" event={"ID":"53b74c4a-78ab-458a-ac52-f942452a5652","Type":"ContainerDied","Data":"dc43fe42581e27af20df9a09ab896a43b2997d6f91cffe143e3fd6510a614794"}
Jul 21 20:43:31.669766 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.669734    2560 scope.go:117] "RemoveContainer" containerID="60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380"
Jul 21 20:43:31.678042 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.678026    2560 scope.go:117] "RemoveContainer" containerID="60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380"
Jul 21 20:43:31.678377 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:43:31.678356    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380\": container with ID starting with 60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380 not found: ID does not exist" containerID="60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380"
Jul 21 20:43:31.678433 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.678386    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380"} err="failed to get container status \"60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380\": rpc error: code = NotFound desc = could not find container \"60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380\": container with ID starting with 60d99111ec8ff9a15f95ea4de46d95e7ea440b469ac581b99dbe95654f550380 not found: ID does not exist"
Jul 21 20:43:31.692079 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.692059    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4fc49f4d-n82kk"]
Jul 21 20:43:31.694964 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:31.694939    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b4fc49f4d-n82kk"]
Jul 21 20:43:32.496937 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:32.496904    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53b74c4a-78ab-458a-ac52-f942452a5652" path="/var/lib/kubelet/pods/53b74c4a-78ab-458a-ac52-f942452a5652/volumes"
Jul 21 20:43:41.689815 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:41.689768    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8756c84c-fcht7" podUID="9477d5d9-b865-412d-9064-69d18affed55" containerName="console" containerID="cri-o://d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f" gracePeriod=15
Jul 21 20:43:41.938255 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:41.938230    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:43:42.061505 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.061474    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-serving-cert\") pod \"9477d5d9-b865-412d-9064-69d18affed55\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") "
Jul 21 20:43:42.061676 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.061524    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-trusted-ca-bundle\") pod \"9477d5d9-b865-412d-9064-69d18affed55\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") "
Jul 21 20:43:42.061676 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.061574    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-console-config\") pod \"9477d5d9-b865-412d-9064-69d18affed55\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") "
Jul 21 20:43:42.061676 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.061605    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-oauth-config\") pod \"9477d5d9-b865-412d-9064-69d18affed55\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") "
Jul 21 20:43:42.061676 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.061630    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-service-ca\") pod \"9477d5d9-b865-412d-9064-69d18affed55\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") "
Jul 21 20:43:42.061864 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.061689    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-oauth-serving-cert\") pod \"9477d5d9-b865-412d-9064-69d18affed55\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") "
Jul 21 20:43:42.061864 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.061716    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85wjt\" (UniqueName: \"kubernetes.io/projected/9477d5d9-b865-412d-9064-69d18affed55-kube-api-access-85wjt\") pod \"9477d5d9-b865-412d-9064-69d18affed55\" (UID: \"9477d5d9-b865-412d-9064-69d18affed55\") "
Jul 21 20:43:42.062179 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.062150    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9477d5d9-b865-412d-9064-69d18affed55" (UID: "9477d5d9-b865-412d-9064-69d18affed55"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:43:42.062301 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.062207    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9477d5d9-b865-412d-9064-69d18affed55" (UID: "9477d5d9-b865-412d-9064-69d18affed55"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:43:42.062301 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.062153    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-console-config" (OuterVolumeSpecName: "console-config") pod "9477d5d9-b865-412d-9064-69d18affed55" (UID: "9477d5d9-b865-412d-9064-69d18affed55"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:43:42.062301 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.062284    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-service-ca" (OuterVolumeSpecName: "service-ca") pod "9477d5d9-b865-412d-9064-69d18affed55" (UID: "9477d5d9-b865-412d-9064-69d18affed55"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:43:42.063756 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.063728    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9477d5d9-b865-412d-9064-69d18affed55" (UID: "9477d5d9-b865-412d-9064-69d18affed55"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:43:42.063853 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.063820    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9477d5d9-b865-412d-9064-69d18affed55" (UID: "9477d5d9-b865-412d-9064-69d18affed55"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:43:42.063853 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.063833    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9477d5d9-b865-412d-9064-69d18affed55-kube-api-access-85wjt" (OuterVolumeSpecName: "kube-api-access-85wjt") pod "9477d5d9-b865-412d-9064-69d18affed55" (UID: "9477d5d9-b865-412d-9064-69d18affed55"). InnerVolumeSpecName "kube-api-access-85wjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:43:42.162786 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.162758    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:42.162786 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.162781    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-trusted-ca-bundle\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:42.162786 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.162793    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-console-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:42.163020 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.162802    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9477d5d9-b865-412d-9064-69d18affed55-console-oauth-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:42.163020 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.162810    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:42.163020 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.162819    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9477d5d9-b865-412d-9064-69d18affed55-oauth-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:42.163020 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.162827    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85wjt\" (UniqueName: \"kubernetes.io/projected/9477d5d9-b865-412d-9064-69d18affed55-kube-api-access-85wjt\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:43:42.714017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.713981    2560 generic.go:356] "Generic (PLEG): container finished" podID="9477d5d9-b865-412d-9064-69d18affed55" containerID="d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f" exitCode=0
Jul 21 20:43:42.714017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.714020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8756c84c-fcht7" event={"ID":"9477d5d9-b865-412d-9064-69d18affed55","Type":"ContainerDied","Data":"d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f"}
Jul 21 20:43:42.714508 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.714027    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8756c84c-fcht7"
Jul 21 20:43:42.714508 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.714059    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8756c84c-fcht7" event={"ID":"9477d5d9-b865-412d-9064-69d18affed55","Type":"ContainerDied","Data":"70f797d2fe4c17cefa8ec204062f8c19f53bd7d48483c71810b4954a1e4aba43"}
Jul 21 20:43:42.714508 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.714079    2560 scope.go:117] "RemoveContainer" containerID="d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f"
Jul 21 20:43:42.722146 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.722122    2560 scope.go:117] "RemoveContainer" containerID="d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f"
Jul 21 20:43:42.722405 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:43:42.722386    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f\": container with ID starting with d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f not found: ID does not exist" containerID="d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f"
Jul 21 20:43:42.722501 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.722413    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f"} err="failed to get container status \"d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f\": rpc error: code = NotFound desc = could not find container \"d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f\": container with ID starting with d56915d0f7ad06f228d20950fd51b06a209460d33f3942edff54b835dbdd276f not found: ID does not exist"
Jul 21 20:43:42.730767 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.730747    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8756c84c-fcht7"]
Jul 21 20:43:42.732091 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:42.732072    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8756c84c-fcht7"]
Jul 21 20:43:44.496931 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:43:44.496897    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9477d5d9-b865-412d-9064-69d18affed55" path="/var/lib/kubelet/pods/9477d5d9-b865-412d-9064-69d18affed55/volumes"
Jul 21 20:44:30.235571 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.235533    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z"]
Jul 21 20:44:30.236008 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.235839    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53b74c4a-78ab-458a-ac52-f942452a5652" containerName="console"
Jul 21 20:44:30.236008 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.235849    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="53b74c4a-78ab-458a-ac52-f942452a5652" containerName="console"
Jul 21 20:44:30.236008 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.235861    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9477d5d9-b865-412d-9064-69d18affed55" containerName="console"
Jul 21 20:44:30.236008 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.235867    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9477d5d9-b865-412d-9064-69d18affed55" containerName="console"
Jul 21 20:44:30.236008 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.235920    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="53b74c4a-78ab-458a-ac52-f942452a5652" containerName="console"
Jul 21 20:44:30.236008 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.235929    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9477d5d9-b865-412d-9064-69d18affed55" containerName="console"
Jul 21 20:44:30.239062 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.239043    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z"
Jul 21 20:44:30.241440 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.241410    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 20:44:30.241563 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.241461    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gbwgp\""
Jul 21 20:44:30.242117 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.242097    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 20:44:30.253097 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.253075    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z"]
Jul 21 20:44:30.359907 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.359871    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmjws\" (UniqueName: \"kubernetes.io/projected/690fe550-c0c8-42bf-981b-897c18b2972c-kube-api-access-nmjws\") pod \"openshift-lws-operator-fd8ccff4c-9lg6z\" (UID: \"690fe550-c0c8-42bf-981b-897c18b2972c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z"
Jul 21 20:44:30.360065 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.359926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/690fe550-c0c8-42bf-981b-897c18b2972c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9lg6z\" (UID: \"690fe550-c0c8-42bf-981b-897c18b2972c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z"
Jul 21 20:44:30.461347 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.461300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmjws\" (UniqueName: \"kubernetes.io/projected/690fe550-c0c8-42bf-981b-897c18b2972c-kube-api-access-nmjws\") pod \"openshift-lws-operator-fd8ccff4c-9lg6z\" (UID: \"690fe550-c0c8-42bf-981b-897c18b2972c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z"
Jul 21 20:44:30.461489 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.461363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/690fe550-c0c8-42bf-981b-897c18b2972c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9lg6z\" (UID: \"690fe550-c0c8-42bf-981b-897c18b2972c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z"
Jul 21 20:44:30.461748 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.461731    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/690fe550-c0c8-42bf-981b-897c18b2972c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9lg6z\" (UID: \"690fe550-c0c8-42bf-981b-897c18b2972c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z"
Jul 21 20:44:30.475795 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.475767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmjws\" (UniqueName: \"kubernetes.io/projected/690fe550-c0c8-42bf-981b-897c18b2972c-kube-api-access-nmjws\") pod \"openshift-lws-operator-fd8ccff4c-9lg6z\" (UID: \"690fe550-c0c8-42bf-981b-897c18b2972c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z"
Jul 21 20:44:30.559525 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.559499    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z"
Jul 21 20:44:30.694538 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.694510    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z"]
Jul 21 20:44:30.697618 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:44:30.697584    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod690fe550_c0c8_42bf_981b_897c18b2972c.slice/crio-eba1b37a6181b3d9448382103d491cac20b492244598917de6a4fb7f06de27f1 WatchSource:0}: Error finding container eba1b37a6181b3d9448382103d491cac20b492244598917de6a4fb7f06de27f1: Status 404 returned error can't find the container with id eba1b37a6181b3d9448382103d491cac20b492244598917de6a4fb7f06de27f1
Jul 21 20:44:30.907671 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:30.907597    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z" event={"ID":"690fe550-c0c8-42bf-981b-897c18b2972c","Type":"ContainerStarted","Data":"eba1b37a6181b3d9448382103d491cac20b492244598917de6a4fb7f06de27f1"}
Jul 21 20:44:33.923741 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:33.923708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z" event={"ID":"690fe550-c0c8-42bf-981b-897c18b2972c","Type":"ContainerStarted","Data":"13086c75f7617c2acb5fd2b5af33be775a93d26701f4993aa80e12ea86d1c00c"}
Jul 21 20:44:34.405471 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:34.405441    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 20:44:34.408960 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:34.408940    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:44:34.410497 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:34.410478    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 20:44:34.414495 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:34.414472    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:44:34.416169 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:34.416146    2560 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 20:44:54.091246 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.091179    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9lg6z" podStartSLOduration=21.683460253 podStartE2EDuration="24.091161102s" totalImagesPullingTime="2.407700849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:44:33.94883382 +0000 UTC m=+299.969242284" watchObservedRunningTime="2026-07-21 20:44:54.091161102 +0000 UTC m=+320.111569565"
Jul 21 20:44:54.094080 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.091970    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"]
Jul 21 20:44:54.095378 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.095357    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.099747 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.099717    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 20:44:54.100747 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.100722    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 20:44:54.101529 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.101507    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 20:44:54.101643 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.101545    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 20:44:54.101721 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.101677    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rvl9p\""
Jul 21 20:44:54.125082 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.125055    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"]
Jul 21 20:44:54.263440 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.263405    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11751f16-0e4e-4904-9cd8-d428de2dd34a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.263573 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.263453    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c25vn\" (UniqueName: \"kubernetes.io/projected/11751f16-0e4e-4904-9cd8-d428de2dd34a-kube-api-access-c25vn\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.263573 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.263527    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11751f16-0e4e-4904-9cd8-d428de2dd34a-tmp\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.263688 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.263595    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11751f16-0e4e-4904-9cd8-d428de2dd34a-webhook-cert\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.263688 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.263636    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11751f16-0e4e-4904-9cd8-d428de2dd34a-manifests\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.364281 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.364200    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11751f16-0e4e-4904-9cd8-d428de2dd34a-tmp\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.364281 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.364259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11751f16-0e4e-4904-9cd8-d428de2dd34a-webhook-cert\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.364484 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.364287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11751f16-0e4e-4904-9cd8-d428de2dd34a-manifests\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.364484 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.364314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11751f16-0e4e-4904-9cd8-d428de2dd34a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.364484 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.364337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c25vn\" (UniqueName: \"kubernetes.io/projected/11751f16-0e4e-4904-9cd8-d428de2dd34a-kube-api-access-c25vn\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.364761 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.364729    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11751f16-0e4e-4904-9cd8-d428de2dd34a-manifests\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.366488 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.366464    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11751f16-0e4e-4904-9cd8-d428de2dd34a-tmp\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.366714 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.366694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11751f16-0e4e-4904-9cd8-d428de2dd34a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.366851 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.366832    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11751f16-0e4e-4904-9cd8-d428de2dd34a-webhook-cert\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.372313 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.372294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c25vn\" (UniqueName: \"kubernetes.io/projected/11751f16-0e4e-4904-9cd8-d428de2dd34a-kube-api-access-c25vn\") pod \"opendatahub-operator-controller-manager-647bdf6675-4d7pt\" (UID: \"11751f16-0e4e-4904-9cd8-d428de2dd34a\") " pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.406019 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.405993    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:44:54.562935 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.562911    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"]
Jul 21 20:44:54.564706 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:44:54.564682    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11751f16_0e4e_4904_9cd8_d428de2dd34a.slice/crio-9adca3d7e6af658519761ed76583e9a2616efd173c2ad9cfb6d28290f17cdc37 WatchSource:0}: Error finding container 9adca3d7e6af658519761ed76583e9a2616efd173c2ad9cfb6d28290f17cdc37: Status 404 returned error can't find the container with id 9adca3d7e6af658519761ed76583e9a2616efd173c2ad9cfb6d28290f17cdc37
Jul 21 20:44:54.566250 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:54.566231    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 20:44:55.007905 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:55.007869    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt" event={"ID":"11751f16-0e4e-4904-9cd8-d428de2dd34a","Type":"ContainerStarted","Data":"9adca3d7e6af658519761ed76583e9a2616efd173c2ad9cfb6d28290f17cdc37"}
Jul 21 20:44:58.024683 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:58.024595    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt" event={"ID":"11751f16-0e4e-4904-9cd8-d428de2dd34a","Type":"ContainerStarted","Data":"eb51724a730ea58279d1813033a0a10f34db87789b617b8d84f193fc2f6d57da"}
Jul 21 20:44:59.030831 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:59.030792    2560 generic.go:356] "Generic (PLEG): container finished" podID="11751f16-0e4e-4904-9cd8-d428de2dd34a" containerID="eb51724a730ea58279d1813033a0a10f34db87789b617b8d84f193fc2f6d57da" exitCode=0
Jul 21 20:44:59.031237 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:44:59.030849    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt" event={"ID":"11751f16-0e4e-4904-9cd8-d428de2dd34a","Type":"ContainerDied","Data":"eb51724a730ea58279d1813033a0a10f34db87789b617b8d84f193fc2f6d57da"}
Jul 21 20:45:00.037175 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:00.037137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt" event={"ID":"11751f16-0e4e-4904-9cd8-d428de2dd34a","Type":"ContainerStarted","Data":"9ef851b58c5afddddaabbb79e229064251d7b822aead124842143a1e4a38a002"}
Jul 21 20:45:00.037649 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:00.037305    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:45:11.044112 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:11.044084    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt"
Jul 21 20:45:11.070005 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:11.069959    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-647bdf6675-4d7pt" podStartSLOduration=12.568358058 podStartE2EDuration="17.06994335s" totalImagesPullingTime="3.444508257s" totalInitContainerRuntime="1.057077035s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:44:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:45:00.085493751 +0000 UTC m=+326.105902238" watchObservedRunningTime="2026-07-21 20:45:11.06994335 +0000 UTC m=+337.090351813"
Jul 21 20:45:23.730732 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.730694    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"]
Jul 21 20:45:23.741097 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.741064    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.748639 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.747552    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sj469\""
Jul 21 20:45:23.748639 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.747660    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 20:45:23.748639 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.747691    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 20:45:23.748639 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.747546    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 20:45:23.748639 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.747882    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"]
Jul 21 20:45:23.828391 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.828359    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m225z\" (UniqueName: \"kubernetes.io/projected/3958f856-4f5a-49fb-b430-a23e9440e12e-kube-api-access-m225z\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.828549 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.828450    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3958f856-4f5a-49fb-b430-a23e9440e12e-manager-config\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.828549 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.828514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3958f856-4f5a-49fb-b430-a23e9440e12e-cert\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.828549 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.828532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3958f856-4f5a-49fb-b430-a23e9440e12e-metrics-cert\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.929328 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.929293    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3958f856-4f5a-49fb-b430-a23e9440e12e-metrics-cert\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.929498 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.929361    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m225z\" (UniqueName: \"kubernetes.io/projected/3958f856-4f5a-49fb-b430-a23e9440e12e-kube-api-access-m225z\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.929498 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.929451    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3958f856-4f5a-49fb-b430-a23e9440e12e-manager-config\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.929616 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.929590    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3958f856-4f5a-49fb-b430-a23e9440e12e-cert\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.930233 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.930205    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3958f856-4f5a-49fb-b430-a23e9440e12e-manager-config\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.931653 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.931632    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3958f856-4f5a-49fb-b430-a23e9440e12e-metrics-cert\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.931907 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.931886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3958f856-4f5a-49fb-b430-a23e9440e12e-cert\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:23.938647 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:23.938623    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m225z\" (UniqueName: \"kubernetes.io/projected/3958f856-4f5a-49fb-b430-a23e9440e12e-kube-api-access-m225z\") pod \"lws-controller-manager-66f9b7665f-bfsj2\" (UID: \"3958f856-4f5a-49fb-b430-a23e9440e12e\") " pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:24.052248 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:24.052157    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:24.223530 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:24.223500    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"]
Jul 21 20:45:24.225145 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:45:24.225122    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3958f856_4f5a_49fb_b430_a23e9440e12e.slice/crio-621c2a23b590003b744fadabe8b64a571c5cab2fe3b5a0519339e85d647c1db9 WatchSource:0}: Error finding container 621c2a23b590003b744fadabe8b64a571c5cab2fe3b5a0519339e85d647c1db9: Status 404 returned error can't find the container with id 621c2a23b590003b744fadabe8b64a571c5cab2fe3b5a0519339e85d647c1db9
Jul 21 20:45:25.148998 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.148961    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2" event={"ID":"3958f856-4f5a-49fb-b430-a23e9440e12e","Type":"ContainerStarted","Data":"621c2a23b590003b744fadabe8b64a571c5cab2fe3b5a0519339e85d647c1db9"}
Jul 21 20:45:25.334779 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.334743    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"]
Jul 21 20:45:25.338507 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.338486    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.347844 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.347819    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 20:45:25.347957 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.347887    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5ftp5\""
Jul 21 20:45:25.380992 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.380938    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"]
Jul 21 20:45:25.442046 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.441963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.442046 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.442011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.442046 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.442048    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a83dfd72-d4cd-409b-9496-828fd4f3153f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.442342 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.442077    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.442342 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.442105    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kfj9\" (UniqueName: \"kubernetes.io/projected/a83dfd72-d4cd-409b-9496-828fd4f3153f-kube-api-access-5kfj9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.442342 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.442227    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.442342 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.442285    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.442342 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.442332    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.442547 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.442381    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.543313 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.543274    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.543463 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.543314    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.543463 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.543345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a83dfd72-d4cd-409b-9496-828fd4f3153f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.543463 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.543374    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.543463 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.543405    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kfj9\" (UniqueName: \"kubernetes.io/projected/a83dfd72-d4cd-409b-9496-828fd4f3153f-kube-api-access-5kfj9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.543730 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.543480    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.543730 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.543528    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.543730 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.543704    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.543889 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.543751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.543944 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.543920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.543997 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.543972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.544057 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.544008    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.544160 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.544138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.544269 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.544236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a83dfd72-d4cd-409b-9496-828fd4f3153f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.545713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.545683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.545826 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.545804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.556386 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.556365    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kfj9\" (UniqueName: \"kubernetes.io/projected/a83dfd72-d4cd-409b-9496-828fd4f3153f-kube-api-access-5kfj9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.556472 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.556456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a83dfd72-d4cd-409b-9496-828fd4f3153f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf42hn98\" (UID: \"a83dfd72-d4cd-409b-9496-828fd4f3153f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.651115 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.651091    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:25.847601 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:25.847561    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"]
Jul 21 20:45:25.866000 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:45:25.865970    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda83dfd72_d4cd_409b_9496_828fd4f3153f.slice/crio-ce19eb5ef07356d6b5d2190bca7ac1b03f9b485fe4f5f02268083e62be59c30c WatchSource:0}: Error finding container ce19eb5ef07356d6b5d2190bca7ac1b03f9b485fe4f5f02268083e62be59c30c: Status 404 returned error can't find the container with id ce19eb5ef07356d6b5d2190bca7ac1b03f9b485fe4f5f02268083e62be59c30c
Jul 21 20:45:26.155459 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:26.155409    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2" event={"ID":"3958f856-4f5a-49fb-b430-a23e9440e12e","Type":"ContainerStarted","Data":"cf672d937ec7a379a65e197df0d8e642fdea533e445d9d396c8919f97b76178f"}
Jul 21 20:45:26.155959 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:26.155551    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:26.156945 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:26.156908    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98" event={"ID":"a83dfd72-d4cd-409b-9496-828fd4f3153f","Type":"ContainerStarted","Data":"ce19eb5ef07356d6b5d2190bca7ac1b03f9b485fe4f5f02268083e62be59c30c"}
Jul 21 20:45:26.182258 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:26.182180    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2" podStartSLOduration=1.818855418 podStartE2EDuration="3.182164708s" totalImagesPullingTime="1.36330929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:45:26.179786881 +0000 UTC m=+352.200195340" watchObservedRunningTime="2026-07-21 20:45:26.182164708 +0000 UTC m=+352.202573171"
Jul 21 20:45:27.937792 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:27.937710    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-49cml"]
Jul 21 20:45:27.944667 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:27.944635    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml"
Jul 21 20:45:27.949435 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:27.949400    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fqhm6\""
Jul 21 20:45:27.949569 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:27.949472    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 21 20:45:27.980636 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:27.980569    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-49cml"]
Jul 21 20:45:28.068312 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:28.068270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e3913a-b89c-48b7-9cf2-95eef8b1fd8b-cert\") pod \"kserve-controller-manager-d6f4b65b8-49cml\" (UID: \"29e3913a-b89c-48b7-9cf2-95eef8b1fd8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml"
Jul 21 20:45:28.068504 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:28.068401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncw2z\" (UniqueName: \"kubernetes.io/projected/29e3913a-b89c-48b7-9cf2-95eef8b1fd8b-kube-api-access-ncw2z\") pod \"kserve-controller-manager-d6f4b65b8-49cml\" (UID: \"29e3913a-b89c-48b7-9cf2-95eef8b1fd8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml"
Jul 21 20:45:28.169125 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:28.169092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e3913a-b89c-48b7-9cf2-95eef8b1fd8b-cert\") pod \"kserve-controller-manager-d6f4b65b8-49cml\" (UID: \"29e3913a-b89c-48b7-9cf2-95eef8b1fd8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml"
Jul 21 20:45:28.169340 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:28.169164    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncw2z\" (UniqueName: \"kubernetes.io/projected/29e3913a-b89c-48b7-9cf2-95eef8b1fd8b-kube-api-access-ncw2z\") pod \"kserve-controller-manager-d6f4b65b8-49cml\" (UID: \"29e3913a-b89c-48b7-9cf2-95eef8b1fd8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml"
Jul 21 20:45:28.171825 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:28.171798    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e3913a-b89c-48b7-9cf2-95eef8b1fd8b-cert\") pod \"kserve-controller-manager-d6f4b65b8-49cml\" (UID: \"29e3913a-b89c-48b7-9cf2-95eef8b1fd8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml"
Jul 21 20:45:28.186591 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:28.186565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncw2z\" (UniqueName: \"kubernetes.io/projected/29e3913a-b89c-48b7-9cf2-95eef8b1fd8b-kube-api-access-ncw2z\") pod \"kserve-controller-manager-d6f4b65b8-49cml\" (UID: \"29e3913a-b89c-48b7-9cf2-95eef8b1fd8b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml"
Jul 21 20:45:28.258483 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:28.258407    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml"
Jul 21 20:45:28.978075 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:28.974629    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-49cml"]
Jul 21 20:45:29.172593 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:29.172520    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml" event={"ID":"29e3913a-b89c-48b7-9cf2-95eef8b1fd8b","Type":"ContainerStarted","Data":"ef32825419311d50bf23a1bad60a13e63a6d06bb16bdc62252464c54c367f6b2"}
Jul 21 20:45:29.256101 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:29.256048    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:29.256244 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:29.256139    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:29.256244 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:29.256174    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 20:45:30.181315 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:30.181268    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98" event={"ID":"a83dfd72-d4cd-409b-9496-828fd4f3153f","Type":"ContainerStarted","Data":"7a6791012ee55dfd554df02e1bd9f0aa90e85928dc4f372424aaa915ac39f4c8"}
Jul 21 20:45:30.226502 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:30.226453    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98" podStartSLOduration=1.8389176470000002 podStartE2EDuration="5.226437181s" totalImagesPullingTime="3.387519534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:45:30.223377301 +0000 UTC m=+356.243785764" watchObservedRunningTime="2026-07-21 20:45:30.226437181 +0000 UTC m=+356.246845644"
Jul 21 20:45:30.651726 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:30.651693    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:30.656038 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:30.656015    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:31.187573 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:31.187501    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:31.188825 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:31.188799    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf42hn98"
Jul 21 20:45:32.192851 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:32.192818    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml" event={"ID":"29e3913a-b89c-48b7-9cf2-95eef8b1fd8b","Type":"ContainerStarted","Data":"1349b3d40387f8d3cd788c305e1f9f96c4169e8f29eb797b1c8edf0d02425767"}
Jul 21 20:45:32.193334 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:32.193093    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml"
Jul 21 20:45:37.164713 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:37.164678    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66f9b7665f-bfsj2"
Jul 21 20:45:37.182714 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:45:37.182618    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml" podStartSLOduration=7.776171649 podStartE2EDuration="10.182596687s" totalImagesPullingTime="2.406425038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:45:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:45:32.304228926 +0000 UTC m=+358.324637390" watchObservedRunningTime="2026-07-21 20:45:37.182596687 +0000 UTC m=+363.203005150"
Jul 21 20:46:03.202792 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:03.202760    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-49cml"
Jul 21 20:46:15.451916 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.451877    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9gn5"]
Jul 21 20:46:15.460537 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.460510    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l9gn5"
Jul 21 20:46:15.463279 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.463255    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-wss7q\""
Jul 21 20:46:15.463474 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.463255    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 20:46:15.464071 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.464054    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 20:46:15.469903 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.469880    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9gn5"]
Jul 21 20:46:15.592896 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.592856    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9wxq\" (UniqueName: \"kubernetes.io/projected/01cfe422-bfb3-4025-9e7f-d8307ff9b3a5-kube-api-access-r9wxq\") pod \"kuadrant-operator-catalog-l9gn5\" (UID: \"01cfe422-bfb3-4025-9e7f-d8307ff9b3a5\") " pod="kuadrant-system/kuadrant-operator-catalog-l9gn5"
Jul 21 20:46:15.693831 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.693791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9wxq\" (UniqueName: \"kubernetes.io/projected/01cfe422-bfb3-4025-9e7f-d8307ff9b3a5-kube-api-access-r9wxq\") pod \"kuadrant-operator-catalog-l9gn5\" (UID: \"01cfe422-bfb3-4025-9e7f-d8307ff9b3a5\") " pod="kuadrant-system/kuadrant-operator-catalog-l9gn5"
Jul 21 20:46:15.702278 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.702220    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9wxq\" (UniqueName: \"kubernetes.io/projected/01cfe422-bfb3-4025-9e7f-d8307ff9b3a5-kube-api-access-r9wxq\") pod \"kuadrant-operator-catalog-l9gn5\" (UID: \"01cfe422-bfb3-4025-9e7f-d8307ff9b3a5\") " pod="kuadrant-system/kuadrant-operator-catalog-l9gn5"
Jul 21 20:46:15.773428 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.773389    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l9gn5"
Jul 21 20:46:15.794155 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.794128    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9gn5"]
Jul 21 20:46:15.904070 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:15.904035    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9gn5"]
Jul 21 20:46:15.907266 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:46:15.907236    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01cfe422_bfb3_4025_9e7f_d8307ff9b3a5.slice/crio-d2c95a03d1ea0d87c7f755ab7872dae6bb8abc10bef219469d6845f62c4f3d6b WatchSource:0}: Error finding container d2c95a03d1ea0d87c7f755ab7872dae6bb8abc10bef219469d6845f62c4f3d6b: Status 404 returned error can't find the container with id d2c95a03d1ea0d87c7f755ab7872dae6bb8abc10bef219469d6845f62c4f3d6b
Jul 21 20:46:16.006340 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:16.006259    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xf4pd"]
Jul 21 20:46:16.010609 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:16.010593    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xf4pd"
Jul 21 20:46:16.016580 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:16.016559    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xf4pd"]
Jul 21 20:46:16.097271 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:16.097232    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqx6f\" (UniqueName: \"kubernetes.io/projected/50cf08c1-edca-4922-806e-1810c8251a98-kube-api-access-gqx6f\") pod \"kuadrant-operator-catalog-xf4pd\" (UID: \"50cf08c1-edca-4922-806e-1810c8251a98\") " pod="kuadrant-system/kuadrant-operator-catalog-xf4pd"
Jul 21 20:46:16.198664 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:16.198631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqx6f\" (UniqueName: \"kubernetes.io/projected/50cf08c1-edca-4922-806e-1810c8251a98-kube-api-access-gqx6f\") pod \"kuadrant-operator-catalog-xf4pd\" (UID: \"50cf08c1-edca-4922-806e-1810c8251a98\") " pod="kuadrant-system/kuadrant-operator-catalog-xf4pd"
Jul 21 20:46:16.207069 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:16.207032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqx6f\" (UniqueName: \"kubernetes.io/projected/50cf08c1-edca-4922-806e-1810c8251a98-kube-api-access-gqx6f\") pod \"kuadrant-operator-catalog-xf4pd\" (UID: \"50cf08c1-edca-4922-806e-1810c8251a98\") " pod="kuadrant-system/kuadrant-operator-catalog-xf4pd"
Jul 21 20:46:16.321068 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:16.321032    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xf4pd"
Jul 21 20:46:16.395226 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:16.395175    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l9gn5" event={"ID":"01cfe422-bfb3-4025-9e7f-d8307ff9b3a5","Type":"ContainerStarted","Data":"d2c95a03d1ea0d87c7f755ab7872dae6bb8abc10bef219469d6845f62c4f3d6b"}
Jul 21 20:46:16.473152 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:16.473127    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xf4pd"]
Jul 21 20:46:16.481835 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:46:16.481810    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50cf08c1_edca_4922_806e_1810c8251a98.slice/crio-e2cb800cbbfa56ddfa432785e476cf74accc42723d61759abfb37bd8b37dde91 WatchSource:0}: Error finding container e2cb800cbbfa56ddfa432785e476cf74accc42723d61759abfb37bd8b37dde91: Status 404 returned error can't find the container with id e2cb800cbbfa56ddfa432785e476cf74accc42723d61759abfb37bd8b37dde91
Jul 21 20:46:17.401404 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:17.401369    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xf4pd" event={"ID":"50cf08c1-edca-4922-806e-1810c8251a98","Type":"ContainerStarted","Data":"e2cb800cbbfa56ddfa432785e476cf74accc42723d61759abfb37bd8b37dde91"}
Jul 21 20:46:18.406992 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:18.406951    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l9gn5" event={"ID":"01cfe422-bfb3-4025-9e7f-d8307ff9b3a5","Type":"ContainerStarted","Data":"b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb"}
Jul 21 20:46:18.407474 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:18.407060    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l9gn5" podUID="01cfe422-bfb3-4025-9e7f-d8307ff9b3a5" containerName="registry-server" containerID="cri-o://b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb" gracePeriod=2
Jul 21 20:46:18.408732 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:18.408708    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xf4pd" event={"ID":"50cf08c1-edca-4922-806e-1810c8251a98","Type":"ContainerStarted","Data":"428be262a7c3e85ca80bf083c48d6f2161f7809694dd75314f6574b6a4a523fa"}
Jul 21 20:46:18.425223 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:18.425163    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l9gn5" podStartSLOduration=1.3037847550000001 podStartE2EDuration="3.425149325s" totalImagesPullingTime="2.12136457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:46:18.423482639 +0000 UTC m=+404.443891102" watchObservedRunningTime="2026-07-21 20:46:18.425149325 +0000 UTC m=+404.445557789"
Jul 21 20:46:18.441652 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:18.441612    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xf4pd" podStartSLOduration=1.892258616 podStartE2EDuration="3.44159892s" totalImagesPullingTime="1.549340304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:46:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:46:18.440727503 +0000 UTC m=+404.461135967" watchObservedRunningTime="2026-07-21 20:46:18.44159892 +0000 UTC m=+404.462007383"
Jul 21 20:46:18.653660 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:18.653635    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l9gn5"
Jul 21 20:46:18.825249 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:18.825220    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9wxq\" (UniqueName: \"kubernetes.io/projected/01cfe422-bfb3-4025-9e7f-d8307ff9b3a5-kube-api-access-r9wxq\") pod \"01cfe422-bfb3-4025-9e7f-d8307ff9b3a5\" (UID: \"01cfe422-bfb3-4025-9e7f-d8307ff9b3a5\") "
Jul 21 20:46:18.827361 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:18.827338    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01cfe422-bfb3-4025-9e7f-d8307ff9b3a5-kube-api-access-r9wxq" (OuterVolumeSpecName: "kube-api-access-r9wxq") pod "01cfe422-bfb3-4025-9e7f-d8307ff9b3a5" (UID: "01cfe422-bfb3-4025-9e7f-d8307ff9b3a5"). InnerVolumeSpecName "kube-api-access-r9wxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:46:18.926114 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:18.926074    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9wxq\" (UniqueName: \"kubernetes.io/projected/01cfe422-bfb3-4025-9e7f-d8307ff9b3a5-kube-api-access-r9wxq\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:46:19.415353 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:19.415319    2560 generic.go:356] "Generic (PLEG): container finished" podID="01cfe422-bfb3-4025-9e7f-d8307ff9b3a5" containerID="b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb" exitCode=0
Jul 21 20:46:19.415738 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:19.415363    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l9gn5"
Jul 21 20:46:19.415738 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:19.415403    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l9gn5" event={"ID":"01cfe422-bfb3-4025-9e7f-d8307ff9b3a5","Type":"ContainerDied","Data":"b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb"}
Jul 21 20:46:19.415738 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:19.415450    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l9gn5" event={"ID":"01cfe422-bfb3-4025-9e7f-d8307ff9b3a5","Type":"ContainerDied","Data":"d2c95a03d1ea0d87c7f755ab7872dae6bb8abc10bef219469d6845f62c4f3d6b"}
Jul 21 20:46:19.415738 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:19.415471    2560 scope.go:117] "RemoveContainer" containerID="b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb"
Jul 21 20:46:19.424499 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:19.424483    2560 scope.go:117] "RemoveContainer" containerID="b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb"
Jul 21 20:46:19.424759 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:46:19.424741    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb\": container with ID starting with b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb not found: ID does not exist" containerID="b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb"
Jul 21 20:46:19.424822 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:19.424771    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb"} err="failed to get container status \"b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb\": rpc error: code = NotFound desc = could not find container \"b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb\": container with ID starting with b4e326c7df54acbe562789d08e7b8b6942df58ac3e36b8920cca55b416ef16eb not found: ID does not exist"
Jul 21 20:46:19.440461 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:19.440442    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9gn5"]
Jul 21 20:46:19.441886 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:19.441867    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l9gn5"]
Jul 21 20:46:20.496631 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:20.496598    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01cfe422-bfb3-4025-9e7f-d8307ff9b3a5" path="/var/lib/kubelet/pods/01cfe422-bfb3-4025-9e7f-d8307ff9b3a5/volumes"
Jul 21 20:46:26.321770 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:26.321727    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xf4pd"
Jul 21 20:46:26.322171 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:26.321793    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xf4pd"
Jul 21 20:46:26.344055 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:26.344030    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xf4pd"
Jul 21 20:46:26.469365 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:26.469339    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xf4pd"
Jul 21 20:46:46.166017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.165979    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b"]
Jul 21 20:46:46.166469 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.166361    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01cfe422-bfb3-4025-9e7f-d8307ff9b3a5" containerName="registry-server"
Jul 21 20:46:46.166469 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.166374    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="01cfe422-bfb3-4025-9e7f-d8307ff9b3a5" containerName="registry-server"
Jul 21 20:46:46.166469 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.166433    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="01cfe422-bfb3-4025-9e7f-d8307ff9b3a5" containerName="registry-server"
Jul 21 20:46:46.174367 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.174340    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b"
Jul 21 20:46:46.177567 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.177547    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wksf2\""
Jul 21 20:46:46.192301 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.192281    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b"]
Jul 21 20:46:46.257056 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.257029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfdks\" (UniqueName: \"kubernetes.io/projected/90a4f073-10d2-4ca2-80c9-150ff1471e9a-kube-api-access-kfdks\") pod \"authorino-operator-75cc8d5cb7-d4c8b\" (UID: \"90a4f073-10d2-4ca2-80c9-150ff1471e9a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b"
Jul 21 20:46:46.357998 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.357968    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfdks\" (UniqueName: \"kubernetes.io/projected/90a4f073-10d2-4ca2-80c9-150ff1471e9a-kube-api-access-kfdks\") pod \"authorino-operator-75cc8d5cb7-d4c8b\" (UID: \"90a4f073-10d2-4ca2-80c9-150ff1471e9a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b"
Jul 21 20:46:46.366680 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.366651    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfdks\" (UniqueName: \"kubernetes.io/projected/90a4f073-10d2-4ca2-80c9-150ff1471e9a-kube-api-access-kfdks\") pod \"authorino-operator-75cc8d5cb7-d4c8b\" (UID: \"90a4f073-10d2-4ca2-80c9-150ff1471e9a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b"
Jul 21 20:46:46.484420 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.484341    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b"
Jul 21 20:46:46.619791 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:46.619764    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b"]
Jul 21 20:46:46.622514 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:46:46.622486    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a4f073_10d2_4ca2_80c9_150ff1471e9a.slice/crio-17f47ba074376d7786c3b0d44cab14031246de067bfb651e07d4c0a11f37ab42 WatchSource:0}: Error finding container 17f47ba074376d7786c3b0d44cab14031246de067bfb651e07d4c0a11f37ab42: Status 404 returned error can't find the container with id 17f47ba074376d7786c3b0d44cab14031246de067bfb651e07d4c0a11f37ab42
Jul 21 20:46:47.541922 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:47.541883    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b" event={"ID":"90a4f073-10d2-4ca2-80c9-150ff1471e9a","Type":"ContainerStarted","Data":"17f47ba074376d7786c3b0d44cab14031246de067bfb651e07d4c0a11f37ab42"}
Jul 21 20:46:49.553468 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:49.553424    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b" event={"ID":"90a4f073-10d2-4ca2-80c9-150ff1471e9a","Type":"ContainerStarted","Data":"5fbc9c72b353c6c96c0a646c04c770f7655f10ac50796d3bae4efa915ab73205"}
Jul 21 20:46:49.553853 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:49.553496    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b"
Jul 21 20:46:49.575933 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:46:49.575882    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b" podStartSLOduration=1.2842939740000001 podStartE2EDuration="3.575867281s" totalImagesPullingTime="2.291573307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:46:49.573329357 +0000 UTC m=+435.593737820" watchObservedRunningTime="2026-07-21 20:46:49.575867281 +0000 UTC m=+435.596275744"
Jul 21 20:47:00.560681 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:00.560611    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4c8b"
Jul 21 20:47:15.204298 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:15.204263    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx"]
Jul 21 20:47:15.207996 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:15.207977    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx"
Jul 21 20:47:15.211903 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:15.211884    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2zmzt\""
Jul 21 20:47:15.239228 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:15.239199    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx"]
Jul 21 20:47:15.315943 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:15.315911    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbw4c\" (UniqueName: \"kubernetes.io/projected/cd38af5b-5544-4574-95c4-f429738d9125-kube-api-access-nbw4c\") pod \"limitador-operator-controller-manager-859d7b78bd-mdbgx\" (UID: \"cd38af5b-5544-4574-95c4-f429738d9125\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx"
Jul 21 20:47:15.417331 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:15.417298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbw4c\" (UniqueName: \"kubernetes.io/projected/cd38af5b-5544-4574-95c4-f429738d9125-kube-api-access-nbw4c\") pod \"limitador-operator-controller-manager-859d7b78bd-mdbgx\" (UID: \"cd38af5b-5544-4574-95c4-f429738d9125\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx"
Jul 21 20:47:15.433700 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:15.433674    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbw4c\" (UniqueName: \"kubernetes.io/projected/cd38af5b-5544-4574-95c4-f429738d9125-kube-api-access-nbw4c\") pod \"limitador-operator-controller-manager-859d7b78bd-mdbgx\" (UID: \"cd38af5b-5544-4574-95c4-f429738d9125\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx"
Jul 21 20:47:15.521023 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:15.520948    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx"
Jul 21 20:47:15.682790 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:15.682607    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx"]
Jul 21 20:47:15.686078 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:47:15.686048    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd38af5b_5544_4574_95c4_f429738d9125.slice/crio-9ae0b15a6370b75e1eab043149e152df9df0ee7d9c886671be7fc38596a270d8 WatchSource:0}: Error finding container 9ae0b15a6370b75e1eab043149e152df9df0ee7d9c886671be7fc38596a270d8: Status 404 returned error can't find the container with id 9ae0b15a6370b75e1eab043149e152df9df0ee7d9c886671be7fc38596a270d8
Jul 21 20:47:16.682851 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:16.682812    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx" event={"ID":"cd38af5b-5544-4574-95c4-f429738d9125","Type":"ContainerStarted","Data":"9ae0b15a6370b75e1eab043149e152df9df0ee7d9c886671be7fc38596a270d8"}
Jul 21 20:47:17.688776 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:17.688739    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx" event={"ID":"cd38af5b-5544-4574-95c4-f429738d9125","Type":"ContainerStarted","Data":"96b4d4a5061269d56b4b399b5dd18bba6030487ffce27a904a6a87a0a397172d"}
Jul 21 20:47:17.689207 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:17.688900    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx"
Jul 21 20:47:17.708024 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:17.707977    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx" podStartSLOduration=1.376820794 podStartE2EDuration="2.707962051s" totalImagesPullingTime="1.331141257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:47:17.707014924 +0000 UTC m=+463.727423389" watchObservedRunningTime="2026-07-21 20:47:17.707962051 +0000 UTC m=+463.728370566"
Jul 21 20:47:28.696504 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:28.696473    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mdbgx"
Jul 21 20:47:48.780644 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:48.780608    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:47:48.784370 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:48.784346    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"
Jul 21 20:47:48.787594 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:48.787576    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 20:47:48.787671 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:48.787576    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tlcgm\""
Jul 21 20:47:48.794495 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:48.794477    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:47:48.835616 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:48.835582    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:47:48.918063 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:48.918031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lhz6\" (UniqueName: \"kubernetes.io/projected/a7b76d39-116b-4bbb-b06d-e41908a9439a-kube-api-access-5lhz6\") pod \"limitador-limitador-54d6d988d5-mh7g8\" (UID: \"a7b76d39-116b-4bbb-b06d-e41908a9439a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"
Jul 21 20:47:48.918231 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:48.918097    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a7b76d39-116b-4bbb-b06d-e41908a9439a-config-file\") pod \"limitador-limitador-54d6d988d5-mh7g8\" (UID: \"a7b76d39-116b-4bbb-b06d-e41908a9439a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"
Jul 21 20:47:49.018867 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:49.018834    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a7b76d39-116b-4bbb-b06d-e41908a9439a-config-file\") pod \"limitador-limitador-54d6d988d5-mh7g8\" (UID: \"a7b76d39-116b-4bbb-b06d-e41908a9439a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"
Jul 21 20:47:49.019031 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:49.018895    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lhz6\" (UniqueName: \"kubernetes.io/projected/a7b76d39-116b-4bbb-b06d-e41908a9439a-kube-api-access-5lhz6\") pod \"limitador-limitador-54d6d988d5-mh7g8\" (UID: \"a7b76d39-116b-4bbb-b06d-e41908a9439a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"
Jul 21 20:47:49.019475 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:49.019454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a7b76d39-116b-4bbb-b06d-e41908a9439a-config-file\") pod \"limitador-limitador-54d6d988d5-mh7g8\" (UID: \"a7b76d39-116b-4bbb-b06d-e41908a9439a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"
Jul 21 20:47:49.029133 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:49.029111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lhz6\" (UniqueName: \"kubernetes.io/projected/a7b76d39-116b-4bbb-b06d-e41908a9439a-kube-api-access-5lhz6\") pod \"limitador-limitador-54d6d988d5-mh7g8\" (UID: \"a7b76d39-116b-4bbb-b06d-e41908a9439a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"
Jul 21 20:47:49.095141 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:49.095110    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"
Jul 21 20:47:49.230142 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:49.229991    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:47:49.232531 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:47:49.232499    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b76d39_116b_4bbb_b06d_e41908a9439a.slice/crio-d95edab96273d8810b98cd52b6d2322c36d98553fcff1cecf5a8bb234d568b0b WatchSource:0}: Error finding container d95edab96273d8810b98cd52b6d2322c36d98553fcff1cecf5a8bb234d568b0b: Status 404 returned error can't find the container with id d95edab96273d8810b98cd52b6d2322c36d98553fcff1cecf5a8bb234d568b0b
Jul 21 20:47:49.838076 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:49.838028    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8" event={"ID":"a7b76d39-116b-4bbb-b06d-e41908a9439a","Type":"ContainerStarted","Data":"d95edab96273d8810b98cd52b6d2322c36d98553fcff1cecf5a8bb234d568b0b"}
Jul 21 20:47:52.856635 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:52.856595    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8" event={"ID":"a7b76d39-116b-4bbb-b06d-e41908a9439a","Type":"ContainerStarted","Data":"eb26f947f8ad4a4875a3044163573f6dad6a7f8c9f54ea7e0e76b696805eba09"}
Jul 21 20:47:52.857017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:47:52.856728    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"
Jul 21 20:48:03.862485 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:03.862449    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"
Jul 21 20:48:03.882581 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:03.882523    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mh7g8" podStartSLOduration=13.26377836 podStartE2EDuration="15.882507226s" totalImagesPullingTime="2.618728866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:47:52.890008946 +0000 UTC m=+498.910417410" watchObservedRunningTime="2026-07-21 20:48:03.882507226 +0000 UTC m=+509.902915731"
Jul 21 20:48:07.227338 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.227284    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b9995ff55-2qtqg"]
Jul 21 20:48:07.231361 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.231336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.241527 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.241387    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9995ff55-2qtqg"]
Jul 21 20:48:07.391588 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.391553    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-service-ca\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.391588 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.391592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5821f194-fc0a-4e0a-8c6a-82f5090fc635-console-oauth-config\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.391855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.391612    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4gw2\" (UniqueName: \"kubernetes.io/projected/5821f194-fc0a-4e0a-8c6a-82f5090fc635-kube-api-access-r4gw2\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.391855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.391675    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-oauth-serving-cert\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.391855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.391766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5821f194-fc0a-4e0a-8c6a-82f5090fc635-console-serving-cert\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.391855 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.391819    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-console-config\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.391999 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.391869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-trusted-ca-bundle\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.492467 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.492381    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-console-config\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.492467 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.492421    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-trusted-ca-bundle\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.492698 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.492478    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-service-ca\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.492698 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.492510    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5821f194-fc0a-4e0a-8c6a-82f5090fc635-console-oauth-config\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.492698 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.492627    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4gw2\" (UniqueName: \"kubernetes.io/projected/5821f194-fc0a-4e0a-8c6a-82f5090fc635-kube-api-access-r4gw2\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.492698 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.492674    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-oauth-serving-cert\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.492917 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.492730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5821f194-fc0a-4e0a-8c6a-82f5090fc635-console-serving-cert\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.493296 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.493262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-service-ca\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.493296 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.493270    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-console-config\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.493480 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.493412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-trusted-ca-bundle\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.493480 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.493416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5821f194-fc0a-4e0a-8c6a-82f5090fc635-oauth-serving-cert\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.495066 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.495037    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5821f194-fc0a-4e0a-8c6a-82f5090fc635-console-oauth-config\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.495156 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.495122    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5821f194-fc0a-4e0a-8c6a-82f5090fc635-console-serving-cert\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.500898 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.500879    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4gw2\" (UniqueName: \"kubernetes.io/projected/5821f194-fc0a-4e0a-8c6a-82f5090fc635-kube-api-access-r4gw2\") pod \"console-b9995ff55-2qtqg\" (UID: \"5821f194-fc0a-4e0a-8c6a-82f5090fc635\") " pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.542961 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.542927    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:07.676870 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.676846    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9995ff55-2qtqg"]
Jul 21 20:48:07.678888 ip-10-0-134-121 kubenswrapper[2560]: W0721 20:48:07.678852    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5821f194_fc0a_4e0a_8c6a_82f5090fc635.slice/crio-76e9e1629f6e5c4b98e7a22ec633b1927b4bb1796791d0022da4c29207c78383 WatchSource:0}: Error finding container 76e9e1629f6e5c4b98e7a22ec633b1927b4bb1796791d0022da4c29207c78383: Status 404 returned error can't find the container with id 76e9e1629f6e5c4b98e7a22ec633b1927b4bb1796791d0022da4c29207c78383
Jul 21 20:48:07.926336 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.926296    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9995ff55-2qtqg" event={"ID":"5821f194-fc0a-4e0a-8c6a-82f5090fc635","Type":"ContainerStarted","Data":"fc8dac607e87fb5300369d5ff55e2e46cb23d92725c5e9145cd694fcb40daebe"}
Jul 21 20:48:07.926503 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.926354    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9995ff55-2qtqg" event={"ID":"5821f194-fc0a-4e0a-8c6a-82f5090fc635","Type":"ContainerStarted","Data":"76e9e1629f6e5c4b98e7a22ec633b1927b4bb1796791d0022da4c29207c78383"}
Jul 21 20:48:07.945106 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:07.945055    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b9995ff55-2qtqg" podStartSLOduration=0.945039273 podStartE2EDuration="945.039273ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 20:48:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 20:48:07.943312402 +0000 UTC m=+513.963720866" watchObservedRunningTime="2026-07-21 20:48:07.945039273 +0000 UTC m=+513.965447803"
Jul 21 20:48:17.543079 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:17.543039    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:17.543474 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:17.543104    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:17.547914 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:17.547893    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:17.978740 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:17.978710    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b9995ff55-2qtqg"
Jul 21 20:48:18.025211 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:18.024314    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f767c59c-9rgnf"]
Jul 21 20:48:43.062276 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.062132    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59f767c59c-9rgnf" podUID="f6f2d180-03f2-481d-aeac-49e5979b29a4" containerName="console" containerID="cri-o://a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865" gracePeriod=15
Jul 21 20:48:43.322649 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.322589    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:48:43.420693 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.420658    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-oauth-serving-cert\") pod \"f6f2d180-03f2-481d-aeac-49e5979b29a4\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") "
Jul 21 20:48:43.420693 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.420702    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-oauth-config\") pod \"f6f2d180-03f2-481d-aeac-49e5979b29a4\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") "
Jul 21 20:48:43.420950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.420732    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgszw\" (UniqueName: \"kubernetes.io/projected/f6f2d180-03f2-481d-aeac-49e5979b29a4-kube-api-access-zgszw\") pod \"f6f2d180-03f2-481d-aeac-49e5979b29a4\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") "
Jul 21 20:48:43.420950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.420774    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-service-ca\") pod \"f6f2d180-03f2-481d-aeac-49e5979b29a4\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") "
Jul 21 20:48:43.420950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.420790    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-trusted-ca-bundle\") pod \"f6f2d180-03f2-481d-aeac-49e5979b29a4\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") "
Jul 21 20:48:43.420950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.420809    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-config\") pod \"f6f2d180-03f2-481d-aeac-49e5979b29a4\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") "
Jul 21 20:48:43.420950 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.420865    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-serving-cert\") pod \"f6f2d180-03f2-481d-aeac-49e5979b29a4\" (UID: \"f6f2d180-03f2-481d-aeac-49e5979b29a4\") "
Jul 21 20:48:43.421254 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.421225    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f6f2d180-03f2-481d-aeac-49e5979b29a4" (UID: "f6f2d180-03f2-481d-aeac-49e5979b29a4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:48:43.421422 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.421392    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-service-ca" (OuterVolumeSpecName: "service-ca") pod "f6f2d180-03f2-481d-aeac-49e5979b29a4" (UID: "f6f2d180-03f2-481d-aeac-49e5979b29a4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:48:43.421422 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.421402    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-config" (OuterVolumeSpecName: "console-config") pod "f6f2d180-03f2-481d-aeac-49e5979b29a4" (UID: "f6f2d180-03f2-481d-aeac-49e5979b29a4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:48:43.421529 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.421467    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f6f2d180-03f2-481d-aeac-49e5979b29a4" (UID: "f6f2d180-03f2-481d-aeac-49e5979b29a4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 20:48:43.423042 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.423013    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f6f2d180-03f2-481d-aeac-49e5979b29a4" (UID: "f6f2d180-03f2-481d-aeac-49e5979b29a4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:48:43.423123 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.423075    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f2d180-03f2-481d-aeac-49e5979b29a4-kube-api-access-zgszw" (OuterVolumeSpecName: "kube-api-access-zgszw") pod "f6f2d180-03f2-481d-aeac-49e5979b29a4" (UID: "f6f2d180-03f2-481d-aeac-49e5979b29a4"). InnerVolumeSpecName "kube-api-access-zgszw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 20:48:43.423123 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.423083    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f6f2d180-03f2-481d-aeac-49e5979b29a4" (UID: "f6f2d180-03f2-481d-aeac-49e5979b29a4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 20:48:43.522551 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.522512    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:48:43.522551 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.522543    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-oauth-serving-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:48:43.522551 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.522552    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-oauth-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:48:43.522800 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.522561    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgszw\" (UniqueName: \"kubernetes.io/projected/f6f2d180-03f2-481d-aeac-49e5979b29a4-kube-api-access-zgszw\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:48:43.522800 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.522572    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:48:43.522800 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.522580    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-trusted-ca-bundle\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:48:43.522800 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:43.522588    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f2d180-03f2-481d-aeac-49e5979b29a4-console-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 20:48:44.096285 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:44.096248    2560 generic.go:356] "Generic (PLEG): container finished" podID="f6f2d180-03f2-481d-aeac-49e5979b29a4" containerID="a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865" exitCode=0
Jul 21 20:48:44.096285 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:44.096290    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f767c59c-9rgnf" event={"ID":"f6f2d180-03f2-481d-aeac-49e5979b29a4","Type":"ContainerDied","Data":"a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865"}
Jul 21 20:48:44.096817 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:44.096295    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f767c59c-9rgnf"
Jul 21 20:48:44.096817 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:44.096334    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f767c59c-9rgnf" event={"ID":"f6f2d180-03f2-481d-aeac-49e5979b29a4","Type":"ContainerDied","Data":"f825159516e17b3b7adf5823fa9ade381fdbc7d54397c8c96fb13fd4e8512177"}
Jul 21 20:48:44.096817 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:44.096353    2560 scope.go:117] "RemoveContainer" containerID="a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865"
Jul 21 20:48:44.105377 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:44.105360    2560 scope.go:117] "RemoveContainer" containerID="a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865"
Jul 21 20:48:44.105640 ip-10-0-134-121 kubenswrapper[2560]: E0721 20:48:44.105619    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865\": container with ID starting with a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865 not found: ID does not exist" containerID="a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865"
Jul 21 20:48:44.105689 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:44.105648    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865"} err="failed to get container status \"a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865\": rpc error: code = NotFound desc = could not find container \"a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865\": container with ID starting with a6bbd04c75425f9bc0ea02fbd520d8556021b24a060cc23ecfb093252adb8865 not found: ID does not exist"
Jul 21 20:48:44.118619 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:44.118585    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f767c59c-9rgnf"]
Jul 21 20:48:44.121780 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:44.121758    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59f767c59c-9rgnf"]
Jul 21 20:48:44.498500 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:48:44.498415    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f2d180-03f2-481d-aeac-49e5979b29a4" path="/var/lib/kubelet/pods/f6f2d180-03f2-481d-aeac-49e5979b29a4/volumes"
Jul 21 20:49:06.921619 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:49:06.921582    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:49:25.019396 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:49:25.019356    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:49:34.436053 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:49:34.436016    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 20:49:34.439846 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:49:34.439821    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:49:34.440581 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:49:34.440558    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 20:49:34.444059 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:49:34.444042    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:49:41.096297 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:49:41.096256    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:49:55.905017 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:49:55.904974    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:50:12.205578 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:50:12.205494    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:50:27.493415 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:50:27.493375    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:50:47.409354 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:50:47.409315    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:52:46.402481 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:52:46.402446    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:52:55.804522 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:52:55.804485    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:53:07.298324 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:53:07.298249    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:54:34.472256 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:54:34.467303    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 20:54:34.476620 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:54:34.476600    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 20:54:34.477598 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:54:34.477576    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:54:34.480481 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:54:34.480456    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:54:46.855094 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:54:46.855054    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:54:57.790158 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:54:57.790123    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:55:37.400221 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:55:37.400164    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:55:46.906856 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:55:46.906820    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:55:56.701045 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:55:56.701001    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:56:04.398000 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:56:04.397889    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:56:13.609411 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:56:13.609377    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:56:25.493932 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:56:25.493898    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:56:36.120121 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:56:36.120082    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:56:45.895468 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:56:45.895435    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:57:08.607438 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:57:08.607400    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:57:20.746244 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:57:20.746204    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:57:45.208540 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:57:45.208505    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:57:56.966340 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:57:56.966302    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:58:12.851591 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:58:12.851557    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:58:33.261269 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:58:33.261231    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:58:47.318278 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:58:47.318230    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 20:59:34.506241 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:59:34.506213    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 20:59:34.507558 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:59:34.507536    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 20:59:34.509816 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:59:34.509798    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 20:59:34.518096 ip-10-0-134-121 kubenswrapper[2560]: I0721 20:59:34.518075    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:00:42.320658 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:00:42.320617    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:00:54.603033 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:00:54.602998    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:01:03.322800 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:01:03.322763    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:01:15.213066 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:01:15.213032    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:01:26.911204 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:01:26.911155    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:01:36.315946 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:01:36.315911    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:01:46.120284 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:01:46.120249    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:01:56.698683 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:01:56.698646    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:02:06.898775 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:02:06.898701    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:02:17.500757 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:02:17.500714    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:02:28.598911 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:02:28.598880    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:02:51.601584 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:02:51.601547    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:03:00.883011 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.882968    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"]
Jul 21 21:03:00.883502 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.883331    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f2d180-03f2-481d-aeac-49e5979b29a4" containerName="console"
Jul 21 21:03:00.883502 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.883342    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f2d180-03f2-481d-aeac-49e5979b29a4" containerName="console"
Jul 21 21:03:00.883502 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.883409    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f2d180-03f2-481d-aeac-49e5979b29a4" containerName="console"
Jul 21 21:03:00.886480 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.886457    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:00.889450 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.889427    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-k4xb8\""
Jul 21 21:03:00.889565 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.889433    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 21:03:00.889565 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.889486    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 21:03:00.889565 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.889438    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-f31a6dfd-kserve-self-signed-certs\""
Jul 21 21:03:00.903127 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.903108    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"]
Jul 21 21:03:00.933416 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.933388    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-tmp-dir\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:00.933564 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.933426    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-home\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:00.933564 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.933451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48204079-2a69-456f-81d9-66e4a3a05f2f-tls-certs\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:00.933564 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.933508    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-dshm\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:00.933564 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.933532    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-model-cache\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:00.933700 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:00.933569    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6dck\" (UniqueName: \"kubernetes.io/projected/48204079-2a69-456f-81d9-66e4a3a05f2f-kube-api-access-r6dck\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.034706 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.034659    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-dshm\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.034706 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.034709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-model-cache\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.034898 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.034745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6dck\" (UniqueName: \"kubernetes.io/projected/48204079-2a69-456f-81d9-66e4a3a05f2f-kube-api-access-r6dck\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.034898 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.034795    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-tmp-dir\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.034898 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.034819    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-home\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.034898 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.034844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48204079-2a69-456f-81d9-66e4a3a05f2f-tls-certs\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.035171 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.035152    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-model-cache\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.035260 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.035231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-home\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.035302 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.035271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-tmp-dir\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.036981 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.036961    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-dshm\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.037295 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.037277    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48204079-2a69-456f-81d9-66e4a3a05f2f-tls-certs\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.046216 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.046179    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6dck\" (UniqueName: \"kubernetes.io/projected/48204079-2a69-456f-81d9-66e4a3a05f2f-kube-api-access-r6dck\") pod \"e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") " pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.093154 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.093121    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:03:01.196660 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.196584    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:01.330436 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.330357    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"]
Jul 21 21:03:01.332893 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:03:01.332855    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48204079_2a69_456f_81d9_66e4a3a05f2f.slice/crio-b1a339c2c8be4e2ea3efaa7bfe4aaf44580009d4129be4f736b14ff0e9cd562a WatchSource:0}: Error finding container b1a339c2c8be4e2ea3efaa7bfe4aaf44580009d4129be4f736b14ff0e9cd562a: Status 404 returned error can't find the container with id b1a339c2c8be4e2ea3efaa7bfe4aaf44580009d4129be4f736b14ff0e9cd562a
Jul 21 21:03:01.334851 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:01.334834    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 21:03:02.119811 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:02.119755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q" event={"ID":"48204079-2a69-456f-81d9-66e4a3a05f2f","Type":"ContainerStarted","Data":"b1a339c2c8be4e2ea3efaa7bfe4aaf44580009d4129be4f736b14ff0e9cd562a"}
Jul 21 21:03:03.127090 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:03.127050    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q" event={"ID":"48204079-2a69-456f-81d9-66e4a3a05f2f","Type":"ContainerStarted","Data":"f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb"}
Jul 21 21:03:03.145928 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:03.145886    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q" podStartSLOduration=1.757295088 podStartE2EDuration="3.145870248s" totalImagesPullingTime="1.38857516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:03:03.144360408 +0000 UTC m=+1409.164768871" watchObservedRunningTime="2026-07-21 21:03:03.145870248 +0000 UTC m=+1409.166278711"
Jul 21 21:03:11.197470 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:11.197382    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:11.197470 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:11.197434    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:11.210220 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:11.210171    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:12.190977 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:12.190943    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:03:14.998602 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:14.998565    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:03:29.102870 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.102776    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"]
Jul 21 21:03:29.106812 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.106789    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.109386 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.109361    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-f31a6dfd-kserve-self-signed-certs\""
Jul 21 21:03:29.115897 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.115874    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"]
Jul 21 21:03:29.287309 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.287276    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-model-cache\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.287468 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.287342    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-dshm\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.287468 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.287377    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c4c1e0-0747-46c7-9dc7-0e260a789383-tls-certs\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.287468 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.287402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqlz4\" (UniqueName: \"kubernetes.io/projected/75c4c1e0-0747-46c7-9dc7-0e260a789383-kube-api-access-tqlz4\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.287571 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.287486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-home\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.287571 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.287522    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-tmp-dir\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.388266 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.388149    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-tmp-dir\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.388266 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.388218    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-model-cache\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.388447 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.388303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-dshm\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.388447 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.388349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c4c1e0-0747-46c7-9dc7-0e260a789383-tls-certs\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.388447 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.388378    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqlz4\" (UniqueName: \"kubernetes.io/projected/75c4c1e0-0747-46c7-9dc7-0e260a789383-kube-api-access-tqlz4\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.388447 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.388424    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-home\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.388837 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.388602    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-tmp-dir\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.388837 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.388644    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-model-cache\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.388837 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.388750    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-home\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.390580 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.390551    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-dshm\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.390745 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.390725    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c4c1e0-0747-46c7-9dc7-0e260a789383-tls-certs\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.396891 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.396860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqlz4\" (UniqueName: \"kubernetes.io/projected/75c4c1e0-0747-46c7-9dc7-0e260a789383-kube-api-access-tqlz4\") pod \"e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") " pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.416924 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.416897    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:29.551618 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:29.551595    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"]
Jul 21 21:03:29.553827 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:03:29.553789    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75c4c1e0_0747_46c7_9dc7_0e260a789383.slice/crio-8bdb5953c88907c750bd92a1c4bfd92f5e29d6a2d8ba52908a397615461e7f83 WatchSource:0}: Error finding container 8bdb5953c88907c750bd92a1c4bfd92f5e29d6a2d8ba52908a397615461e7f83: Status 404 returned error can't find the container with id 8bdb5953c88907c750bd92a1c4bfd92f5e29d6a2d8ba52908a397615461e7f83
Jul 21 21:03:30.274641 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:30.274605    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv" event={"ID":"75c4c1e0-0747-46c7-9dc7-0e260a789383","Type":"ContainerStarted","Data":"b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a"}
Jul 21 21:03:30.275010 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:30.274651    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv" event={"ID":"75c4c1e0-0747-46c7-9dc7-0e260a789383","Type":"ContainerStarted","Data":"8bdb5953c88907c750bd92a1c4bfd92f5e29d6a2d8ba52908a397615461e7f83"}
Jul 21 21:03:30.294145 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:30.294096    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv" podStartSLOduration=1.294082017 podStartE2EDuration="1.294082017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:03:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:03:30.291721419 +0000 UTC m=+1436.312129895" watchObservedRunningTime="2026-07-21 21:03:30.294082017 +0000 UTC m=+1436.314490480"
Jul 21 21:03:32.896347 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:32.896305    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:03:39.417786 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:39.417704    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:39.418230 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:39.417812    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:39.430599 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:39.430577    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:40.331429 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:40.331400    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:03:55.429562 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:55.429528    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"]
Jul 21 21:03:56.482246 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:56.482216    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"]
Jul 21 21:03:58.093013 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:03:58.092975    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:04:10.450009 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.449940    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q" podUID="48204079-2a69-456f-81d9-66e4a3a05f2f" containerName="main" containerID="cri-o://f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb" gracePeriod=45
Jul 21 21:04:10.702320 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.702260    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:04:10.852329 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852300    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-model-cache\") pod \"48204079-2a69-456f-81d9-66e4a3a05f2f\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") "
Jul 21 21:04:10.852491 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852341    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-home\") pod \"48204079-2a69-456f-81d9-66e4a3a05f2f\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") "
Jul 21 21:04:10.852491 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852379    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48204079-2a69-456f-81d9-66e4a3a05f2f-tls-certs\") pod \"48204079-2a69-456f-81d9-66e4a3a05f2f\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") "
Jul 21 21:04:10.852491 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852413    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-dshm\") pod \"48204079-2a69-456f-81d9-66e4a3a05f2f\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") "
Jul 21 21:04:10.852491 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852451    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-tmp-dir\") pod \"48204079-2a69-456f-81d9-66e4a3a05f2f\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") "
Jul 21 21:04:10.852697 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852583    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6dck\" (UniqueName: \"kubernetes.io/projected/48204079-2a69-456f-81d9-66e4a3a05f2f-kube-api-access-r6dck\") pod \"48204079-2a69-456f-81d9-66e4a3a05f2f\" (UID: \"48204079-2a69-456f-81d9-66e4a3a05f2f\") "
Jul 21 21:04:10.852697 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852587    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-model-cache" (OuterVolumeSpecName: "model-cache") pod "48204079-2a69-456f-81d9-66e4a3a05f2f" (UID: "48204079-2a69-456f-81d9-66e4a3a05f2f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:04:10.852697 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852638    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-home" (OuterVolumeSpecName: "home") pod "48204079-2a69-456f-81d9-66e4a3a05f2f" (UID: "48204079-2a69-456f-81d9-66e4a3a05f2f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:04:10.852850 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852703    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "48204079-2a69-456f-81d9-66e4a3a05f2f" (UID: "48204079-2a69-456f-81d9-66e4a3a05f2f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:04:10.852894 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852875    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-tmp-dir\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:10.852931 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852904    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-model-cache\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:10.852931 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.852919    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-home\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:10.854654 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.854629    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-dshm" (OuterVolumeSpecName: "dshm") pod "48204079-2a69-456f-81d9-66e4a3a05f2f" (UID: "48204079-2a69-456f-81d9-66e4a3a05f2f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:04:10.854775 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.854687    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48204079-2a69-456f-81d9-66e4a3a05f2f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "48204079-2a69-456f-81d9-66e4a3a05f2f" (UID: "48204079-2a69-456f-81d9-66e4a3a05f2f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 21:04:10.854775 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.854720    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48204079-2a69-456f-81d9-66e4a3a05f2f-kube-api-access-r6dck" (OuterVolumeSpecName: "kube-api-access-r6dck") pod "48204079-2a69-456f-81d9-66e4a3a05f2f" (UID: "48204079-2a69-456f-81d9-66e4a3a05f2f"). InnerVolumeSpecName "kube-api-access-r6dck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:04:10.953999 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.953944    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48204079-2a69-456f-81d9-66e4a3a05f2f-tls-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:10.953999 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.953965    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48204079-2a69-456f-81d9-66e4a3a05f2f-dshm\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:10.953999 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:10.953974    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6dck\" (UniqueName: \"kubernetes.io/projected/48204079-2a69-456f-81d9-66e4a3a05f2f-kube-api-access-r6dck\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:11.470903 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.470868    2560 generic.go:356] "Generic (PLEG): container finished" podID="48204079-2a69-456f-81d9-66e4a3a05f2f" containerID="f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb" exitCode=0
Jul 21 21:04:11.471336 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.470915    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"
Jul 21 21:04:11.471336 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.470943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q" event={"ID":"48204079-2a69-456f-81d9-66e4a3a05f2f","Type":"ContainerDied","Data":"f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb"}
Jul 21 21:04:11.471336 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.470982    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q" event={"ID":"48204079-2a69-456f-81d9-66e4a3a05f2f","Type":"ContainerDied","Data":"b1a339c2c8be4e2ea3efaa7bfe4aaf44580009d4129be4f736b14ff0e9cd562a"}
Jul 21 21:04:11.471336 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.470998    2560 scope.go:117] "RemoveContainer" containerID="f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb"
Jul 21 21:04:11.480128 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.480110    2560 scope.go:117] "RemoveContainer" containerID="f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb"
Jul 21 21:04:11.480440 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:04:11.480416    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb\": container with ID starting with f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb not found: ID does not exist" containerID="f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb"
Jul 21 21:04:11.480538 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.480446    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb"} err="failed to get container status \"f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb\": rpc error: code = NotFound desc = could not find container \"f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb\": container with ID starting with f48348c3f9ef00478b7d8323ac84c2bae9dc332edf6986d81e095dee99ada5eb not found: ID does not exist"
Jul 21 21:04:11.493534 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.493511    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"]
Jul 21 21:04:11.499485 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.499463    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-f31a6dfd-kserve-6878ffdcf-58b8q"]
Jul 21 21:04:11.504430 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.504403    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv" podUID="75c4c1e0-0747-46c7-9dc7-0e260a789383" containerName="main" containerID="cri-o://b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a" gracePeriod=45
Jul 21 21:04:11.699392 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.699356    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:04:11.759091 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.759057    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:04:11.863786 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.863749    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-model-cache\") pod \"75c4c1e0-0747-46c7-9dc7-0e260a789383\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") "
Jul 21 21:04:11.863786 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.863787    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-home\") pod \"75c4c1e0-0747-46c7-9dc7-0e260a789383\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") "
Jul 21 21:04:11.864036 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.863813    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-dshm\") pod \"75c4c1e0-0747-46c7-9dc7-0e260a789383\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") "
Jul 21 21:04:11.864036 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.863832    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c4c1e0-0747-46c7-9dc7-0e260a789383-tls-certs\") pod \"75c4c1e0-0747-46c7-9dc7-0e260a789383\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") "
Jul 21 21:04:11.864036 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.863900    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-tmp-dir\") pod \"75c4c1e0-0747-46c7-9dc7-0e260a789383\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") "
Jul 21 21:04:11.864036 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.863918    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqlz4\" (UniqueName: \"kubernetes.io/projected/75c4c1e0-0747-46c7-9dc7-0e260a789383-kube-api-access-tqlz4\") pod \"75c4c1e0-0747-46c7-9dc7-0e260a789383\" (UID: \"75c4c1e0-0747-46c7-9dc7-0e260a789383\") "
Jul 21 21:04:11.864274 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.864091    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-home" (OuterVolumeSpecName: "home") pod "75c4c1e0-0747-46c7-9dc7-0e260a789383" (UID: "75c4c1e0-0747-46c7-9dc7-0e260a789383"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:04:11.864274 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.864107    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-model-cache" (OuterVolumeSpecName: "model-cache") pod "75c4c1e0-0747-46c7-9dc7-0e260a789383" (UID: "75c4c1e0-0747-46c7-9dc7-0e260a789383"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:04:11.864274 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.864257    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "75c4c1e0-0747-46c7-9dc7-0e260a789383" (UID: "75c4c1e0-0747-46c7-9dc7-0e260a789383"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:04:11.864419 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.864370    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-model-cache\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:11.864419 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.864390    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-home\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:11.864419 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.864404    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-tmp-dir\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:11.866272 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.866234    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75c4c1e0-0747-46c7-9dc7-0e260a789383-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "75c4c1e0-0747-46c7-9dc7-0e260a789383" (UID: "75c4c1e0-0747-46c7-9dc7-0e260a789383"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 21:04:11.866394 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.866282    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75c4c1e0-0747-46c7-9dc7-0e260a789383-kube-api-access-tqlz4" (OuterVolumeSpecName: "kube-api-access-tqlz4") pod "75c4c1e0-0747-46c7-9dc7-0e260a789383" (UID: "75c4c1e0-0747-46c7-9dc7-0e260a789383"). InnerVolumeSpecName "kube-api-access-tqlz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:04:11.866463 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.866434    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-dshm" (OuterVolumeSpecName: "dshm") pod "75c4c1e0-0747-46c7-9dc7-0e260a789383" (UID: "75c4c1e0-0747-46c7-9dc7-0e260a789383"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:04:11.964943 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.964909    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75c4c1e0-0747-46c7-9dc7-0e260a789383-dshm\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:11.965107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.964940    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75c4c1e0-0747-46c7-9dc7-0e260a789383-tls-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:11.965107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:11.964971    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqlz4\" (UniqueName: \"kubernetes.io/projected/75c4c1e0-0747-46c7-9dc7-0e260a789383-kube-api-access-tqlz4\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:04:12.477532 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:12.477497    2560 generic.go:356] "Generic (PLEG): container finished" podID="75c4c1e0-0747-46c7-9dc7-0e260a789383" containerID="b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a" exitCode=0
Jul 21 21:04:12.477967 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:12.477551    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"
Jul 21 21:04:12.477967 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:12.477560    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv" event={"ID":"75c4c1e0-0747-46c7-9dc7-0e260a789383","Type":"ContainerDied","Data":"b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a"}
Jul 21 21:04:12.477967 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:12.477589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv" event={"ID":"75c4c1e0-0747-46c7-9dc7-0e260a789383","Type":"ContainerDied","Data":"8bdb5953c88907c750bd92a1c4bfd92f5e29d6a2d8ba52908a397615461e7f83"}
Jul 21 21:04:12.477967 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:12.477605    2560 scope.go:117] "RemoveContainer" containerID="b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a"
Jul 21 21:04:12.486736 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:12.486720    2560 scope.go:117] "RemoveContainer" containerID="b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a"
Jul 21 21:04:12.487025 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:04:12.487003    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a\": container with ID starting with b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a not found: ID does not exist" containerID="b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a"
Jul 21 21:04:12.487069 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:12.487033    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a"} err="failed to get container status \"b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a\": rpc error: code = NotFound desc = could not find container \"b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a\": container with ID starting with b9e80179514bd9d2eb231f7429bdd488d56b1f04ccbfbfd38d7c781272a9f49a not found: ID does not exist"
Jul 21 21:04:12.498434 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:12.498411    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48204079-2a69-456f-81d9-66e4a3a05f2f" path="/var/lib/kubelet/pods/48204079-2a69-456f-81d9-66e4a3a05f2f/volumes"
Jul 21 21:04:12.498666 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:12.498654    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"]
Jul 21 21:04:12.504153 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:12.504130    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-f31a6dfd-kserve-6bc4944d5f-9vnjv"]
Jul 21 21:04:14.497737 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:14.497699    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75c4c1e0-0747-46c7-9dc7-0e260a789383" path="/var/lib/kubelet/pods/75c4c1e0-0747-46c7-9dc7-0e260a789383/volumes"
Jul 21 21:04:18.420360 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:18.420318    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:04:34.354844 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:34.354808    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:04:34.542679 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:34.542651    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 21:04:34.543909 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:34.543881    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 21:04:34.546528 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:34.546504    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:04:34.547686 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:34.547668    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:04:43.903598 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:43.903565    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:04:52.927809 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:04:52.927765    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:05:03.226418 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:05:03.226344    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:05:12.513179 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:05:12.513148    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:05:22.514394 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:05:22.514358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:05:35.602046 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:05:35.602006    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:05:45.307925 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:05:45.307888    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:05:55.160531 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:05:55.160489    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:06:11.292667 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:06:11.292629    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:06:23.303356 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:06:23.303319    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:06:31.806410 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:06:31.806329    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:06:43.897700 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:06:43.897669    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:06:56.100510 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:06:56.100480    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:07:07.594367 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:07.594328    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:07:18.799394 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:18.799358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:07:33.404773 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:33.404736    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:07:40.046024 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.045987    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"]
Jul 21 21:07:40.046527 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.046372    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75c4c1e0-0747-46c7-9dc7-0e260a789383" containerName="main"
Jul 21 21:07:40.046527 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.046384    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="75c4c1e0-0747-46c7-9dc7-0e260a789383" containerName="main"
Jul 21 21:07:40.046527 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.046394    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48204079-2a69-456f-81d9-66e4a3a05f2f" containerName="main"
Jul 21 21:07:40.046527 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.046400    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="48204079-2a69-456f-81d9-66e4a3a05f2f" containerName="main"
Jul 21 21:07:40.046527 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.046467    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="48204079-2a69-456f-81d9-66e4a3a05f2f" containerName="main"
Jul 21 21:07:40.046527 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.046475    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="75c4c1e0-0747-46c7-9dc7-0e260a789383" containerName="main"
Jul 21 21:07:40.049416 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.049397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.052321 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.052299    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-82e9b33b-openshift-default-dockercfg-7jtnb\""
Jul 21 21:07:40.075944 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.075914    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"]
Jul 21 21:07:40.161993 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.161959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-credential-socket\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.162293 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.161999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnh4k\" (UniqueName: \"kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-kube-api-access-wnh4k\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.162293 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.162021    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-token\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.162293 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.162122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-data\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.162293 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.162169    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-certs\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.162293 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.162243    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-podinfo\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.162293 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.162291    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-socket\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.162528 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.162315    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ac8a926-0d1c-40e5-b27f-2443730ff354-istiod-ca-cert\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.162528 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.162339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-envoy\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263033 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263002    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-token\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263178 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-data\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263178 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263100    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-certs\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263178 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263142    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-podinfo\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263178 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-socket\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263494 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ac8a926-0d1c-40e5-b27f-2443730ff354-istiod-ca-cert\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263494 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-envoy\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263494 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263349    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-credential-socket\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263494 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263386    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnh4k\" (UniqueName: \"kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-kube-api-access-wnh4k\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263704 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263560    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-data\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263704 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-socket\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263772 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263751    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-credential-socket\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.263992 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263974    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-certs\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.264035 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.263982    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ac8a926-0d1c-40e5-b27f-2443730ff354-istiod-ca-cert\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.265658 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.265631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-envoy\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.265872 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.265852    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-podinfo\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.270783 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.270758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-token\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.270997 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.270980    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnh4k\" (UniqueName: \"kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-kube-api-access-wnh4k\") pod \"e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") " pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.360362 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.360332    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:40.498395 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.498349    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"]
Jul 21 21:07:40.500639 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:07:40.500609    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac8a926_0d1c_40e5_b27f_2443730ff354.slice/crio-f56b01f35ed91d16c50b886350c2c639912552419f037230fd6a0ab4e2cd1f2b WatchSource:0}: Error finding container f56b01f35ed91d16c50b886350c2c639912552419f037230fd6a0ab4e2cd1f2b: Status 404 returned error can't find the container with id f56b01f35ed91d16c50b886350c2c639912552419f037230fd6a0ab4e2cd1f2b
Jul 21 21:07:40.502669 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.502639    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:07:40.502736 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.502718    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:07:40.502773 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:40.502745    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:07:41.448106 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:41.448069    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" event={"ID":"7ac8a926-0d1c-40e5-b27f-2443730ff354","Type":"ContainerStarted","Data":"2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f"}
Jul 21 21:07:41.448542 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:41.448164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" event={"ID":"7ac8a926-0d1c-40e5-b27f-2443730ff354","Type":"ContainerStarted","Data":"f56b01f35ed91d16c50b886350c2c639912552419f037230fd6a0ab4e2cd1f2b"}
Jul 21 21:07:41.470384 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:41.470335    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" podStartSLOduration=1.470318948 podStartE2EDuration="1.470318948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:07:41.469280459 +0000 UTC m=+1687.489688925" watchObservedRunningTime="2026-07-21 21:07:41.470318948 +0000 UTC m=+1687.490727412"
Jul 21 21:07:42.360843 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:42.360806    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:42.365318 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:42.365291    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:42.453472 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:42.453437    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:42.454300 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:42.454278    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:07:50.094263 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:50.094223    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:07:57.633987 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:57.633376    2560 patch_prober.go:28] interesting pod/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:46276->10.133.0.41:15021: read: connection reset by peer" start-of-body=
Jul 21 21:07:57.633987 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:57.633441    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:46276->10.133.0.41:15021: read: connection reset by peer"
Jul 21 21:07:58.530304 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:58.530267    2560 generic.go:356] "Generic (PLEG): container finished" podID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerID="2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f" exitCode=0
Jul 21 21:07:58.530481 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:58.530325    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" event={"ID":"7ac8a926-0d1c-40e5-b27f-2443730ff354","Type":"ContainerDied","Data":"2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f"}
Jul 21 21:07:58.530650 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:58.530635    2560 scope.go:117] "RemoveContainer" containerID="2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f"
Jul 21 21:07:58.531592 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:58.531563    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:07:58.531660 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:58.531628    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:07:58.531710 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:58.531658    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:07:59.541267 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:07:59.540368    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" event={"ID":"7ac8a926-0d1c-40e5-b27f-2443730ff354","Type":"ContainerStarted","Data":"e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c"}
Jul 21 21:08:00.361089 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:00.361044    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:08:00.361343 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:00.361316    2560 patch_prober.go:28] interesting pod/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 21 21:08:00.361437 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:00.361411    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 21 21:08:01.361003 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:01.360966    2560 patch_prober.go:28] interesting pod/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 21 21:08:01.361420 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:01.361023    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 21 21:08:02.361735 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:02.361691    2560 patch_prober.go:28] interesting pod/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 21 21:08:02.362234 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:02.361756    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 21 21:08:03.361584 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:03.361541    2560 patch_prober.go:28] interesting pod/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 21 21:08:03.361775 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:03.361611    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 21 21:08:04.364336 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:04.364307    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:08:04.364698 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:04.364597    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:08:04.365331 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:04.365311    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:08:08.529332 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:08.529303    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"]
Jul 21 21:08:08.532612 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:08.532597    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"
Jul 21 21:08:08.535438 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:08.535413    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 21:08:08.535560 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:08.535499    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmths\""
Jul 21 21:08:08.543997 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:08.543968    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"]
Jul 21 21:08:08.619060 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:08.619027    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5b3a8ec-9f21-4213-ac6d-61171dd01146-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m\" (UID: \"b5b3a8ec-9f21-4213-ac6d-61171dd01146\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"
Jul 21 21:08:08.719716 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:08.719679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5b3a8ec-9f21-4213-ac6d-61171dd01146-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m\" (UID: \"b5b3a8ec-9f21-4213-ac6d-61171dd01146\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"
Jul 21 21:08:08.720330 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:08.720310    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5b3a8ec-9f21-4213-ac6d-61171dd01146-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m\" (UID: \"b5b3a8ec-9f21-4213-ac6d-61171dd01146\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"
Jul 21 21:08:08.844411 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:08.844376    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"
Jul 21 21:08:09.184316 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:09.184291    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"]
Jul 21 21:08:09.186779 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:08:09.186748    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b3a8ec_9f21_4213_ac6d_61171dd01146.slice/crio-51f336df40d387dfc269e29fd5692b2a717d27fb827ec9bb445c145faa87fb25 WatchSource:0}: Error finding container 51f336df40d387dfc269e29fd5692b2a717d27fb827ec9bb445c145faa87fb25: Status 404 returned error can't find the container with id 51f336df40d387dfc269e29fd5692b2a717d27fb827ec9bb445c145faa87fb25
Jul 21 21:08:09.188632 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:09.188616    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 21:08:09.603030 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:09.602997    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m" event={"ID":"b5b3a8ec-9f21-4213-ac6d-61171dd01146","Type":"ContainerStarted","Data":"51f336df40d387dfc269e29fd5692b2a717d27fb827ec9bb445c145faa87fb25"}
Jul 21 21:08:12.619086 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:12.618998    2560 generic.go:356] "Generic (PLEG): container finished" podID="b5b3a8ec-9f21-4213-ac6d-61171dd01146" containerID="5dce55ebf6202260bc285ad9619cd1740a7f4b74f6c9232aebd3e7457e2f40b6" exitCode=0
Jul 21 21:08:12.619477 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:12.619090    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m" event={"ID":"b5b3a8ec-9f21-4213-ac6d-61171dd01146","Type":"ContainerDied","Data":"5dce55ebf6202260bc285ad9619cd1740a7f4b74f6c9232aebd3e7457e2f40b6"}
Jul 21 21:08:13.757844 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:13.757821    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"
Jul 21 21:08:13.864407 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:13.864369    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5b3a8ec-9f21-4213-ac6d-61171dd01146-maas-api-service-ca\") pod \"b5b3a8ec-9f21-4213-ac6d-61171dd01146\" (UID: \"b5b3a8ec-9f21-4213-ac6d-61171dd01146\") "
Jul 21 21:08:13.864742 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:13.864714    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5b3a8ec-9f21-4213-ac6d-61171dd01146-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b5b3a8ec-9f21-4213-ac6d-61171dd01146" (UID: "b5b3a8ec-9f21-4213-ac6d-61171dd01146"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:08:13.965597 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:13.965525    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5b3a8ec-9f21-4213-ac6d-61171dd01146-maas-api-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:08:14.629604 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:14.629565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m" event={"ID":"b5b3a8ec-9f21-4213-ac6d-61171dd01146","Type":"ContainerDied","Data":"51f336df40d387dfc269e29fd5692b2a717d27fb827ec9bb445c145faa87fb25"}
Jul 21 21:08:14.629604 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:14.629600    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"
Jul 21 21:08:14.629833 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:14.629614    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51f336df40d387dfc269e29fd5692b2a717d27fb827ec9bb445c145faa87fb25"
Jul 21 21:08:22.392666 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:22.392615    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:08:23.612441 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:23.612402    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"]
Jul 21 21:08:23.615336 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:23.615313    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-82e9b33b-ntn4m"]
Jul 21 21:08:23.762803 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:23.762766    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"]
Jul 21 21:08:23.763047 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:23.763017    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy" containerID="cri-o://e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c" gracePeriod=30
Jul 21 21:08:24.499219 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.499155    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5b3a8ec-9f21-4213-ac6d-61171dd01146" path="/var/lib/kubelet/pods/b5b3a8ec-9f21-4213-ac6d-61171dd01146/volumes"
Jul 21 21:08:24.858073 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.858041    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"]
Jul 21 21:08:24.858464 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.858430    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5b3a8ec-9f21-4213-ac6d-61171dd01146" containerName="revoke-keys"
Jul 21 21:08:24.858464 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.858441    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5b3a8ec-9f21-4213-ac6d-61171dd01146" containerName="revoke-keys"
Jul 21 21:08:24.858544 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.858507    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5b3a8ec-9f21-4213-ac6d-61171dd01146" containerName="revoke-keys"
Jul 21 21:08:24.861746 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.861726    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:24.864461 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.864443    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-0f699c57-gw-openshift-default-dockercfg-gj6mh\""
Jul 21 21:08:24.883285 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.883253    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"]
Jul 21 21:08:24.968066 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.968036    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-istio-token\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:24.968228 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.968076    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/199793d8-29d3-4854-86a5-c84c03732949-istiod-ca-cert\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:24.968228 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.968108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-socket\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:24.968228 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.968151    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-envoy\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:24.968228 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.968172    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-data\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:24.968384 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.968237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-credential-socket\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:24.968384 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.968258    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncphl\" (UniqueName: \"kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-kube-api-access-ncphl\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:24.968384 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.968325    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/199793d8-29d3-4854-86a5-c84c03732949-istio-podinfo\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:24.968384 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:24.968371    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-certs\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.069662 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.069625    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncphl\" (UniqueName: \"kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-kube-api-access-ncphl\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.069882 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.069701    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/199793d8-29d3-4854-86a5-c84c03732949-istio-podinfo\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.069882 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.069754    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-certs\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.069882 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.069781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-istio-token\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.069882 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.069824    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/199793d8-29d3-4854-86a5-c84c03732949-istiod-ca-cert\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.070120 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.069978    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-socket\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.070120 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.070020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-envoy\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.070120 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.070043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-data\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.070120 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.070115    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-credential-socket\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.070542 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.070515    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-socket\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.070674 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.070522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-credential-socket\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.070674 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.070573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-certs\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.070674 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.070615    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/199793d8-29d3-4854-86a5-c84c03732949-istiod-ca-cert\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.070674 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.070672    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-data\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.072329 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.072309    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-envoy\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.072423 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.072362    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/199793d8-29d3-4854-86a5-c84c03732949-istio-podinfo\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.082687 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.082665    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncphl\" (UniqueName: \"kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-kube-api-access-ncphl\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.083012 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.082994    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-istio-token\") pod \"e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") " pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.171484 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.171421    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:25.310315 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.310249    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"]
Jul 21 21:08:25.312583 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:08:25.312554    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199793d8_29d3_4854_86a5_c84c03732949.slice/crio-886c2e730c2d0b6f1285a9fb8d17492b7786db3ac864a6daae0cf54677589fd9 WatchSource:0}: Error finding container 886c2e730c2d0b6f1285a9fb8d17492b7786db3ac864a6daae0cf54677589fd9: Status 404 returned error can't find the container with id 886c2e730c2d0b6f1285a9fb8d17492b7786db3ac864a6daae0cf54677589fd9
Jul 21 21:08:25.320901 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.320856    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:08:25.320978 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.320931    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:08:25.320978 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.320964    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:08:25.684018 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.683981    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" event={"ID":"199793d8-29d3-4854-86a5-c84c03732949","Type":"ContainerStarted","Data":"979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087"}
Jul 21 21:08:25.684203 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.684065    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" event={"ID":"199793d8-29d3-4854-86a5-c84c03732949","Type":"ContainerStarted","Data":"886c2e730c2d0b6f1285a9fb8d17492b7786db3ac864a6daae0cf54677589fd9"}
Jul 21 21:08:25.705327 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:25.705280    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" podStartSLOduration=1.705267615 podStartE2EDuration="1.705267615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:08:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:08:25.703537278 +0000 UTC m=+1731.723945755" watchObservedRunningTime="2026-07-21 21:08:25.705267615 +0000 UTC m=+1731.725676078"
Jul 21 21:08:26.172589 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:26.172554    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:26.177758 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:26.177729    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:26.689223 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:26.689171    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:26.690250 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:26.690229    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:29.020462 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.020440    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:08:29.106866 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.106843    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-envoy\") pod \"7ac8a926-0d1c-40e5-b27f-2443730ff354\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") "
Jul 21 21:08:29.107013 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.106872    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-data\") pod \"7ac8a926-0d1c-40e5-b27f-2443730ff354\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") "
Jul 21 21:08:29.107013 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.106892    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-certs\") pod \"7ac8a926-0d1c-40e5-b27f-2443730ff354\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") "
Jul 21 21:08:29.107013 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.106911    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-credential-socket\") pod \"7ac8a926-0d1c-40e5-b27f-2443730ff354\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") "
Jul 21 21:08:29.107013 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.106933    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-podinfo\") pod \"7ac8a926-0d1c-40e5-b27f-2443730ff354\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") "
Jul 21 21:08:29.107013 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.106980    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-token\") pod \"7ac8a926-0d1c-40e5-b27f-2443730ff354\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") "
Jul 21 21:08:29.107013 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.106996    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ac8a926-0d1c-40e5-b27f-2443730ff354-istiod-ca-cert\") pod \"7ac8a926-0d1c-40e5-b27f-2443730ff354\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") "
Jul 21 21:08:29.107351 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.107030    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnh4k\" (UniqueName: \"kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-kube-api-access-wnh4k\") pod \"7ac8a926-0d1c-40e5-b27f-2443730ff354\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") "
Jul 21 21:08:29.107351 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.107096    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-socket\") pod \"7ac8a926-0d1c-40e5-b27f-2443730ff354\" (UID: \"7ac8a926-0d1c-40e5-b27f-2443730ff354\") "
Jul 21 21:08:29.107351 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.107208    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ac8a926-0d1c-40e5-b27f-2443730ff354" (UID: "7ac8a926-0d1c-40e5-b27f-2443730ff354"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:29.107351 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.107240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ac8a926-0d1c-40e5-b27f-2443730ff354" (UID: "7ac8a926-0d1c-40e5-b27f-2443730ff354"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:29.107558 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.107480    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ac8a926-0d1c-40e5-b27f-2443730ff354" (UID: "7ac8a926-0d1c-40e5-b27f-2443730ff354"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:29.107558 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.107497    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ac8a926-0d1c-40e5-b27f-2443730ff354-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ac8a926-0d1c-40e5-b27f-2443730ff354" (UID: "7ac8a926-0d1c-40e5-b27f-2443730ff354"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:08:29.107558 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.107491    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:08:29.107558 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.107545    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:08:29.107925 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.107904    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ac8a926-0d1c-40e5-b27f-2443730ff354" (UID: "7ac8a926-0d1c-40e5-b27f-2443730ff354"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:29.109177 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.109157    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ac8a926-0d1c-40e5-b27f-2443730ff354" (UID: "7ac8a926-0d1c-40e5-b27f-2443730ff354"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:08:29.109413 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.109396    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-kube-api-access-wnh4k" (OuterVolumeSpecName: "kube-api-access-wnh4k") pod "7ac8a926-0d1c-40e5-b27f-2443730ff354" (UID: "7ac8a926-0d1c-40e5-b27f-2443730ff354"). InnerVolumeSpecName "kube-api-access-wnh4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:08:29.109631 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.109607    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ac8a926-0d1c-40e5-b27f-2443730ff354" (UID: "7ac8a926-0d1c-40e5-b27f-2443730ff354"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:08:29.109685 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.109628    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ac8a926-0d1c-40e5-b27f-2443730ff354" (UID: "7ac8a926-0d1c-40e5-b27f-2443730ff354"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:08:29.208932 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.208904    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:08:29.208932 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.208928    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:08:29.208932 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.208938    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:08:29.209148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.208947    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:08:29.209148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.208956    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ac8a926-0d1c-40e5-b27f-2443730ff354-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:08:29.209148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.208965    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnh4k\" (UniqueName: \"kubernetes.io/projected/7ac8a926-0d1c-40e5-b27f-2443730ff354-kube-api-access-wnh4k\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:08:29.209148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.208974    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ac8a926-0d1c-40e5-b27f-2443730ff354-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:08:29.704345 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.704181    2560 generic.go:356] "Generic (PLEG): container finished" podID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerID="e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c" exitCode=0
Jul 21 21:08:29.704345 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.704257    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"
Jul 21 21:08:29.704345 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.704277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" event={"ID":"7ac8a926-0d1c-40e5-b27f-2443730ff354","Type":"ContainerDied","Data":"e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c"}
Jul 21 21:08:29.704345 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.704331    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs" event={"ID":"7ac8a926-0d1c-40e5-b27f-2443730ff354","Type":"ContainerDied","Data":"f56b01f35ed91d16c50b886350c2c639912552419f037230fd6a0ab4e2cd1f2b"}
Jul 21 21:08:29.704345 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.704353    2560 scope.go:117] "RemoveContainer" containerID="e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c"
Jul 21 21:08:29.714272 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.714255    2560 scope.go:117] "RemoveContainer" containerID="2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f"
Jul 21 21:08:29.722045 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.722029    2560 scope.go:117] "RemoveContainer" containerID="e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c"
Jul 21 21:08:29.722295 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:08:29.722274    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c\": container with ID starting with e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c not found: ID does not exist" containerID="e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c"
Jul 21 21:08:29.722359 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.722303    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c"} err="failed to get container status \"e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c\": rpc error: code = NotFound desc = could not find container \"e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c\": container with ID starting with e3b56b3c9f212e07f55c404af424a52182abba644aa42059bc0ae100de8f900c not found: ID does not exist"
Jul 21 21:08:29.722359 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.722319    2560 scope.go:117] "RemoveContainer" containerID="2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f"
Jul 21 21:08:29.722566 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:08:29.722551    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f\": container with ID starting with 2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f not found: ID does not exist" containerID="2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f"
Jul 21 21:08:29.722612 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.722569    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f"} err="failed to get container status \"2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f\": rpc error: code = NotFound desc = could not find container \"2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f\": container with ID starting with 2950a502ec9617ac21a41701741e41b54f01e43239ab08417009ccf2e6863d1f not found: ID does not exist"
Jul 21 21:08:29.728048 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.728026    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"]
Jul 21 21:08:29.732300 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:29.732282    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-82e9b33b-openshift-default-998bcff47-hsmhs"]
Jul 21 21:08:30.503502 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:30.498963    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" path="/var/lib/kubelet/pods/7ac8a926-0d1c-40e5-b27f-2443730ff354/volumes"
Jul 21 21:08:33.692276 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:33.692237    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:08:41.690649 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:41.690611    2560 patch_prober.go:28] interesting pod/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 21 21:08:41.691072 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:41.690669    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 21 21:08:41.774953 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:41.774917    2560 generic.go:356] "Generic (PLEG): container finished" podID="199793d8-29d3-4854-86a5-c84c03732949" containerID="979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087" exitCode=0
Jul 21 21:08:41.775115 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:41.774991    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" event={"ID":"199793d8-29d3-4854-86a5-c84c03732949","Type":"ContainerDied","Data":"979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087"}
Jul 21 21:08:41.775425 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:41.775411    2560 scope.go:117] "RemoveContainer" containerID="979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087"
Jul 21 21:08:41.776421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:41.776393    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:08:41.776501 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:41.776461    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:08:41.776544 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:41.776505    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:08:42.781258 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:42.781223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" event={"ID":"199793d8-29d3-4854-86a5-c84c03732949","Type":"ContainerStarted","Data":"eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161"}
Jul 21 21:08:43.172651 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:43.172605    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:43.172888 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:43.172852    2560 patch_prober.go:28] interesting pod/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 21 21:08:43.172947 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:43.172928    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 21 21:08:44.172638 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:44.172606    2560 patch_prober.go:28] interesting pod/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 21 21:08:44.173012 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:44.172667    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 21 21:08:45.172451 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:45.172411    2560 patch_prober.go:28] interesting pod/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 21 21:08:45.172632 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:45.172467    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 21 21:08:46.172397 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:46.172358    2560 patch_prober.go:28] interesting pod/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 21 21:08:46.172792 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:46.172415    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 21 21:08:47.175780 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:47.175746    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:47.176218 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:47.176179    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:47.176950 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:47.176928    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:08:52.228681 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.228639    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"]
Jul 21 21:08:52.229225 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.229202    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy"
Jul 21 21:08:52.229315 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.229229    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy"
Jul 21 21:08:52.229371 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.229363    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy"
Jul 21 21:08:52.229422 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.229378    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy"
Jul 21 21:08:52.234779 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.234755    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"
Jul 21 21:08:52.237553 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.237525    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 21:08:52.237680 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.237618    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmths\""
Jul 21 21:08:52.238612 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.238586    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"]
Jul 21 21:08:52.327165 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.327132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/446e488a-0547-49f8-9140-84e0074aed6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj\" (UID: \"446e488a-0547-49f8-9140-84e0074aed6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"
Jul 21 21:08:52.428058 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.428020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/446e488a-0547-49f8-9140-84e0074aed6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj\" (UID: \"446e488a-0547-49f8-9140-84e0074aed6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"
Jul 21 21:08:52.428650 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.428628    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/446e488a-0547-49f8-9140-84e0074aed6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj\" (UID: \"446e488a-0547-49f8-9140-84e0074aed6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"
Jul 21 21:08:52.548048 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.547969    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"
Jul 21 21:08:52.679250 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.679225    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"]
Jul 21 21:08:52.681672 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:08:52.681642    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446e488a_0547_49f8_9140_84e0074aed6d.slice/crio-b15901369de15b561109d9a8877424a4e618e1e0ec92c4c031710bc05ea3d122 WatchSource:0}: Error finding container b15901369de15b561109d9a8877424a4e618e1e0ec92c4c031710bc05ea3d122: Status 404 returned error can't find the container with id b15901369de15b561109d9a8877424a4e618e1e0ec92c4c031710bc05ea3d122
Jul 21 21:08:52.828581 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:52.828547    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj" event={"ID":"446e488a-0547-49f8-9140-84e0074aed6d","Type":"ContainerStarted","Data":"b15901369de15b561109d9a8877424a4e618e1e0ec92c4c031710bc05ea3d122"}
Jul 21 21:08:53.841075 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:53.841037    2560 generic.go:356] "Generic (PLEG): container finished" podID="446e488a-0547-49f8-9140-84e0074aed6d" containerID="17a0419ed2960e438a39d239a49582d67b0c9707f5255da8ced40f8dbc194766" exitCode=0
Jul 21 21:08:53.841479 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:53.841247    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj" event={"ID":"446e488a-0547-49f8-9140-84e0074aed6d","Type":"ContainerDied","Data":"17a0419ed2960e438a39d239a49582d67b0c9707f5255da8ced40f8dbc194766"}
Jul 21 21:08:54.983582 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:54.983558    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"
Jul 21 21:08:55.052602 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:55.052568    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/446e488a-0547-49f8-9140-84e0074aed6d-maas-api-service-ca\") pod \"446e488a-0547-49f8-9140-84e0074aed6d\" (UID: \"446e488a-0547-49f8-9140-84e0074aed6d\") "
Jul 21 21:08:55.052915 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:55.052891    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/446e488a-0547-49f8-9140-84e0074aed6d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "446e488a-0547-49f8-9140-84e0074aed6d" (UID: "446e488a-0547-49f8-9140-84e0074aed6d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:08:55.153426 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:55.153361    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/446e488a-0547-49f8-9140-84e0074aed6d-maas-api-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:08:55.851436 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:55.851407    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"
Jul 21 21:08:55.851599 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:55.851455    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj" event={"ID":"446e488a-0547-49f8-9140-84e0074aed6d","Type":"ContainerDied","Data":"b15901369de15b561109d9a8877424a4e618e1e0ec92c4c031710bc05ea3d122"}
Jul 21 21:08:55.851599 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:08:55.851502    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b15901369de15b561109d9a8877424a4e618e1e0ec92c4c031710bc05ea3d122"
Jul 21 21:09:06.007304 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:06.007266    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:09:07.314418 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:07.314383    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"]
Jul 21 21:09:07.319302 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:07.319280    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0f699c57-psxsj"]
Jul 21 21:09:07.459894 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:07.459854    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"]
Jul 21 21:09:07.460128 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:07.460103    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy" containerID="cri-o://eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161" gracePeriod=30
Jul 21 21:09:08.497463 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:08.497428    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="446e488a-0547-49f8-9140-84e0074aed6d" path="/var/lib/kubelet/pods/446e488a-0547-49f8-9140-84e0074aed6d/volumes"
Jul 21 21:09:12.714048 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.714016    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:09:12.810810 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.810786    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncphl\" (UniqueName: \"kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-kube-api-access-ncphl\") pod \"199793d8-29d3-4854-86a5-c84c03732949\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") "
Jul 21 21:09:12.810965 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.810834    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-credential-socket\") pod \"199793d8-29d3-4854-86a5-c84c03732949\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") "
Jul 21 21:09:12.810965 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.810859    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-socket\") pod \"199793d8-29d3-4854-86a5-c84c03732949\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") "
Jul 21 21:09:12.810965 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.810882    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-data\") pod \"199793d8-29d3-4854-86a5-c84c03732949\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") "
Jul 21 21:09:12.810965 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.810905    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-istio-token\") pod \"199793d8-29d3-4854-86a5-c84c03732949\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") "
Jul 21 21:09:12.810965 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.810924    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/199793d8-29d3-4854-86a5-c84c03732949-istiod-ca-cert\") pod \"199793d8-29d3-4854-86a5-c84c03732949\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") "
Jul 21 21:09:12.810965 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.810945    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/199793d8-29d3-4854-86a5-c84c03732949-istio-podinfo\") pod \"199793d8-29d3-4854-86a5-c84c03732949\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") "
Jul 21 21:09:12.811294 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.810998    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-envoy\") pod \"199793d8-29d3-4854-86a5-c84c03732949\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") "
Jul 21 21:09:12.811294 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.811028    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-certs\") pod \"199793d8-29d3-4854-86a5-c84c03732949\" (UID: \"199793d8-29d3-4854-86a5-c84c03732949\") "
Jul 21 21:09:12.811294 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.811086    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "199793d8-29d3-4854-86a5-c84c03732949" (UID: "199793d8-29d3-4854-86a5-c84c03732949"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:09:12.811461 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.811289    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "199793d8-29d3-4854-86a5-c84c03732949" (UID: "199793d8-29d3-4854-86a5-c84c03732949"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:09:12.811461 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.811366    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:09:12.811461 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.811383    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:09:12.811615 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.811469    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "199793d8-29d3-4854-86a5-c84c03732949" (UID: "199793d8-29d3-4854-86a5-c84c03732949"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:09:12.811717 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.811680    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/199793d8-29d3-4854-86a5-c84c03732949-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "199793d8-29d3-4854-86a5-c84c03732949" (UID: "199793d8-29d3-4854-86a5-c84c03732949"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:09:12.812407 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.812379    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-data" (OuterVolumeSpecName: "istio-data") pod "199793d8-29d3-4854-86a5-c84c03732949" (UID: "199793d8-29d3-4854-86a5-c84c03732949"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:09:12.813182 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.813147    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-istio-token" (OuterVolumeSpecName: "istio-token") pod "199793d8-29d3-4854-86a5-c84c03732949" (UID: "199793d8-29d3-4854-86a5-c84c03732949"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:09:12.813288 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.813240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/199793d8-29d3-4854-86a5-c84c03732949-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "199793d8-29d3-4854-86a5-c84c03732949" (UID: "199793d8-29d3-4854-86a5-c84c03732949"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:09:12.813497 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.813470    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "199793d8-29d3-4854-86a5-c84c03732949" (UID: "199793d8-29d3-4854-86a5-c84c03732949"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:09:12.813497 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.813481    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-kube-api-access-ncphl" (OuterVolumeSpecName: "kube-api-access-ncphl") pod "199793d8-29d3-4854-86a5-c84c03732949" (UID: "199793d8-29d3-4854-86a5-c84c03732949"). InnerVolumeSpecName "kube-api-access-ncphl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:09:12.912049 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.912025    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:09:12.912049 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.912048    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:09:12.912214 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.912056    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/199793d8-29d3-4854-86a5-c84c03732949-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:09:12.912214 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.912066    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/199793d8-29d3-4854-86a5-c84c03732949-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:09:12.912214 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.912073    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:09:12.912214 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.912081    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/199793d8-29d3-4854-86a5-c84c03732949-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:09:12.912214 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.912091    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncphl\" (UniqueName: \"kubernetes.io/projected/199793d8-29d3-4854-86a5-c84c03732949-kube-api-access-ncphl\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:09:12.935566 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.935535    2560 generic.go:356] "Generic (PLEG): container finished" podID="199793d8-29d3-4854-86a5-c84c03732949" containerID="eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161" exitCode=0
Jul 21 21:09:12.935680 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.935590    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"
Jul 21 21:09:12.935680 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.935592    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" event={"ID":"199793d8-29d3-4854-86a5-c84c03732949","Type":"ContainerDied","Data":"eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161"}
Jul 21 21:09:12.935782 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.935726    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w" event={"ID":"199793d8-29d3-4854-86a5-c84c03732949","Type":"ContainerDied","Data":"886c2e730c2d0b6f1285a9fb8d17492b7786db3ac864a6daae0cf54677589fd9"}
Jul 21 21:09:12.935782 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.935756    2560 scope.go:117] "RemoveContainer" containerID="eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161"
Jul 21 21:09:12.945082 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.945065    2560 scope.go:117] "RemoveContainer" containerID="979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087"
Jul 21 21:09:12.953085 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.953060    2560 scope.go:117] "RemoveContainer" containerID="eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161"
Jul 21 21:09:12.953420 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:09:12.953399    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161\": container with ID starting with eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161 not found: ID does not exist" containerID="eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161"
Jul 21 21:09:12.953487 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.953427    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161"} err="failed to get container status \"eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161\": rpc error: code = NotFound desc = could not find container \"eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161\": container with ID starting with eea8f3c705687cbfbee0b120aab56a1db484dd70943df3ecf662b16b737ff161 not found: ID does not exist"
Jul 21 21:09:12.953487 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.953442    2560 scope.go:117] "RemoveContainer" containerID="979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087"
Jul 21 21:09:12.953666 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:09:12.953650    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087\": container with ID starting with 979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087 not found: ID does not exist" containerID="979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087"
Jul 21 21:09:12.953705 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.953670    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087"} err="failed to get container status \"979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087\": rpc error: code = NotFound desc = could not find container \"979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087\": container with ID starting with 979ad6118f813bad279a190faec488a98d352eebe9afbba2d719f5519dd2f087 not found: ID does not exist"
Jul 21 21:09:12.975603 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.975579    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"]
Jul 21 21:09:12.987758 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:12.987736    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-0f699c57-gw-openshift-default-79d85b4c4c-n5t7w"]
Jul 21 21:09:14.497516 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:14.497487    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="199793d8-29d3-4854-86a5-c84c03732949" path="/var/lib/kubelet/pods/199793d8-29d3-4854-86a5-c84c03732949/volumes"
Jul 21 21:09:17.595453 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:17.595413    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:09:34.573493 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:34.573465    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 21:09:34.576047 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:34.576017    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 21:09:34.577046 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:34.577027    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:09:34.579883 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:34.579858    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:09:36.525005 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.524971    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"]
Jul 21 21:09:36.525380 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.525370    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="446e488a-0547-49f8-9140-84e0074aed6d" containerName="revoke-keys"
Jul 21 21:09:36.525421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.525382    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="446e488a-0547-49f8-9140-84e0074aed6d" containerName="revoke-keys"
Jul 21 21:09:36.525421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.525399    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy"
Jul 21 21:09:36.525421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.525404    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy"
Jul 21 21:09:36.525421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.525414    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy"
Jul 21 21:09:36.525545 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.525421    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ac8a926-0d1c-40e5-b27f-2443730ff354" containerName="istio-proxy"
Jul 21 21:09:36.525545 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.525434    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy"
Jul 21 21:09:36.525545 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.525440    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy"
Jul 21 21:09:36.525545 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.525539    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy"
Jul 21 21:09:36.525663 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.525548    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="446e488a-0547-49f8-9140-84e0074aed6d" containerName="revoke-keys"
Jul 21 21:09:36.525663 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.525558    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="199793d8-29d3-4854-86a5-c84c03732949" containerName="istio-proxy"
Jul 21 21:09:36.529737 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.529721    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"
Jul 21 21:09:36.532008 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.531986    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 21:09:36.532147 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.532052    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmths\""
Jul 21 21:09:36.536755 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.536731    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"]
Jul 21 21:09:36.705462 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.705427    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2357b6cc-349e-4b46-813b-4f73bed81dad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4\" (UID: \"2357b6cc-349e-4b46-813b-4f73bed81dad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"
Jul 21 21:09:36.806286 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.806254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2357b6cc-349e-4b46-813b-4f73bed81dad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4\" (UID: \"2357b6cc-349e-4b46-813b-4f73bed81dad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"
Jul 21 21:09:36.806881 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.806854    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2357b6cc-349e-4b46-813b-4f73bed81dad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4\" (UID: \"2357b6cc-349e-4b46-813b-4f73bed81dad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"
Jul 21 21:09:36.842440 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:36.842408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"
Jul 21 21:09:37.180346 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:37.180170    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"]
Jul 21 21:09:37.183127 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:09:37.183095    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2357b6cc_349e_4b46_813b_4f73bed81dad.slice/crio-d0d70b3ad9d4b2fedb9455b945ba41df106e717c620966b93bd0f566fa64615b WatchSource:0}: Error finding container d0d70b3ad9d4b2fedb9455b945ba41df106e717c620966b93bd0f566fa64615b: Status 404 returned error can't find the container with id d0d70b3ad9d4b2fedb9455b945ba41df106e717c620966b93bd0f566fa64615b
Jul 21 21:09:38.053784 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:38.053752    2560 generic.go:356] "Generic (PLEG): container finished" podID="2357b6cc-349e-4b46-813b-4f73bed81dad" containerID="e2ac1f02f340d92a0b4456d7e98ea40b28a798a49f87179e90f7626a4c607389" exitCode=0
Jul 21 21:09:38.054148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:38.053815    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4" event={"ID":"2357b6cc-349e-4b46-813b-4f73bed81dad","Type":"ContainerDied","Data":"e2ac1f02f340d92a0b4456d7e98ea40b28a798a49f87179e90f7626a4c607389"}
Jul 21 21:09:38.054148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:38.053851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4" event={"ID":"2357b6cc-349e-4b46-813b-4f73bed81dad","Type":"ContainerStarted","Data":"d0d70b3ad9d4b2fedb9455b945ba41df106e717c620966b93bd0f566fa64615b"}
Jul 21 21:09:39.196175 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:39.196149    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"
Jul 21 21:09:39.330423 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:39.330331    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2357b6cc-349e-4b46-813b-4f73bed81dad-maas-api-service-ca\") pod \"2357b6cc-349e-4b46-813b-4f73bed81dad\" (UID: \"2357b6cc-349e-4b46-813b-4f73bed81dad\") "
Jul 21 21:09:39.330700 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:39.330676    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2357b6cc-349e-4b46-813b-4f73bed81dad-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2357b6cc-349e-4b46-813b-4f73bed81dad" (UID: "2357b6cc-349e-4b46-813b-4f73bed81dad"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:09:39.431416 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:39.431380    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2357b6cc-349e-4b46-813b-4f73bed81dad-maas-api-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:09:40.065119 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:40.065083    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4" event={"ID":"2357b6cc-349e-4b46-813b-4f73bed81dad","Type":"ContainerDied","Data":"d0d70b3ad9d4b2fedb9455b945ba41df106e717c620966b93bd0f566fa64615b"}
Jul 21 21:09:40.065314 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:40.065156    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0d70b3ad9d4b2fedb9455b945ba41df106e717c620966b93bd0f566fa64615b"
Jul 21 21:09:40.065314 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:40.065099    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"
Jul 21 21:09:50.396661 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:50.396626    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:09:51.613011 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:51.612970    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"]
Jul 21 21:09:51.615863 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:51.615838    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-21b7cb95-c7cw4"]
Jul 21 21:09:52.497099 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:52.497065    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2357b6cc-349e-4b46-813b-4f73bed81dad" path="/var/lib/kubelet/pods/2357b6cc-349e-4b46-813b-4f73bed81dad/volumes"
Jul 21 21:09:53.659443 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.659404    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"]
Jul 21 21:09:53.659976 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.659920    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2357b6cc-349e-4b46-813b-4f73bed81dad" containerName="revoke-keys"
Jul 21 21:09:53.659976 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.659935    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2357b6cc-349e-4b46-813b-4f73bed81dad" containerName="revoke-keys"
Jul 21 21:09:53.660068 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.660016    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2357b6cc-349e-4b46-813b-4f73bed81dad" containerName="revoke-keys"
Jul 21 21:09:53.663317 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.663299    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.665760 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.665739    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-febaebdc-openshift-default-dockercfg-j7bfg\""
Jul 21 21:09:53.676263 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.676240    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"]
Jul 21 21:09:53.748433 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.748402    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-credential-socket\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.748593 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.748442    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-token\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.748593 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.748468    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istiod-ca-cert\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.748593 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.748534    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-socket\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.748711 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.748622    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-envoy\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.748711 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.748667    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-data\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.748789 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.748731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-certs\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.748789 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.748756    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w9dc\" (UniqueName: \"kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-kube-api-access-8w9dc\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.748861 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.748822    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-podinfo\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.849605 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.849569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-data\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.849801 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.849612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-certs\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.849801 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.849635    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w9dc\" (UniqueName: \"kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-kube-api-access-8w9dc\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.849801 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.849667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-podinfo\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.849801 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.849699    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-credential-socket\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.849801 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.849715    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-token\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.849801 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.849731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istiod-ca-cert\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.849801 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.849750    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-socket\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.850166 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.849883    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-envoy\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.850166 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.850032    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-certs\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.850309 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.850279    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-data\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.850354 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.850302    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-socket\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.850409 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.850384    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-credential-socket\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.850580 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.850554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istiod-ca-cert\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.852050 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.852030    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-envoy\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.852427 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.852411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-podinfo\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.858416 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.858393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-token\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.858646 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.858629    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w9dc\" (UniqueName: \"kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-kube-api-access-8w9dc\") pod \"e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") " pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:53.974282 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:53.974202    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:54.111311 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:54.111282    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"]
Jul 21 21:09:54.113078 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:09:54.113053    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a17cc0f_3ad7_449a_a706_3f116c609cf1.slice/crio-89201428c08cfe913229dce05beed58fa72bb19210e7e08571887041324dc6c6 WatchSource:0}: Error finding container 89201428c08cfe913229dce05beed58fa72bb19210e7e08571887041324dc6c6: Status 404 returned error can't find the container with id 89201428c08cfe913229dce05beed58fa72bb19210e7e08571887041324dc6c6
Jul 21 21:09:54.115311 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:54.115272    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:09:54.115378 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:54.115360    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:09:54.115422 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:54.115409    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:09:54.133348 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:54.133312    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" event={"ID":"6a17cc0f-3ad7-449a-a706-3f116c609cf1","Type":"ContainerStarted","Data":"89201428c08cfe913229dce05beed58fa72bb19210e7e08571887041324dc6c6"}
Jul 21 21:09:55.139976 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:55.139938    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" event={"ID":"6a17cc0f-3ad7-449a-a706-3f116c609cf1","Type":"ContainerStarted","Data":"c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769"}
Jul 21 21:09:55.174045 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:55.173996    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" podStartSLOduration=2.173981633 podStartE2EDuration="2.173981633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:09:55.172224194 +0000 UTC m=+1821.192632659" watchObservedRunningTime="2026-07-21 21:09:55.173981633 +0000 UTC m=+1821.194390153"
Jul 21 21:09:55.974528 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:55.974487    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:55.979653 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:55.979627    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:56.145255 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:56.145223    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:09:56.146233 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:09:56.146213    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:10:01.706555 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:01.706512    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:10:10.217236 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:10.217181    2560 generic.go:356] "Generic (PLEG): container finished" podID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerID="c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769" exitCode=0
Jul 21 21:10:10.217773 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:10.217256    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" event={"ID":"6a17cc0f-3ad7-449a-a706-3f116c609cf1","Type":"ContainerDied","Data":"c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769"}
Jul 21 21:10:10.217773 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:10.217728    2560 scope.go:117] "RemoveContainer" containerID="c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769"
Jul 21 21:10:10.218758 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:10.218728    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:10:10.218871 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:10.218810    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:10:10.218871 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:10.218859    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:10:11.145441 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:11.145409    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:10:11.224093 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:11.224058    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" event={"ID":"6a17cc0f-3ad7-449a-a706-3f116c609cf1","Type":"ContainerStarted","Data":"cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207"}
Jul 21 21:10:11.975394 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:11.975353    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:10:11.976553 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:11.976530    2560 patch_prober.go:28] interesting pod/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 21 21:10:11.976615 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:11.976580    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 21 21:10:12.974979 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:12.974941    2560 patch_prober.go:28] interesting pod/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 21 21:10:12.975431 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:12.975007    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 21 21:10:13.975137 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:13.975100    2560 patch_prober.go:28] interesting pod/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 21 21:10:13.975594 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:13.975153    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 21 21:10:14.975570 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:14.975536    2560 patch_prober.go:28] interesting pod/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 21 21:10:14.975964 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:14.975589    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 21 21:10:15.978328 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:15.978290    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:10:15.978788 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:15.978679    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:10:15.979403 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:15.979382    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:10:21.453256 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:21.453210    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"]
Jul 21 21:10:21.457179 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:21.457161    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"
Jul 21 21:10:21.459423 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:21.459395    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 21:10:21.459518 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:21.459466    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmths\""
Jul 21 21:10:21.463922 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:21.463895    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"]
Jul 21 21:10:21.619203 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:21.619150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d996676-3b8b-48b9-8c2d-5c0387f6040d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj\" (UID: \"0d996676-3b8b-48b9-8c2d-5c0387f6040d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"
Jul 21 21:10:21.720722 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:21.720633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d996676-3b8b-48b9-8c2d-5c0387f6040d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj\" (UID: \"0d996676-3b8b-48b9-8c2d-5c0387f6040d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"
Jul 21 21:10:21.721308 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:21.721288    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d996676-3b8b-48b9-8c2d-5c0387f6040d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj\" (UID: \"0d996676-3b8b-48b9-8c2d-5c0387f6040d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"
Jul 21 21:10:21.769161 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:21.769136    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"
Jul 21 21:10:21.900009 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:21.899984    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"]
Jul 21 21:10:21.902707 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:10:21.902679    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d996676_3b8b_48b9_8c2d_5c0387f6040d.slice/crio-7c7b6f0fa16ae8b47571dbe025fcf2e1b0b518b7f148d8cf76ee6c16f90fd5d7 WatchSource:0}: Error finding container 7c7b6f0fa16ae8b47571dbe025fcf2e1b0b518b7f148d8cf76ee6c16f90fd5d7: Status 404 returned error can't find the container with id 7c7b6f0fa16ae8b47571dbe025fcf2e1b0b518b7f148d8cf76ee6c16f90fd5d7
Jul 21 21:10:22.298801 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:22.298770    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj" event={"ID":"0d996676-3b8b-48b9-8c2d-5c0387f6040d","Type":"ContainerStarted","Data":"abba51e5c2c00f7785bfbcf59538f920db00c83fe23cde58a9f67fec5214f171"}
Jul 21 21:10:22.298936 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:22.298822    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj" event={"ID":"0d996676-3b8b-48b9-8c2d-5c0387f6040d","Type":"ContainerStarted","Data":"7c7b6f0fa16ae8b47571dbe025fcf2e1b0b518b7f148d8cf76ee6c16f90fd5d7"}
Jul 21 21:10:22.315397 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:22.315351    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj" podStartSLOduration=1.315336 podStartE2EDuration="1.315336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:10:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:10:22.314285622 +0000 UTC m=+1848.334694081" watchObservedRunningTime="2026-07-21 21:10:22.315336 +0000 UTC m=+1848.335744512"
Jul 21 21:10:23.305342 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:23.305303    2560 generic.go:356] "Generic (PLEG): container finished" podID="0d996676-3b8b-48b9-8c2d-5c0387f6040d" containerID="abba51e5c2c00f7785bfbcf59538f920db00c83fe23cde58a9f67fec5214f171" exitCode=0
Jul 21 21:10:23.305720 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:23.305381    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj" event={"ID":"0d996676-3b8b-48b9-8c2d-5c0387f6040d","Type":"ContainerDied","Data":"abba51e5c2c00f7785bfbcf59538f920db00c83fe23cde58a9f67fec5214f171"}
Jul 21 21:10:24.441947 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:24.441921    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"
Jul 21 21:10:24.546149 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:24.546119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d996676-3b8b-48b9-8c2d-5c0387f6040d-maas-api-service-ca\") pod \"0d996676-3b8b-48b9-8c2d-5c0387f6040d\" (UID: \"0d996676-3b8b-48b9-8c2d-5c0387f6040d\") "
Jul 21 21:10:24.546487 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:24.546461    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d996676-3b8b-48b9-8c2d-5c0387f6040d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d996676-3b8b-48b9-8c2d-5c0387f6040d" (UID: "0d996676-3b8b-48b9-8c2d-5c0387f6040d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:10:24.647331 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:24.647233    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d996676-3b8b-48b9-8c2d-5c0387f6040d-maas-api-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:10:25.316361 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:25.316332    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"
Jul 21 21:10:25.316562 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:25.316332    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj" event={"ID":"0d996676-3b8b-48b9-8c2d-5c0387f6040d","Type":"ContainerDied","Data":"7c7b6f0fa16ae8b47571dbe025fcf2e1b0b518b7f148d8cf76ee6c16f90fd5d7"}
Jul 21 21:10:25.316562 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:25.316448    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c7b6f0fa16ae8b47571dbe025fcf2e1b0b518b7f148d8cf76ee6c16f90fd5d7"
Jul 21 21:10:34.797403 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:34.797363    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:10:36.542523 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:36.542494    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"]
Jul 21 21:10:36.546459 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:36.546436    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-febaebdc-zx4hj"]
Jul 21 21:10:36.713122 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:36.713085    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"]
Jul 21 21:10:36.713370 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:36.713319    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerName="istio-proxy" containerID="cri-o://cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207" gracePeriod=30
Jul 21 21:10:38.497654 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:38.497620    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d996676-3b8b-48b9-8c2d-5c0387f6040d" path="/var/lib/kubelet/pods/0d996676-3b8b-48b9-8c2d-5c0387f6040d/volumes"
Jul 21 21:10:41.967829 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:41.967805    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:10:42.102839 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.102805    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-certs\") pod \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") "
Jul 21 21:10:42.103029 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.102854    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-socket\") pod \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") "
Jul 21 21:10:42.103029 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.102874    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istiod-ca-cert\") pod \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") "
Jul 21 21:10:42.103029 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.102925    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-token\") pod \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") "
Jul 21 21:10:42.103029 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.102941    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-data\") pod \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") "
Jul 21 21:10:42.103029 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.102979    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-credential-socket\") pod \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") "
Jul 21 21:10:42.103029 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.102994    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-envoy\") pod \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") "
Jul 21 21:10:42.103029 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.103014    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-podinfo\") pod \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") "
Jul 21 21:10:42.103421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.103050    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w9dc\" (UniqueName: \"kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-kube-api-access-8w9dc\") pod \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\" (UID: \"6a17cc0f-3ad7-449a-a706-3f116c609cf1\") "
Jul 21 21:10:42.103421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.103102    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a17cc0f-3ad7-449a-a706-3f116c609cf1" (UID: "6a17cc0f-3ad7-449a-a706-3f116c609cf1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:10:42.103421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.103215    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a17cc0f-3ad7-449a-a706-3f116c609cf1" (UID: "6a17cc0f-3ad7-449a-a706-3f116c609cf1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:10:42.103421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.103340    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a17cc0f-3ad7-449a-a706-3f116c609cf1" (UID: "6a17cc0f-3ad7-449a-a706-3f116c609cf1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:10:42.103421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.103428    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:10:42.103740 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.103447    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:10:42.103740 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.103446    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a17cc0f-3ad7-449a-a706-3f116c609cf1" (UID: "6a17cc0f-3ad7-449a-a706-3f116c609cf1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:10:42.103740 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.103462    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:10:42.104108 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.104082    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a17cc0f-3ad7-449a-a706-3f116c609cf1" (UID: "6a17cc0f-3ad7-449a-a706-3f116c609cf1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:10:42.105418 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.105389    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a17cc0f-3ad7-449a-a706-3f116c609cf1" (UID: "6a17cc0f-3ad7-449a-a706-3f116c609cf1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:10:42.105535 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.105517    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a17cc0f-3ad7-449a-a706-3f116c609cf1" (UID: "6a17cc0f-3ad7-449a-a706-3f116c609cf1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:10:42.105535 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.105524    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-kube-api-access-8w9dc" (OuterVolumeSpecName: "kube-api-access-8w9dc") pod "6a17cc0f-3ad7-449a-a706-3f116c609cf1" (UID: "6a17cc0f-3ad7-449a-a706-3f116c609cf1"). InnerVolumeSpecName "kube-api-access-8w9dc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:10:42.105641 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.105531    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a17cc0f-3ad7-449a-a706-3f116c609cf1" (UID: "6a17cc0f-3ad7-449a-a706-3f116c609cf1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:10:42.204311 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.204276    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:10:42.204311 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.204305    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:10:42.204311 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.204317    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:10:42.204520 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.204329    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:10:42.204520 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.204340    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a17cc0f-3ad7-449a-a706-3f116c609cf1-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:10:42.204520 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.204351    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w9dc\" (UniqueName: \"kubernetes.io/projected/6a17cc0f-3ad7-449a-a706-3f116c609cf1-kube-api-access-8w9dc\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:10:42.410555 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.410469    2560 generic.go:356] "Generic (PLEG): container finished" podID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerID="cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207" exitCode=0
Jul 21 21:10:42.410555 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.410511    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"
Jul 21 21:10:42.410761 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.410555    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" event={"ID":"6a17cc0f-3ad7-449a-a706-3f116c609cf1","Type":"ContainerDied","Data":"cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207"}
Jul 21 21:10:42.410761 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.410610    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5" event={"ID":"6a17cc0f-3ad7-449a-a706-3f116c609cf1","Type":"ContainerDied","Data":"89201428c08cfe913229dce05beed58fa72bb19210e7e08571887041324dc6c6"}
Jul 21 21:10:42.410761 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.410634    2560 scope.go:117] "RemoveContainer" containerID="cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207"
Jul 21 21:10:42.420103 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.420084    2560 scope.go:117] "RemoveContainer" containerID="c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769"
Jul 21 21:10:42.427728 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.427710    2560 scope.go:117] "RemoveContainer" containerID="cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207"
Jul 21 21:10:42.427981 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:10:42.427962    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207\": container with ID starting with cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207 not found: ID does not exist" containerID="cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207"
Jul 21 21:10:42.428038 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.427989    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207"} err="failed to get container status \"cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207\": rpc error: code = NotFound desc = could not find container \"cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207\": container with ID starting with cb566228c3d895e686dba51b64bb0da9d14949d52111c4761f01e61588dca207 not found: ID does not exist"
Jul 21 21:10:42.428038 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.428009    2560 scope.go:117] "RemoveContainer" containerID="c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769"
Jul 21 21:10:42.428247 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:10:42.428233    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769\": container with ID starting with c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769 not found: ID does not exist" containerID="c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769"
Jul 21 21:10:42.428300 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.428251    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769"} err="failed to get container status \"c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769\": rpc error: code = NotFound desc = could not find container \"c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769\": container with ID starting with c76519f46812b78182b07fd095c7e31a0745eb99878687dca82dfafab1f3c769 not found: ID does not exist"
Jul 21 21:10:42.432756 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.432734    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"]
Jul 21 21:10:42.436707 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.436689    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-febaebdc-openshift-default-79b7dbbdcf-s7ct5"]
Jul 21 21:10:42.498043 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:10:42.498013    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" path="/var/lib/kubelet/pods/6a17cc0f-3ad7-449a-a706-3f116c609cf1/volumes"
Jul 21 21:12:02.017019 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:02.016980    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:12:14.405393 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:14.405354    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:12:15.989565 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:15.989530    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"]
Jul 21 21:12:15.990068 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:15.990046    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerName="istio-proxy"
Jul 21 21:12:15.990145 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:15.990070    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerName="istio-proxy"
Jul 21 21:12:15.990145 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:15.990108    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d996676-3b8b-48b9-8c2d-5c0387f6040d" containerName="revoke-keys"
Jul 21 21:12:15.990145 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:15.990120    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d996676-3b8b-48b9-8c2d-5c0387f6040d" containerName="revoke-keys"
Jul 21 21:12:15.990329 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:15.990232    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d996676-3b8b-48b9-8c2d-5c0387f6040d" containerName="revoke-keys"
Jul 21 21:12:15.990329 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:15.990248    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerName="istio-proxy"
Jul 21 21:12:15.990329 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:15.990261    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerName="istio-proxy"
Jul 21 21:12:15.993166 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:15.993145    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:15.996303 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:15.996283    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-99bde6d0-openshift-default-dockercfg-s65pd\""
Jul 21 21:12:16.020391 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.020367    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"]
Jul 21 21:12:16.037559 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.037528    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-credential-socket\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.037673 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.037566    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p97h\" (UniqueName: \"kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-kube-api-access-9p97h\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.037673 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.037664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-data\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.037791 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.037718    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-token\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.037791 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.037766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-socket\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.037888 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.037801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-envoy\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.037888 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.037818    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istiod-ca-cert\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.037888 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.037860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-certs\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.037993 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.037915    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-podinfo\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.138554 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.138516    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-socket\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.138735 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.138569    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-envoy\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.138735 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.138594    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istiod-ca-cert\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.138735 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.138646    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-certs\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.138735 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.138685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-podinfo\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.138735 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.138729    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-credential-socket\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.139008 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.138821    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p97h\" (UniqueName: \"kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-kube-api-access-9p97h\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.139008 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.138887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-data\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.139008 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.138937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-token\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.139182 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.139143    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-socket\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.139275 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.139261    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-certs\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.139350 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.139321    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-data\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.139486 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.139457    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istiod-ca-cert\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.139486 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.139474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-credential-socket\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.140926 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.140898    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-envoy\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.141154 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.141135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-podinfo\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.149940 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.149915    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p97h\" (UniqueName: \"kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-kube-api-access-9p97h\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.150054 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.150000    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-token\") pod \"e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") " pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.303758 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.303731    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:16.442558 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.442536    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"]
Jul 21 21:12:16.444441 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:12:16.444404    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb4ca1b_83a1_4ea5_913e_f78b3da0de7e.slice/crio-29a67f9e886e8c61e8ea679ecfe0ba7bce383f00c8431f09ae2338feed3a50ea WatchSource:0}: Error finding container 29a67f9e886e8c61e8ea679ecfe0ba7bce383f00c8431f09ae2338feed3a50ea: Status 404 returned error can't find the container with id 29a67f9e886e8c61e8ea679ecfe0ba7bce383f00c8431f09ae2338feed3a50ea
Jul 21 21:12:16.446552 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.446521    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:12:16.446637 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.446581    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:12:16.446637 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.446609    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:12:16.873491 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.873451    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" event={"ID":"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e","Type":"ContainerStarted","Data":"35891fcc577c9975dcc9efb5227cf862a155dcf6bbdd936fc27175fdbf7c9b12"}
Jul 21 21:12:16.873637 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.873518    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" event={"ID":"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e","Type":"ContainerStarted","Data":"29a67f9e886e8c61e8ea679ecfe0ba7bce383f00c8431f09ae2338feed3a50ea"}
Jul 21 21:12:16.901776 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:16.901725    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" podStartSLOduration=1.9017110050000001 podStartE2EDuration="1.901711005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:12:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:12:16.899059307 +0000 UTC m=+1962.919467794" watchObservedRunningTime="2026-07-21 21:12:16.901711005 +0000 UTC m=+1962.922119538"
Jul 21 21:12:17.304123 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:17.304097    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:17.308778 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:17.308749    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:17.878331 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:17.878302    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:17.879382 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:17.879360    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:24.706979 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:24.706939    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:12:31.124712 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.124673    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"]
Jul 21 21:12:31.125244 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.125228    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerName="istio-proxy"
Jul 21 21:12:31.125292 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.125246    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a17cc0f-3ad7-449a-a706-3f116c609cf1" containerName="istio-proxy"
Jul 21 21:12:31.130227 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.130208    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"
Jul 21 21:12:31.132730 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.132705    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmths\""
Jul 21 21:12:31.132862 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.132734    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 21:12:31.136597 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.136567    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"]
Jul 21 21:12:31.286360 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.286319    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/629dd616-a30d-4a95-8a6f-ccb99f7ee8c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2\" (UID: \"629dd616-a30d-4a95-8a6f-ccb99f7ee8c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"
Jul 21 21:12:31.387233 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.387131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/629dd616-a30d-4a95-8a6f-ccb99f7ee8c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2\" (UID: \"629dd616-a30d-4a95-8a6f-ccb99f7ee8c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"
Jul 21 21:12:31.387743 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.387723    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/629dd616-a30d-4a95-8a6f-ccb99f7ee8c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2\" (UID: \"629dd616-a30d-4a95-8a6f-ccb99f7ee8c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"
Jul 21 21:12:31.444714 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.444686    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"
Jul 21 21:12:31.793861 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.793832    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"]
Jul 21 21:12:31.796526 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:12:31.796496    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629dd616_a30d_4a95_8a6f_ccb99f7ee8c9.slice/crio-652978a7ed90db5f841f93894dcb01ef27e7e4890feafea8a6a7f78098c9d9f4 WatchSource:0}: Error finding container 652978a7ed90db5f841f93894dcb01ef27e7e4890feafea8a6a7f78098c9d9f4: Status 404 returned error can't find the container with id 652978a7ed90db5f841f93894dcb01ef27e7e4890feafea8a6a7f78098c9d9f4
Jul 21 21:12:31.950415 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:31.950373    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2" event={"ID":"629dd616-a30d-4a95-8a6f-ccb99f7ee8c9","Type":"ContainerStarted","Data":"652978a7ed90db5f841f93894dcb01ef27e7e4890feafea8a6a7f78098c9d9f4"}
Jul 21 21:12:32.880064 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:32.880029    2560 patch_prober.go:28] interesting pod/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 21 21:12:32.880411 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:32.880095    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 21 21:12:32.957037 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:32.957009    2560 generic.go:356] "Generic (PLEG): container finished" podID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerID="35891fcc577c9975dcc9efb5227cf862a155dcf6bbdd936fc27175fdbf7c9b12" exitCode=0
Jul 21 21:12:32.957181 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:32.957087    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" event={"ID":"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e","Type":"ContainerDied","Data":"35891fcc577c9975dcc9efb5227cf862a155dcf6bbdd936fc27175fdbf7c9b12"}
Jul 21 21:12:32.957578 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:32.957555    2560 scope.go:117] "RemoveContainer" containerID="35891fcc577c9975dcc9efb5227cf862a155dcf6bbdd936fc27175fdbf7c9b12"
Jul 21 21:12:32.958684 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:32.958655    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:12:32.958787 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:32.958695    2560 generic.go:356] "Generic (PLEG): container finished" podID="629dd616-a30d-4a95-8a6f-ccb99f7ee8c9" containerID="cfb99e698e353515f29f897b2884b1e90dbcb8e844e24c9442760ee5865b7a41" exitCode=0
Jul 21 21:12:32.958787 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:32.958742    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2" event={"ID":"629dd616-a30d-4a95-8a6f-ccb99f7ee8c9","Type":"ContainerDied","Data":"cfb99e698e353515f29f897b2884b1e90dbcb8e844e24c9442760ee5865b7a41"}
Jul 21 21:12:32.958787 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:32.958741    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:12:32.958787 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:32.958780    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:12:33.966092 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:33.966055    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" event={"ID":"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e","Type":"ContainerStarted","Data":"593c905f1c6e440df052b4049b5869b146bf462a5085e1a83a1d0577c88fa513"}
Jul 21 21:12:34.109720 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:34.109694    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"
Jul 21 21:12:34.213397 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:34.213362    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/629dd616-a30d-4a95-8a6f-ccb99f7ee8c9-maas-api-service-ca\") pod \"629dd616-a30d-4a95-8a6f-ccb99f7ee8c9\" (UID: \"629dd616-a30d-4a95-8a6f-ccb99f7ee8c9\") "
Jul 21 21:12:34.213689 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:34.213666    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/629dd616-a30d-4a95-8a6f-ccb99f7ee8c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "629dd616-a30d-4a95-8a6f-ccb99f7ee8c9" (UID: "629dd616-a30d-4a95-8a6f-ccb99f7ee8c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:12:34.304873 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:34.304841    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:34.305081 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:34.305059    2560 patch_prober.go:28] interesting pod/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 21 21:12:34.305155 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:34.305114    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 21 21:12:34.314164 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:34.314141    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/629dd616-a30d-4a95-8a6f-ccb99f7ee8c9-maas-api-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:12:34.972237 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:34.972205    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"
Jul 21 21:12:34.972237 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:34.972233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2" event={"ID":"629dd616-a30d-4a95-8a6f-ccb99f7ee8c9","Type":"ContainerDied","Data":"652978a7ed90db5f841f93894dcb01ef27e7e4890feafea8a6a7f78098c9d9f4"}
Jul 21 21:12:34.972710 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:34.972280    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="652978a7ed90db5f841f93894dcb01ef27e7e4890feafea8a6a7f78098c9d9f4"
Jul 21 21:12:35.304804 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:35.304763    2560 patch_prober.go:28] interesting pod/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 21 21:12:35.304966 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:35.304840    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 21 21:12:36.304588 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:36.304552    2560 patch_prober.go:28] interesting pod/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 21 21:12:36.304971 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:36.304607    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 21 21:12:37.304608 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:37.304568    2560 patch_prober.go:28] interesting pod/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 21 21:12:37.305000 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:37.304641    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 21 21:12:38.308484 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:38.308448    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:38.308962 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:38.308822    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:38.309510 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:38.309494    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:44.691474 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:44.691432    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:12:46.207146 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:46.207112    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"]
Jul 21 21:12:46.211212 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:46.211171    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-99bde6d0-dvmt2"]
Jul 21 21:12:46.498062 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:46.497982    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="629dd616-a30d-4a95-8a6f-ccb99f7ee8c9" path="/var/lib/kubelet/pods/629dd616-a30d-4a95-8a6f-ccb99f7ee8c9/volumes"
Jul 21 21:12:52.956108 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:52.956072    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"]
Jul 21 21:12:52.956588 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:52.956307    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy" containerID="cri-o://593c905f1c6e440df052b4049b5869b146bf462a5085e1a83a1d0577c88fa513" gracePeriod=30
Jul 21 21:12:53.311302 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:53.311267    2560 patch_prober.go:28] interesting pod/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 21:12:53.311468 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:53.311339    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 21:12:58.094874 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.094837    2560 generic.go:356] "Generic (PLEG): container finished" podID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerID="593c905f1c6e440df052b4049b5869b146bf462a5085e1a83a1d0577c88fa513" exitCode=0
Jul 21 21:12:58.095238 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.094909    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" event={"ID":"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e","Type":"ContainerDied","Data":"593c905f1c6e440df052b4049b5869b146bf462a5085e1a83a1d0577c88fa513"}
Jul 21 21:12:58.095238 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.094972    2560 scope.go:117] "RemoveContainer" containerID="35891fcc577c9975dcc9efb5227cf862a155dcf6bbdd936fc27175fdbf7c9b12"
Jul 21 21:12:58.215264 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.215209    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:58.333410 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.333381    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-data\") pod \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") "
Jul 21 21:12:58.333577 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.333419    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-podinfo\") pod \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") "
Jul 21 21:12:58.333577 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.333444    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-certs\") pod \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") "
Jul 21 21:12:58.333577 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.333471    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-envoy\") pod \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") "
Jul 21 21:12:58.333756 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.333596    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-socket\") pod \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") "
Jul 21 21:12:58.333756 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.333672    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p97h\" (UniqueName: \"kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-kube-api-access-9p97h\") pod \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") "
Jul 21 21:12:58.333865 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.333768    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-credential-socket\") pod \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") "
Jul 21 21:12:58.333865 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.333801    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-token\") pod \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") "
Jul 21 21:12:58.333865 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.333807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" (UID: "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:12:58.333865 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.333829    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istiod-ca-cert\") pod \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\" (UID: \"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e\") "
Jul 21 21:12:58.333865 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.333825    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" (UID: "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:12:58.334121 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.334028    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" (UID: "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:12:58.334215 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.334147    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:12:58.334215 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.334167    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:12:58.334215 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.334203    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:12:58.334383 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.334239    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" (UID: "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:12:58.334383 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.334259    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" (UID: "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:12:58.335719 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.335694    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" (UID: "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:12:58.335913 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.335891    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" (UID: "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:12:58.335964 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.335901    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-kube-api-access-9p97h" (OuterVolumeSpecName: "kube-api-access-9p97h") pod "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" (UID: "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e"). InnerVolumeSpecName "kube-api-access-9p97h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:12:58.335964 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.335930    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" (UID: "9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:12:58.434898 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.434869    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:12:58.434898 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.434892    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:12:58.434898 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.434902    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:12:58.435131 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.434911    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:12:58.435131 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.434919    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:12:58.435131 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:58.434927    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p97h\" (UniqueName: \"kubernetes.io/projected/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e-kube-api-access-9p97h\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:12:59.101813 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:59.101772    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9" event={"ID":"9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e","Type":"ContainerDied","Data":"29a67f9e886e8c61e8ea679ecfe0ba7bce383f00c8431f09ae2338feed3a50ea"}
Jul 21 21:12:59.102255 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:59.101828    2560 scope.go:117] "RemoveContainer" containerID="593c905f1c6e440df052b4049b5869b146bf462a5085e1a83a1d0577c88fa513"
Jul 21 21:12:59.102255 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:59.101784    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"
Jul 21 21:12:59.146248 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:59.146225    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"]
Jul 21 21:12:59.167215 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:12:59.167178    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-99bde6d0-openshift-default-77cf947cb7-vpql9"]
Jul 21 21:13:00.498788 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:00.498759    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" path="/var/lib/kubelet/pods/9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e/volumes"
Jul 21 21:13:14.019618 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.019580    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"]
Jul 21 21:13:14.019985 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.019934    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy"
Jul 21 21:13:14.019985 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.019946    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy"
Jul 21 21:13:14.019985 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.019959    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy"
Jul 21 21:13:14.019985 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.019965    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy"
Jul 21 21:13:14.019985 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.019970    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="629dd616-a30d-4a95-8a6f-ccb99f7ee8c9" containerName="revoke-keys"
Jul 21 21:13:14.019985 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.019976    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="629dd616-a30d-4a95-8a6f-ccb99f7ee8c9" containerName="revoke-keys"
Jul 21 21:13:14.020222 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.020044    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy"
Jul 21 21:13:14.020222 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.020050    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cb4ca1b-83a1-4ea5-913e-f78b3da0de7e" containerName="istio-proxy"
Jul 21 21:13:14.020222 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.020059    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="629dd616-a30d-4a95-8a6f-ccb99f7ee8c9" containerName="revoke-keys"
Jul 21 21:13:14.022908 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.022890    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.028481 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.028458    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-371611dd-openshift-default-dockercfg-jz44b\""
Jul 21 21:13:14.160838 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.160807    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"]
Jul 21 21:13:14.182154 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.182124    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-podinfo\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.182343 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.182219    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba76284c-ca99-4784-9500-884a2bbf6f68-istiod-ca-cert\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.182343 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.182261    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmc7c\" (UniqueName: \"kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-kube-api-access-bmc7c\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.182343 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.182285    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-certs\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.182463 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.182338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-token\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.182463 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.182383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-socket\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.182463 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.182424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-data\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.182567 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.182486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-envoy\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.182567 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.182530    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-credential-socket\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283277 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283202    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba76284c-ca99-4784-9500-884a2bbf6f68-istiod-ca-cert\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283277 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmc7c\" (UniqueName: \"kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-kube-api-access-bmc7c\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283277 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283258    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-certs\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283277 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283279    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-token\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283568 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283310    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-socket\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283568 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283345    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-data\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283568 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283363    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-envoy\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283568 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283388    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-credential-socket\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283568 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283421    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-podinfo\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283876 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-certs\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283876 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-data\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283876 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283831    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-socket\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283999 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-credential-socket\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.283999 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.283955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba76284c-ca99-4784-9500-884a2bbf6f68-istiod-ca-cert\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.285736 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.285718    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-envoy\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.285938 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.285918    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-podinfo\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.296098 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.296070    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-token\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.298604 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.298581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmc7c\" (UniqueName: \"kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-kube-api-access-bmc7c\") pod \"e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") " pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.332791 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.332770    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:14.471452 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.471429    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"]
Jul 21 21:13:14.473276 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:13:14.473248    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba76284c_ca99_4784_9500_884a2bbf6f68.slice/crio-b2351e96befb919b692227be84a60a5414b5d4a5f82f8d298986cde078c0a7bf WatchSource:0}: Error finding container b2351e96befb919b692227be84a60a5414b5d4a5f82f8d298986cde078c0a7bf: Status 404 returned error can't find the container with id b2351e96befb919b692227be84a60a5414b5d4a5f82f8d298986cde078c0a7bf
Jul 21 21:13:14.475355 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.475320    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:13:14.475421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.475382    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:13:14.475421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:14.475413    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:13:15.180810 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:15.180771    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" event={"ID":"ba76284c-ca99-4784-9500-884a2bbf6f68","Type":"ContainerStarted","Data":"325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d"}
Jul 21 21:13:15.181360 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:15.180828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" event={"ID":"ba76284c-ca99-4784-9500-884a2bbf6f68","Type":"ContainerStarted","Data":"b2351e96befb919b692227be84a60a5414b5d4a5f82f8d298986cde078c0a7bf"}
Jul 21 21:13:15.206173 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:15.206121    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" podStartSLOduration=2.206104474 podStartE2EDuration="2.206104474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:13:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:13:15.204616479 +0000 UTC m=+2021.225024942" watchObservedRunningTime="2026-07-21 21:13:15.206104474 +0000 UTC m=+2021.226512942"
Jul 21 21:13:15.333820 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:15.333784    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:15.338090 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:15.338063    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:16.186448 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:16.186411    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:16.187398 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:16.187383    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:23.199742 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:23.199702    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:13:31.188700 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:31.188582    2560 patch_prober.go:28] interesting pod/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 21 21:13:31.188700 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:31.188656    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 21 21:13:31.275739 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:31.275706    2560 generic.go:356] "Generic (PLEG): container finished" podID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerID="325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d" exitCode=0
Jul 21 21:13:31.275889 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:31.275783    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" event={"ID":"ba76284c-ca99-4784-9500-884a2bbf6f68","Type":"ContainerDied","Data":"325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d"}
Jul 21 21:13:31.276157 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:31.276144    2560 scope.go:117] "RemoveContainer" containerID="325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d"
Jul 21 21:13:31.277316 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:31.277285    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:13:31.277399 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:31.277366    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:13:31.277438 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:31.277403    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:13:32.282269 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:32.282233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" event={"ID":"ba76284c-ca99-4784-9500-884a2bbf6f68","Type":"ContainerStarted","Data":"e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35"}
Jul 21 21:13:32.333879 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:32.333842    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:32.334150 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:32.334118    2560 patch_prober.go:28] interesting pod/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 21 21:13:32.334272 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:32.334179    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 21 21:13:33.333941 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:33.333902    2560 patch_prober.go:28] interesting pod/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 21 21:13:33.334447 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:33.333975    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 21 21:13:34.333854 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:34.333400    2560 patch_prober.go:28] interesting pod/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 21 21:13:34.333854 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:34.333463    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 21 21:13:35.333994 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:35.333955    2560 patch_prober.go:28] interesting pod/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 21 21:13:35.334211 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:35.334023    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 21 21:13:36.333326 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:36.333291    2560 patch_prober.go:28] interesting pod/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 21 21:13:36.333504 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:36.333358    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 21 21:13:37.337174 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:37.337145    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:37.337637 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:37.337428    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:37.338163 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:37.338148    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:13:40.993754 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:40.993710    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"]
Jul 21 21:13:40.997699 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:40.997679    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.001315 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.001289    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-371611dd\"/\"kube-root-ca.crt\""
Jul 21 21:13:41.001445 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.001293    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-371611dd\"/\"openshift-service-ca.crt\""
Jul 21 21:13:41.001445 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.001352    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-371611dd\"/\"e2e-lifecycle-model-371611dd-kserve-self-signed-certs\""
Jul 21 21:13:41.001445 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.001351    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-371611dd\"/\"default-dockercfg-vtrh7\""
Jul 21 21:13:41.006382 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.006363    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"]
Jul 21 21:13:41.027772 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.027746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-tmp-dir\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.027932 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.027782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-home\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.027932 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.027798    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-dshm\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.027932 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.027906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d265l\" (UniqueName: \"kubernetes.io/projected/247a2a25-4188-4a88-957a-ff6f835d79a7-kube-api-access-d265l\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.028057 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.027955    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/247a2a25-4188-4a88-957a-ff6f835d79a7-tls-certs\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.028057 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.028007    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-model-cache\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.129280 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.129254    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d265l\" (UniqueName: \"kubernetes.io/projected/247a2a25-4188-4a88-957a-ff6f835d79a7-kube-api-access-d265l\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.129392 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.129287    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/247a2a25-4188-4a88-957a-ff6f835d79a7-tls-certs\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.129392 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.129311    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-model-cache\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.129475 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.129414    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-tmp-dir\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.129475 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.129450    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-home\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.129475 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.129471    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-dshm\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.129803 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.129773    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-model-cache\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.129873 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.129804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-tmp-dir\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.129916 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.129866    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-home\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.131579 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.131549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-dshm\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.131945 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.131924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/247a2a25-4188-4a88-957a-ff6f835d79a7-tls-certs\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.137283 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.137265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d265l\" (UniqueName: \"kubernetes.io/projected/247a2a25-4188-4a88-957a-ff6f835d79a7-kube-api-access-d265l\") pod \"e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") " pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.308313 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.308289    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:41.446761 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:41.446735    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"]
Jul 21 21:13:41.448709 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:13:41.448679    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod247a2a25_4188_4a88_957a_ff6f835d79a7.slice/crio-137973db5e831dd866dea5f1d2f25d141d7e63391250cf7c775a1c18d1aa1a75 WatchSource:0}: Error finding container 137973db5e831dd866dea5f1d2f25d141d7e63391250cf7c775a1c18d1aa1a75: Status 404 returned error can't find the container with id 137973db5e831dd866dea5f1d2f25d141d7e63391250cf7c775a1c18d1aa1a75
Jul 21 21:13:42.332817 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:42.332778    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2" event={"ID":"247a2a25-4188-4a88-957a-ff6f835d79a7","Type":"ContainerStarted","Data":"bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d"}
Jul 21 21:13:42.333311 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:42.332829    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2" event={"ID":"247a2a25-4188-4a88-957a-ff6f835d79a7","Type":"ContainerStarted","Data":"137973db5e831dd866dea5f1d2f25d141d7e63391250cf7c775a1c18d1aa1a75"}
Jul 21 21:13:42.353601 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:42.353555    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2" podStartSLOduration=2.3535308280000002 podStartE2EDuration="2.353530828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:13:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:13:42.353076141 +0000 UTC m=+2048.373484604" watchObservedRunningTime="2026-07-21 21:13:42.353530828 +0000 UTC m=+2048.373939323"
Jul 21 21:13:44.397941 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:44.397902    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:13:51.309267 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:51.309233    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:51.309708 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:51.309292    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:51.322175 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:51.322146    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:13:51.390104 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:13:51.390069    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:14:07.202738 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:07.202662    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:14:10.740794 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:10.740757    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"]
Jul 21 21:14:10.744073 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:10.744058    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"
Jul 21 21:14:10.746451 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:10.746425    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 21:14:10.746598 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:10.746462    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmths\""
Jul 21 21:14:10.752227 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:10.752179    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"]
Jul 21 21:14:10.816832 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:10.816801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e9791a2-0b4e-4704-bd95-6523f29d8be8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-371611dd-p8xtj\" (UID: \"2e9791a2-0b4e-4704-bd95-6523f29d8be8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"
Jul 21 21:14:10.918204 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:10.918155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e9791a2-0b4e-4704-bd95-6523f29d8be8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-371611dd-p8xtj\" (UID: \"2e9791a2-0b4e-4704-bd95-6523f29d8be8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"
Jul 21 21:14:10.918829 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:10.918799    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e9791a2-0b4e-4704-bd95-6523f29d8be8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-371611dd-p8xtj\" (UID: \"2e9791a2-0b4e-4704-bd95-6523f29d8be8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"
Jul 21 21:14:11.056884 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:11.056854    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"
Jul 21 21:14:11.186393 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:11.186348    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"]
Jul 21 21:14:11.188966 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:14:11.188940    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e9791a2_0b4e_4704_bd95_6523f29d8be8.slice/crio-00abf46eebb8f3a148b4e719654de1307fb12332d82d34f2f82486b9436b60c0 WatchSource:0}: Error finding container 00abf46eebb8f3a148b4e719654de1307fb12332d82d34f2f82486b9436b60c0: Status 404 returned error can't find the container with id 00abf46eebb8f3a148b4e719654de1307fb12332d82d34f2f82486b9436b60c0
Jul 21 21:14:11.480972 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:11.480944    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj" event={"ID":"2e9791a2-0b4e-4704-bd95-6523f29d8be8","Type":"ContainerStarted","Data":"bd9d7185107e6df4787849996ef46ef7da50b496b604bb9af272ac6125f6db46"}
Jul 21 21:14:11.481097 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:11.480993    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj" event={"ID":"2e9791a2-0b4e-4704-bd95-6523f29d8be8","Type":"ContainerStarted","Data":"00abf46eebb8f3a148b4e719654de1307fb12332d82d34f2f82486b9436b60c0"}
Jul 21 21:14:11.522856 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:11.522811    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj" podStartSLOduration=1.522796339 podStartE2EDuration="1.522796339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:14:11.52033775 +0000 UTC m=+2077.540746213" watchObservedRunningTime="2026-07-21 21:14:11.522796339 +0000 UTC m=+2077.543204802"
Jul 21 21:14:12.487260 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:12.487220    2560 generic.go:356] "Generic (PLEG): container finished" podID="2e9791a2-0b4e-4704-bd95-6523f29d8be8" containerID="bd9d7185107e6df4787849996ef46ef7da50b496b604bb9af272ac6125f6db46" exitCode=0
Jul 21 21:14:12.487635 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:12.487267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj" event={"ID":"2e9791a2-0b4e-4704-bd95-6523f29d8be8","Type":"ContainerDied","Data":"bd9d7185107e6df4787849996ef46ef7da50b496b604bb9af272ac6125f6db46"}
Jul 21 21:14:13.635488 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:13.635464    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"
Jul 21 21:14:13.641557 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:13.641535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e9791a2-0b4e-4704-bd95-6523f29d8be8-maas-api-service-ca\") pod \"2e9791a2-0b4e-4704-bd95-6523f29d8be8\" (UID: \"2e9791a2-0b4e-4704-bd95-6523f29d8be8\") "
Jul 21 21:14:13.641884 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:13.641866    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e9791a2-0b4e-4704-bd95-6523f29d8be8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2e9791a2-0b4e-4704-bd95-6523f29d8be8" (UID: "2e9791a2-0b4e-4704-bd95-6523f29d8be8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:14:13.742781 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:13.742688    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e9791a2-0b4e-4704-bd95-6523f29d8be8-maas-api-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:14:14.498140 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:14.498100    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj" event={"ID":"2e9791a2-0b4e-4704-bd95-6523f29d8be8","Type":"ContainerDied","Data":"00abf46eebb8f3a148b4e719654de1307fb12332d82d34f2f82486b9436b60c0"}
Jul 21 21:14:14.498320 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:14.498159    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00abf46eebb8f3a148b4e719654de1307fb12332d82d34f2f82486b9436b60c0"
Jul 21 21:14:14.498320 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:14.498115    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"
Jul 21 21:14:24.804311 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:24.804273    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:14:30.829416 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:30.829380    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"]
Jul 21 21:14:30.834228 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:30.834202    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-371611dd-p8xtj"]
Jul 21 21:14:32.498011 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:32.497966    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e9791a2-0b4e-4704-bd95-6523f29d8be8" path="/var/lib/kubelet/pods/2e9791a2-0b4e-4704-bd95-6523f29d8be8/volumes"
Jul 21 21:14:33.335914 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:33.335873    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:14:34.605735 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:34.605710    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 21:14:34.609324 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:34.609297    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 21:14:34.609459 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:34.609376    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:14:34.613110 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:34.613090    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:14:34.676833 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:34.676807    2560 scope.go:117] "RemoveContainer" containerID="5dce55ebf6202260bc285ad9619cd1740a7f4b74f6c9232aebd3e7457e2f40b6"
Jul 21 21:14:38.173045 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:38.173009    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"]
Jul 21 21:14:53.193354 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.193308    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2" podUID="247a2a25-4188-4a88-957a-ff6f835d79a7" containerName="main" containerID="cri-o://bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d" gracePeriod=45
Jul 21 21:14:53.448040 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.447984    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:14:53.506239 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.506209    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/247a2a25-4188-4a88-957a-ff6f835d79a7-tls-certs\") pod \"247a2a25-4188-4a88-957a-ff6f835d79a7\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") "
Jul 21 21:14:53.506530 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.506253    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-home\") pod \"247a2a25-4188-4a88-957a-ff6f835d79a7\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") "
Jul 21 21:14:53.506530 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.506277    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d265l\" (UniqueName: \"kubernetes.io/projected/247a2a25-4188-4a88-957a-ff6f835d79a7-kube-api-access-d265l\") pod \"247a2a25-4188-4a88-957a-ff6f835d79a7\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") "
Jul 21 21:14:53.506530 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.506336    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-dshm\") pod \"247a2a25-4188-4a88-957a-ff6f835d79a7\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") "
Jul 21 21:14:53.506530 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.506361    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-model-cache\") pod \"247a2a25-4188-4a88-957a-ff6f835d79a7\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") "
Jul 21 21:14:53.506530 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.506387    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-tmp-dir\") pod \"247a2a25-4188-4a88-957a-ff6f835d79a7\" (UID: \"247a2a25-4188-4a88-957a-ff6f835d79a7\") "
Jul 21 21:14:53.506805 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.506576    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-home" (OuterVolumeSpecName: "home") pod "247a2a25-4188-4a88-957a-ff6f835d79a7" (UID: "247a2a25-4188-4a88-957a-ff6f835d79a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:14:53.506805 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.506647    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "247a2a25-4188-4a88-957a-ff6f835d79a7" (UID: "247a2a25-4188-4a88-957a-ff6f835d79a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:14:53.506805 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.506792    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-home\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:14:53.506962 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.506814    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-model-cache\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:14:53.506962 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.506791    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "247a2a25-4188-4a88-957a-ff6f835d79a7" (UID: "247a2a25-4188-4a88-957a-ff6f835d79a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:14:53.508705 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.508675    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/247a2a25-4188-4a88-957a-ff6f835d79a7-kube-api-access-d265l" (OuterVolumeSpecName: "kube-api-access-d265l") pod "247a2a25-4188-4a88-957a-ff6f835d79a7" (UID: "247a2a25-4188-4a88-957a-ff6f835d79a7"). InnerVolumeSpecName "kube-api-access-d265l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:14:53.508705 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.508689    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/247a2a25-4188-4a88-957a-ff6f835d79a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "247a2a25-4188-4a88-957a-ff6f835d79a7" (UID: "247a2a25-4188-4a88-957a-ff6f835d79a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 21:14:53.509206 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.509156    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-dshm" (OuterVolumeSpecName: "dshm") pod "247a2a25-4188-4a88-957a-ff6f835d79a7" (UID: "247a2a25-4188-4a88-957a-ff6f835d79a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:14:53.607673 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.607648    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/247a2a25-4188-4a88-957a-ff6f835d79a7-tls-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:14:53.607673 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.607671    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d265l\" (UniqueName: \"kubernetes.io/projected/247a2a25-4188-4a88-957a-ff6f835d79a7-kube-api-access-d265l\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:14:53.607673 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.607681    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-dshm\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:14:53.607888 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.607690    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/247a2a25-4188-4a88-957a-ff6f835d79a7-tmp-dir\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:14:53.692409 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.692374    2560 generic.go:356] "Generic (PLEG): container finished" podID="247a2a25-4188-4a88-957a-ff6f835d79a7" containerID="bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d" exitCode=0
Jul 21 21:14:53.692573 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.692419    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"
Jul 21 21:14:53.692573 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.692459    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2" event={"ID":"247a2a25-4188-4a88-957a-ff6f835d79a7","Type":"ContainerDied","Data":"bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d"}
Jul 21 21:14:53.692573 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.692505    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2" event={"ID":"247a2a25-4188-4a88-957a-ff6f835d79a7","Type":"ContainerDied","Data":"137973db5e831dd866dea5f1d2f25d141d7e63391250cf7c775a1c18d1aa1a75"}
Jul 21 21:14:53.692573 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.692524    2560 scope.go:117] "RemoveContainer" containerID="bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d"
Jul 21 21:14:53.702338 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.702161    2560 scope.go:117] "RemoveContainer" containerID="bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d"
Jul 21 21:14:53.705732 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:14:53.705700    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d\": container with ID starting with bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d not found: ID does not exist" containerID="bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d"
Jul 21 21:14:53.705851 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.705742    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d"} err="failed to get container status \"bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d\": rpc error: code = NotFound desc = could not find container \"bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d\": container with ID starting with bef2ca01a5a41cb2d1f00e632c06a4fc6225c84358effa91f66c6a308dbaf23d not found: ID does not exist"
Jul 21 21:14:53.724126 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.724097    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"]
Jul 21 21:14:53.726950 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:53.726928    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-371611dd/e2e-lifecycle-model-371611dd-kserve-85fb9566f5-276l2"]
Jul 21 21:14:54.497631 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:14:54.497601    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="247a2a25-4188-4a88-957a-ff6f835d79a7" path="/var/lib/kubelet/pods/247a2a25-4188-4a88-957a-ff6f835d79a7/volumes"
Jul 21 21:15:00.141516 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.141477    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744475-h494c"]
Jul 21 21:15:00.142061 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.142040    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="247a2a25-4188-4a88-957a-ff6f835d79a7" containerName="main"
Jul 21 21:15:00.142139 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.142064    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="247a2a25-4188-4a88-957a-ff6f835d79a7" containerName="main"
Jul 21 21:15:00.142139 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.142074    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e9791a2-0b4e-4704-bd95-6523f29d8be8" containerName="revoke-keys"
Jul 21 21:15:00.142139 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.142081    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e9791a2-0b4e-4704-bd95-6523f29d8be8" containerName="revoke-keys"
Jul 21 21:15:00.142316 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.142232    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="247a2a25-4188-4a88-957a-ff6f835d79a7" containerName="main"
Jul 21 21:15:00.142316 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.142252    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e9791a2-0b4e-4704-bd95-6523f29d8be8" containerName="revoke-keys"
Jul 21 21:15:00.146730 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.146707    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744475-h494c"
Jul 21 21:15:00.149940 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.149921    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmths\""
Jul 21 21:15:00.154516 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.154044    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744475-h494c"]
Jul 21 21:15:00.158335 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.158318    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744475-h494c"
Jul 21 21:15:00.502337 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.502313    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744475-h494c"]
Jul 21 21:15:00.504969 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:15:00.504943    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3be218_9900_4aa5_a2b1_3f6ddca9a0c4.slice/crio-a2df348f4f2bf93f6572bbb3aa520cc607aff6a2773715acb56c38fc0ad8b76a WatchSource:0}: Error finding container a2df348f4f2bf93f6572bbb3aa520cc607aff6a2773715acb56c38fc0ad8b76a: Status 404 returned error can't find the container with id a2df348f4f2bf93f6572bbb3aa520cc607aff6a2773715acb56c38fc0ad8b76a
Jul 21 21:15:00.729465 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:00.729432    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744475-h494c" event={"ID":"0a3be218-9900-4aa5-a2b1-3f6ddca9a0c4","Type":"ContainerStarted","Data":"a2df348f4f2bf93f6572bbb3aa520cc607aff6a2773715acb56c38fc0ad8b76a"}
Jul 21 21:15:01.737610 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:01.737524    2560 generic.go:356] "Generic (PLEG): container finished" podID="0a3be218-9900-4aa5-a2b1-3f6ddca9a0c4" containerID="7ec4b1eb14e7c0f214e1673d94e8c74d12315ca49bfbe6ddda6e24ea9a6672d8" exitCode=0
Jul 21 21:15:01.737959 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:01.737614    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744475-h494c" event={"ID":"0a3be218-9900-4aa5-a2b1-3f6ddca9a0c4","Type":"ContainerDied","Data":"7ec4b1eb14e7c0f214e1673d94e8c74d12315ca49bfbe6ddda6e24ea9a6672d8"}
Jul 21 21:15:02.878804 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:02.878778    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744475-h494c"
Jul 21 21:15:03.749928 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:03.749898    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744475-h494c"
Jul 21 21:15:03.750157 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:03.749950    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744475-h494c" event={"ID":"0a3be218-9900-4aa5-a2b1-3f6ddca9a0c4","Type":"ContainerDied","Data":"a2df348f4f2bf93f6572bbb3aa520cc607aff6a2773715acb56c38fc0ad8b76a"}
Jul 21 21:15:03.750157 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:03.750009    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2df348f4f2bf93f6572bbb3aa520cc607aff6a2773715acb56c38fc0ad8b76a"
Jul 21 21:15:21.866794 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:21.866757    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"]
Jul 21 21:15:21.867256 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:21.866996    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy" containerID="cri-o://e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35" gracePeriod=30
Jul 21 21:15:22.340538 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:22.340501    2560 patch_prober.go:28] interesting pod/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 21:15:22.340708 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:22.340563    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 21:15:25.214434 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:25.214398    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:15:27.126140 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.126115    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:15:27.219628 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.219534    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba76284c-ca99-4784-9500-884a2bbf6f68-istiod-ca-cert\") pod \"ba76284c-ca99-4784-9500-884a2bbf6f68\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") "
Jul 21 21:15:27.219628 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.219589    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-token\") pod \"ba76284c-ca99-4784-9500-884a2bbf6f68\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") "
Jul 21 21:15:27.219628 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.219616    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-certs\") pod \"ba76284c-ca99-4784-9500-884a2bbf6f68\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") "
Jul 21 21:15:27.219914 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.219633    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-envoy\") pod \"ba76284c-ca99-4784-9500-884a2bbf6f68\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") "
Jul 21 21:15:27.219914 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.219850    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-socket\") pod \"ba76284c-ca99-4784-9500-884a2bbf6f68\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") "
Jul 21 21:15:27.219914 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.219906    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-data\") pod \"ba76284c-ca99-4784-9500-884a2bbf6f68\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") "
Jul 21 21:15:27.220068 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.219932    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-credential-socket\") pod \"ba76284c-ca99-4784-9500-884a2bbf6f68\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") "
Jul 21 21:15:27.220068 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.219963    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-podinfo\") pod \"ba76284c-ca99-4784-9500-884a2bbf6f68\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") "
Jul 21 21:15:27.220068 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.219983    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba76284c-ca99-4784-9500-884a2bbf6f68" (UID: "ba76284c-ca99-4784-9500-884a2bbf6f68"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:15:27.220068 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.220035    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmc7c\" (UniqueName: \"kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-kube-api-access-bmc7c\") pod \"ba76284c-ca99-4784-9500-884a2bbf6f68\" (UID: \"ba76284c-ca99-4784-9500-884a2bbf6f68\") "
Jul 21 21:15:27.220068 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.220042    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba76284c-ca99-4784-9500-884a2bbf6f68-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba76284c-ca99-4784-9500-884a2bbf6f68" (UID: "ba76284c-ca99-4784-9500-884a2bbf6f68"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:15:27.220357 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.220136    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba76284c-ca99-4784-9500-884a2bbf6f68" (UID: "ba76284c-ca99-4784-9500-884a2bbf6f68"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:15:27.220357 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.220256    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba76284c-ca99-4784-9500-884a2bbf6f68" (UID: "ba76284c-ca99-4784-9500-884a2bbf6f68"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:15:27.220470 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.220451    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:15:27.220526 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.220476    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:15:27.220526 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.220491    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:15:27.220526 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.220506    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba76284c-ca99-4784-9500-884a2bbf6f68-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:15:27.221146 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.221117    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba76284c-ca99-4784-9500-884a2bbf6f68" (UID: "ba76284c-ca99-4784-9500-884a2bbf6f68"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:15:27.221915 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.221888    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba76284c-ca99-4784-9500-884a2bbf6f68" (UID: "ba76284c-ca99-4784-9500-884a2bbf6f68"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:15:27.222238 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.222208    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba76284c-ca99-4784-9500-884a2bbf6f68" (UID: "ba76284c-ca99-4784-9500-884a2bbf6f68"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:15:27.222344 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.222243    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba76284c-ca99-4784-9500-884a2bbf6f68" (UID: "ba76284c-ca99-4784-9500-884a2bbf6f68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:15:27.222476 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.222457    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-kube-api-access-bmc7c" (OuterVolumeSpecName: "kube-api-access-bmc7c") pod "ba76284c-ca99-4784-9500-884a2bbf6f68" (UID: "ba76284c-ca99-4784-9500-884a2bbf6f68"). InnerVolumeSpecName "kube-api-access-bmc7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:15:27.321478 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.321439    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:15:27.321478 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.321471    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:15:27.321478 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.321480    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:15:27.321478 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.321488    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba76284c-ca99-4784-9500-884a2bbf6f68-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:15:27.321739 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.321497    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmc7c\" (UniqueName: \"kubernetes.io/projected/ba76284c-ca99-4784-9500-884a2bbf6f68-kube-api-access-bmc7c\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:15:27.868331 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.868297    2560 generic.go:356] "Generic (PLEG): container finished" podID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerID="e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35" exitCode=0
Jul 21 21:15:27.868503 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.868352    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"
Jul 21 21:15:27.868503 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.868385    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" event={"ID":"ba76284c-ca99-4784-9500-884a2bbf6f68","Type":"ContainerDied","Data":"e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35"}
Jul 21 21:15:27.868503 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.868445    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs" event={"ID":"ba76284c-ca99-4784-9500-884a2bbf6f68","Type":"ContainerDied","Data":"b2351e96befb919b692227be84a60a5414b5d4a5f82f8d298986cde078c0a7bf"}
Jul 21 21:15:27.868503 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.868476    2560 scope.go:117] "RemoveContainer" containerID="e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35"
Jul 21 21:15:27.877969 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.877954    2560 scope.go:117] "RemoveContainer" containerID="325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d"
Jul 21 21:15:27.885935 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.885916    2560 scope.go:117] "RemoveContainer" containerID="e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35"
Jul 21 21:15:27.886175 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:15:27.886156    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35\": container with ID starting with e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35 not found: ID does not exist" containerID="e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35"
Jul 21 21:15:27.886242 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.886198    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35"} err="failed to get container status \"e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35\": rpc error: code = NotFound desc = could not find container \"e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35\": container with ID starting with e79c9a849b061984873f917a02f037c3830d1892ea4ff4aab3be324812efee35 not found: ID does not exist"
Jul 21 21:15:27.886242 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.886216    2560 scope.go:117] "RemoveContainer" containerID="325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d"
Jul 21 21:15:27.886461 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:15:27.886440    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d\": container with ID starting with 325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d not found: ID does not exist" containerID="325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d"
Jul 21 21:15:27.886517 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.886470    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d"} err="failed to get container status \"325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d\": rpc error: code = NotFound desc = could not find container \"325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d\": container with ID starting with 325636c072246752b7c0147f9dcf0021730307c31c85f81588320d4d25f0f08d not found: ID does not exist"
Jul 21 21:15:27.889861 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.889841    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"]
Jul 21 21:15:27.894031 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:27.894011    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-371611dd-openshift-default-5bc6c4dc5-4v9gs"]
Jul 21 21:15:28.497414 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:28.497380    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" path="/var/lib/kubelet/pods/ba76284c-ca99-4784-9500-884a2bbf6f68/volumes"
Jul 21 21:15:34.696257 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:34.696228    2560 scope.go:117] "RemoveContainer" containerID="17a0419ed2960e438a39d239a49582d67b0c9707f5255da8ced40f8dbc194766"
Jul 21 21:15:35.396132 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:15:35.396096    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:16:18.041631 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.041600    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"]
Jul 21 21:16:18.042107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.041975    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy"
Jul 21 21:16:18.042107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.041986    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy"
Jul 21 21:16:18.042107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.041998    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy"
Jul 21 21:16:18.042107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.042003    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy"
Jul 21 21:16:18.042107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.042013    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3be218-9900-4aa5-a2b1-3f6ddca9a0c4" containerName="cleanup"
Jul 21 21:16:18.042107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.042019    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3be218-9900-4aa5-a2b1-3f6ddca9a0c4" containerName="cleanup"
Jul 21 21:16:18.042107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.042094    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy"
Jul 21 21:16:18.042107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.042101    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a3be218-9900-4aa5-a2b1-3f6ddca9a0c4" containerName="cleanup"
Jul 21 21:16:18.045164 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.045146    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.047678 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.047660    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-85e235-openshift-default-dockercfg-hw8ts\""
Jul 21 21:16:18.065512 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.065487    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"]
Jul 21 21:16:18.074831 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.074804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-data\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.074959 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.074837    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-token\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.074959 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.074863    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-credential-socket\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.074959 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.074884    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-certs\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.075148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.074998    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istiod-ca-cert\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.075148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.075094    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf4pw\" (UniqueName: \"kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-kube-api-access-lf4pw\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.075148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.075136    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-socket\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.075323 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.075171    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-podinfo\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.075323 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.075246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-envoy\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.175773 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.175731    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-socket\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.175929 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.175787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-podinfo\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.175929 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.175823    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-envoy\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.175929 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.175855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-data\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.175929 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.175884    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-token\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.175929 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.175920    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-credential-socket\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.176257 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.175949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-certs\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.176257 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.176028    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istiod-ca-cert\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.176257 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.176102    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf4pw\" (UniqueName: \"kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-kube-api-access-lf4pw\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.176257 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.176150    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-socket\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.176473 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.176273    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-data\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.176716 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.176696    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-credential-socket\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.177034 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.176996    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-certs\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.177165 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.177042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istiod-ca-cert\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.178263 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.178241    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-envoy\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.178505 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.178485    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-podinfo\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.189381 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.189355    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf4pw\" (UniqueName: \"kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-kube-api-access-lf4pw\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.190441 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.190416    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-token\") pod \"e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") " pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.355327 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.355292    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:18.490801 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.490774    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"]
Jul 21 21:16:18.492533 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:16:18.492502    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70863b2e_f782_4bbf_9f90_d7ce2a5200b7.slice/crio-d433da8561664e7a9b840518ae82755bb66650b1424b78ef4bc0cdcb5157fc3d WatchSource:0}: Error finding container d433da8561664e7a9b840518ae82755bb66650b1424b78ef4bc0cdcb5157fc3d: Status 404 returned error can't find the container with id d433da8561664e7a9b840518ae82755bb66650b1424b78ef4bc0cdcb5157fc3d
Jul 21 21:16:18.494740 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.494701    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:18.494856 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.494771    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:18.494856 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:18.494803    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:19.128041 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:19.128001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" event={"ID":"70863b2e-f782-4bbf-9f90-d7ce2a5200b7","Type":"ContainerStarted","Data":"d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210"}
Jul 21 21:16:19.128444 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:19.128060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" event={"ID":"70863b2e-f782-4bbf-9f90-d7ce2a5200b7","Type":"ContainerStarted","Data":"d433da8561664e7a9b840518ae82755bb66650b1424b78ef4bc0cdcb5157fc3d"}
Jul 21 21:16:19.152340 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:19.152283    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" podStartSLOduration=1.152268907 podStartE2EDuration="1.152268907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:16:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:16:19.149697031 +0000 UTC m=+2205.170105529" watchObservedRunningTime="2026-07-21 21:16:19.152268907 +0000 UTC m=+2205.172677369"
Jul 21 21:16:19.355862 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:19.355825    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:19.361231 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:19.361179    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:20.133205 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:20.133150    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:20.133994 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:20.133969    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:26.301248 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.301144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:16:26.379776 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.379450    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"]
Jul 21 21:16:26.380860 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.380835    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba76284c-ca99-4784-9500-884a2bbf6f68" containerName="istio-proxy"
Jul 21 21:16:26.386750 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.386725    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.389357 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.389326    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c15522-openshift-default-dockercfg-x54hn\""
Jul 21 21:16:26.393326 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.393303    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"]
Jul 21 21:16:26.449939 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.449906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-credential-socket\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.450097 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.449950    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg5bk\" (UniqueName: \"kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-kube-api-access-wg5bk\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.450097 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.449984    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-podinfo\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.450097 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.450025    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-envoy\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.450097 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.450041    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istiod-ca-cert\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.450097 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.450066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-data\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.450097 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.450083    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-token\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.450336 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.450197    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-socket\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.450336 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.450229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-certs\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.550681 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.550649    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-podinfo\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.550859 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.550711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-envoy\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.550859 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.550745    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istiod-ca-cert\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.550859 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.550809    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-data\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.550859 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.550842    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-token\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.551017 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.550896    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-socket\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.551074 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.551037    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-certs\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.551129 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.551116    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-credential-socket\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.551211 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.551166    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg5bk\" (UniqueName: \"kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-kube-api-access-wg5bk\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.551345 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.551280    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-data\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.551528 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.551464    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-certs\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.551624 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.551509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-credential-socket\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.551678 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.551655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istiod-ca-cert\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.551812 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.551793    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-socket\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.553092 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.553070    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-envoy\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.553233 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.553216    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-podinfo\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.559207 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.559163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-token\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.559517 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.559499    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg5bk\" (UniqueName: \"kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-kube-api-access-wg5bk\") pod \"e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") " pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.701419 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.701377    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:26.846710 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.846671    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"]
Jul 21 21:16:26.849740 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:16:26.849701    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a934e2_3374_4e2e_a2ac_04db6d5090f7.slice/crio-dcfddf6a5fb606baac92ea1e33a48df3df4c8042a498839e5fb8db8351d97088 WatchSource:0}: Error finding container dcfddf6a5fb606baac92ea1e33a48df3df4c8042a498839e5fb8db8351d97088: Status 404 returned error can't find the container with id dcfddf6a5fb606baac92ea1e33a48df3df4c8042a498839e5fb8db8351d97088
Jul 21 21:16:26.851787 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.851756    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:26.851862 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.851839    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:26.851899 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:26.851868    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:27.171364 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:27.171275    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" event={"ID":"56a934e2-3374-4e2e-a2ac-04db6d5090f7","Type":"ContainerStarted","Data":"76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8"}
Jul 21 21:16:27.171364 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:27.171329    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" event={"ID":"56a934e2-3374-4e2e-a2ac-04db6d5090f7","Type":"ContainerStarted","Data":"dcfddf6a5fb606baac92ea1e33a48df3df4c8042a498839e5fb8db8351d97088"}
Jul 21 21:16:27.192894 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:27.192841    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" podStartSLOduration=1.192827849 podStartE2EDuration="1.192827849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:16:27.190629965 +0000 UTC m=+2213.211038429" watchObservedRunningTime="2026-07-21 21:16:27.192827849 +0000 UTC m=+2213.213236312"
Jul 21 21:16:27.701717 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:27.701680    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:27.706771 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:27.706744    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:28.176056 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:28.176025    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:28.177174 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:28.177155    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:34.726463 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:34.726432    2560 scope.go:117] "RemoveContainer" containerID="e2ac1f02f340d92a0b4456d7e98ea40b28a798a49f87179e90f7626a4c607389"
Jul 21 21:16:34.734526 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:34.734508    2560 scope.go:117] "RemoveContainer" containerID="abba51e5c2c00f7785bfbcf59538f920db00c83fe23cde58a9f67fec5214f171"
Jul 21 21:16:35.134514 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:35.134482    2560 patch_prober.go:28] interesting pod/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 21 21:16:35.134686 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:35.134540    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 21 21:16:35.213360 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:35.213330    2560 generic.go:356] "Generic (PLEG): container finished" podID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerID="d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210" exitCode=0
Jul 21 21:16:35.213529 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:35.213401    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" event={"ID":"70863b2e-f782-4bbf-9f90-d7ce2a5200b7","Type":"ContainerDied","Data":"d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210"}
Jul 21 21:16:35.213829 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:35.213814    2560 scope.go:117] "RemoveContainer" containerID="d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210"
Jul 21 21:16:35.214857 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:35.214827    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:35.214921 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:35.214898    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:35.214961 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:35.214930    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:35.598937 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:35.598892    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:16:36.220117 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:36.220081    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" event={"ID":"70863b2e-f782-4bbf-9f90-d7ce2a5200b7","Type":"ContainerStarted","Data":"4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd"}
Jul 21 21:16:36.360590 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:36.360557    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:36.361004 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:36.360918    2560 patch_prober.go:28] interesting pod/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 21 21:16:36.361179 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:36.361157    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 21 21:16:37.356599 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:37.356558    2560 patch_prober.go:28] interesting pod/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 21 21:16:37.357217 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:37.357162    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 21 21:16:38.356794 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:38.356742    2560 patch_prober.go:28] interesting pod/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 21 21:16:38.357334 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:38.356829    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 21 21:16:39.356049 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:39.356001    2560 patch_prober.go:28] interesting pod/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 21 21:16:39.356280 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:39.356085    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 21 21:16:40.360547 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:40.360515    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:40.360962 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:40.360896    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:40.361537 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:40.361512    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:16:43.177864 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:43.177832    2560 patch_prober.go:28] interesting pod/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 21:16:43.178203 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:43.177885    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 21:16:43.264148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:43.264113    2560 generic.go:356] "Generic (PLEG): container finished" podID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerID="76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8" exitCode=0
Jul 21 21:16:43.264321 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:43.264201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" event={"ID":"56a934e2-3374-4e2e-a2ac-04db6d5090f7","Type":"ContainerDied","Data":"76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8"}
Jul 21 21:16:43.264650 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:43.264634    2560 scope.go:117] "RemoveContainer" containerID="76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8"
Jul 21 21:16:43.265731 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:43.265698    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:43.265833 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:43.265783    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:43.265898 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:43.265832    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:16:44.271267 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:44.271230    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" event={"ID":"56a934e2-3374-4e2e-a2ac-04db6d5090f7","Type":"ContainerStarted","Data":"11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a"}
Jul 21 21:16:44.701971 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:44.701930    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:44.702234 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:44.702211    2560 patch_prober.go:28] interesting pod/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 21:16:44.702284 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:44.702261    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 21:16:45.702712 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:45.702677    2560 patch_prober.go:28] interesting pod/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 21:16:45.703091 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:45.702732    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 21:16:46.702683 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:46.702640    2560 patch_prober.go:28] interesting pod/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 21:16:46.702883 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:46.702701    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 21:16:47.702454 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:47.702410    2560 patch_prober.go:28] interesting pod/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 21 21:16:47.702634 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:47.702485    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 21 21:16:48.705419 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:48.705388    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:48.705954 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:48.705648    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:16:48.706246 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:16:48.706228    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:17:00.802710 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.802637    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"]
Jul 21 21:17:00.807449 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.807426    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:00.810064 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.810035    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-85e235\"/\"kube-root-ca.crt\""
Jul 21 21:17:00.810064 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.810039    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-85e235\"/\"openshift-service-ca.crt\""
Jul 21 21:17:00.810867 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.810849    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-85e235\"/\"test-model-85e235-kserve-self-signed-certs\""
Jul 21 21:17:00.810996 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.810978    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-85e235\"/\"default-dockercfg-4p7zw\""
Jul 21 21:17:00.815926 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.815897    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"]
Jul 21 21:17:00.900022 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.899990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-model-cache\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:00.900198 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.900038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-home\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:00.900198 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.900064    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tmp-dir\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:00.900198 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.900084    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xclkj\" (UniqueName: \"kubernetes.io/projected/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-kube-api-access-xclkj\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:00.900198 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.900102    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-dshm\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:00.900198 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:00.900157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tls-certs\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.000703 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.000673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-model-cache\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.000852 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.000717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-home\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.000852 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.000736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tmp-dir\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.000852 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.000756    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xclkj\" (UniqueName: \"kubernetes.io/projected/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-kube-api-access-xclkj\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.000852 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.000780    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-dshm\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.000852 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.000812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tls-certs\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.001127 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.001107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-home\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.001217 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.001149    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-model-cache\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.001288 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.001219    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tmp-dir\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.003134 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.003102    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-dshm\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.003325 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.003307    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tls-certs\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.008923 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.008900    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xclkj\" (UniqueName: \"kubernetes.io/projected/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-kube-api-access-xclkj\") pod \"test-model-85e235-kserve-7c9d89c865-zx464\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") " pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.118029 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.117995    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:01.252631 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.252603    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"]
Jul 21 21:17:01.254115 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:17:01.254091    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ffb3042_bf5a_4c05_90b2_a3bdab67e9b1.slice/crio-51692ad80ba354d1121a8d93be179ff9ce184ca247238e6c1bc3088dd122c779 WatchSource:0}: Error finding container 51692ad80ba354d1121a8d93be179ff9ce184ca247238e6c1bc3088dd122c779: Status 404 returned error can't find the container with id 51692ad80ba354d1121a8d93be179ff9ce184ca247238e6c1bc3088dd122c779
Jul 21 21:17:01.353606 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.353562    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464" event={"ID":"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1","Type":"ContainerStarted","Data":"a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037"}
Jul 21 21:17:01.353606 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.353601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464" event={"ID":"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1","Type":"ContainerStarted","Data":"51692ad80ba354d1121a8d93be179ff9ce184ca247238e6c1bc3088dd122c779"}
Jul 21 21:17:01.372761 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:01.372663    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464" podStartSLOduration=1.372649136 podStartE2EDuration="1.372649136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:17:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:17:01.372322314 +0000 UTC m=+2247.392730775" watchObservedRunningTime="2026-07-21 21:17:01.372649136 +0000 UTC m=+2247.393057620"
Jul 21 21:17:04.701866 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:04.701833    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:17:11.118146 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:11.118111    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:11.118583 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:11.118265    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:11.130939 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:11.130918    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:11.417168 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:11.417090    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:17:16.192829 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:16.192795    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:17:36.108703 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:17:36.108667    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:18:09.321461 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:09.321428    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"]
Jul 21 21:18:14.593657 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:14.593624    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:18:24.341771 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.341701    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464" podUID="7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" containerName="main" containerID="cri-o://a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037" gracePeriod=45
Jul 21 21:18:24.602134 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.602079    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:18:24.668695 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.668667    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tls-certs\") pod \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") "
Jul 21 21:18:24.668815 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.668704    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-dshm\") pod \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") "
Jul 21 21:18:24.668815 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.668750    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xclkj\" (UniqueName: \"kubernetes.io/projected/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-kube-api-access-xclkj\") pod \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") "
Jul 21 21:18:24.668886 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.668848    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-model-cache\") pod \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") "
Jul 21 21:18:24.668886 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.668877    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-home\") pod \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") "
Jul 21 21:18:24.668968 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.668959    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tmp-dir\") pod \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\" (UID: \"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1\") "
Jul 21 21:18:24.669204 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.669135    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-model-cache" (OuterVolumeSpecName: "model-cache") pod "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" (UID: "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:24.669324 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.669249    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-home" (OuterVolumeSpecName: "home") pod "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" (UID: "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:24.669324 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.669274    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" (UID: "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:24.669509 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.669366    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tmp-dir\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:24.669509 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.669385    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-model-cache\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:24.669509 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.669394    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-home\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:24.670986 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.670966    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" (UID: "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 21:18:24.671227 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.671212    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-dshm" (OuterVolumeSpecName: "dshm") pod "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" (UID: "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:24.671304 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.671245    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-kube-api-access-xclkj" (OuterVolumeSpecName: "kube-api-access-xclkj") pod "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" (UID: "7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1"). InnerVolumeSpecName "kube-api-access-xclkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:18:24.770299 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.770268    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-tls-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:24.770299 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.770292    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-dshm\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:24.770299 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.770302    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xclkj\" (UniqueName: \"kubernetes.io/projected/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1-kube-api-access-xclkj\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:24.780455 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.780429    2560 generic.go:356] "Generic (PLEG): container finished" podID="7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" containerID="a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037" exitCode=0
Jul 21 21:18:24.780546 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.780475    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"
Jul 21 21:18:24.780546 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.780517    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464" event={"ID":"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1","Type":"ContainerDied","Data":"a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037"}
Jul 21 21:18:24.780628 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.780567    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464" event={"ID":"7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1","Type":"ContainerDied","Data":"51692ad80ba354d1121a8d93be179ff9ce184ca247238e6c1bc3088dd122c779"}
Jul 21 21:18:24.780628 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.780589    2560 scope.go:117] "RemoveContainer" containerID="a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037"
Jul 21 21:18:24.789448 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.789430    2560 scope.go:117] "RemoveContainer" containerID="a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037"
Jul 21 21:18:24.789713 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:18:24.789696    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037\": container with ID starting with a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037 not found: ID does not exist" containerID="a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037"
Jul 21 21:18:24.789759 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.789722    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037"} err="failed to get container status \"a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037\": rpc error: code = NotFound desc = could not find container \"a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037\": container with ID starting with a9e2d6d28a992d7791598112e87104056367369a006b04f28bebe649a6997037 not found: ID does not exist"
Jul 21 21:18:24.803304 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.803282    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"]
Jul 21 21:18:24.807935 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:24.807913    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-85e235/test-model-85e235-kserve-7c9d89c865-zx464"]
Jul 21 21:18:26.497562 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:26.497518    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" path="/var/lib/kubelet/pods/7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1/volumes"
Jul 21 21:18:29.991219 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:29.991114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:18:32.253493 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:32.253454    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"]
Jul 21 21:18:32.253859 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:32.253707    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy" containerID="cri-o://4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd" gracePeriod=30
Jul 21 21:18:34.763015 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:34.762972    2560 scope.go:117] "RemoveContainer" containerID="cfb99e698e353515f29f897b2884b1e90dbcb8e844e24c9442760ee5865b7a41"
Jul 21 21:18:37.510952 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.510930    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:18:37.586089 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586061    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-credential-socket\") pod \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") "
Jul 21 21:18:37.586269 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586119    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-socket\") pod \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") "
Jul 21 21:18:37.586269 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586153    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-certs\") pod \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") "
Jul 21 21:18:37.586269 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586174    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-podinfo\") pod \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") "
Jul 21 21:18:37.586269 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586228    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istiod-ca-cert\") pod \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") "
Jul 21 21:18:37.586269 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586266    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-envoy\") pod \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") "
Jul 21 21:18:37.586541 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586296    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-token\") pod \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") "
Jul 21 21:18:37.586541 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586377    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-data\") pod \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") "
Jul 21 21:18:37.586541 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586405    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf4pw\" (UniqueName: \"kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-kube-api-access-lf4pw\") pod \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\" (UID: \"70863b2e-f782-4bbf-9f90-d7ce2a5200b7\") "
Jul 21 21:18:37.586541 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586402    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70863b2e-f782-4bbf-9f90-d7ce2a5200b7" (UID: "70863b2e-f782-4bbf-9f90-d7ce2a5200b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:37.586541 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586487    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70863b2e-f782-4bbf-9f90-d7ce2a5200b7" (UID: "70863b2e-f782-4bbf-9f90-d7ce2a5200b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:37.586541 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586508    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70863b2e-f782-4bbf-9f90-d7ce2a5200b7" (UID: "70863b2e-f782-4bbf-9f90-d7ce2a5200b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:37.586851 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586744    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:37.586851 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586752    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70863b2e-f782-4bbf-9f90-d7ce2a5200b7" (UID: "70863b2e-f782-4bbf-9f90-d7ce2a5200b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:18:37.586851 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586764    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:37.586851 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.586781    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:37.587226 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.587205    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "70863b2e-f782-4bbf-9f90-d7ce2a5200b7" (UID: "70863b2e-f782-4bbf-9f90-d7ce2a5200b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:37.588585 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.588562    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-kube-api-access-lf4pw" (OuterVolumeSpecName: "kube-api-access-lf4pw") pod "70863b2e-f782-4bbf-9f90-d7ce2a5200b7" (UID: "70863b2e-f782-4bbf-9f90-d7ce2a5200b7"). InnerVolumeSpecName "kube-api-access-lf4pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:18:37.588585 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.588573    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70863b2e-f782-4bbf-9f90-d7ce2a5200b7" (UID: "70863b2e-f782-4bbf-9f90-d7ce2a5200b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:37.588779 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.588764    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70863b2e-f782-4bbf-9f90-d7ce2a5200b7" (UID: "70863b2e-f782-4bbf-9f90-d7ce2a5200b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:18:37.588839 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.588797    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "70863b2e-f782-4bbf-9f90-d7ce2a5200b7" (UID: "70863b2e-f782-4bbf-9f90-d7ce2a5200b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:18:37.687240 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.687216    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:37.687240 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.687236    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:37.687380 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.687246    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:37.687380 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.687253    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:37.687380 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.687262    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:37.687380 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.687272    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf4pw\" (UniqueName: \"kubernetes.io/projected/70863b2e-f782-4bbf-9f90-d7ce2a5200b7-kube-api-access-lf4pw\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:37.849643 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.849551    2560 generic.go:356] "Generic (PLEG): container finished" podID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerID="4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd" exitCode=0
Jul 21 21:18:37.849643 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.849596    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"
Jul 21 21:18:37.849643 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.849620    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" event={"ID":"70863b2e-f782-4bbf-9f90-d7ce2a5200b7","Type":"ContainerDied","Data":"4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd"}
Jul 21 21:18:37.849853 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.849662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg" event={"ID":"70863b2e-f782-4bbf-9f90-d7ce2a5200b7","Type":"ContainerDied","Data":"d433da8561664e7a9b840518ae82755bb66650b1424b78ef4bc0cdcb5157fc3d"}
Jul 21 21:18:37.849853 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.849683    2560 scope.go:117] "RemoveContainer" containerID="4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd"
Jul 21 21:18:37.858547 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.858526    2560 scope.go:117] "RemoveContainer" containerID="d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210"
Jul 21 21:18:37.866404 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.866383    2560 scope.go:117] "RemoveContainer" containerID="4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd"
Jul 21 21:18:37.866711 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:18:37.866686    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd\": container with ID starting with 4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd not found: ID does not exist" containerID="4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd"
Jul 21 21:18:37.866777 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.866720    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd"} err="failed to get container status \"4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd\": rpc error: code = NotFound desc = could not find container \"4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd\": container with ID starting with 4676af725b8a834ee0f53fc68d0bd04571709bf33f73ba4748259aac1c1876cd not found: ID does not exist"
Jul 21 21:18:37.866777 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.866738    2560 scope.go:117] "RemoveContainer" containerID="d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210"
Jul 21 21:18:37.866962 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:18:37.866947    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210\": container with ID starting with d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210 not found: ID does not exist" containerID="d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210"
Jul 21 21:18:37.867005 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.866965    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210"} err="failed to get container status \"d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210\": rpc error: code = NotFound desc = could not find container \"d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210\": container with ID starting with d0aa81c102f8735c73673f44bd2e6e6396cc430894dc7571023c36153e1fd210 not found: ID does not exist"
Jul 21 21:18:37.873138 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.872392    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"]
Jul 21 21:18:37.880862 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:37.880838    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-85e235-openshift-default-58fb674997-tj7qg"]
Jul 21 21:18:38.497755 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:38.497717    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" path="/var/lib/kubelet/pods/70863b2e-f782-4bbf-9f90-d7ce2a5200b7/volumes"
Jul 21 21:18:45.899846 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:45.899813    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:18:54.499114 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:54.499086    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"]
Jul 21 21:18:54.499505 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:54.499310    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy" containerID="cri-o://11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a" gracePeriod=30
Jul 21 21:18:59.757962 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.757905    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:18:59.787774 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.787747    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-envoy\") pod \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") "
Jul 21 21:18:59.787937 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.787791    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-podinfo\") pod \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") "
Jul 21 21:18:59.787937 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.787813    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-certs\") pod \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") "
Jul 21 21:18:59.787937 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.787830    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-data\") pod \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") "
Jul 21 21:18:59.788107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.787947    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-token\") pod \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") "
Jul 21 21:18:59.788107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788009    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-credential-socket\") pod \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") "
Jul 21 21:18:59.788107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788043    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istiod-ca-cert\") pod \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") "
Jul 21 21:18:59.788314 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788105    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg5bk\" (UniqueName: \"kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-kube-api-access-wg5bk\") pod \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") "
Jul 21 21:18:59.788314 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788109    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56a934e2-3374-4e2e-a2ac-04db6d5090f7" (UID: "56a934e2-3374-4e2e-a2ac-04db6d5090f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:59.788314 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788176    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-socket\") pod \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\" (UID: \"56a934e2-3374-4e2e-a2ac-04db6d5090f7\") "
Jul 21 21:18:59.788483 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788312    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56a934e2-3374-4e2e-a2ac-04db6d5090f7" (UID: "56a934e2-3374-4e2e-a2ac-04db6d5090f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:59.788483 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788387    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56a934e2-3374-4e2e-a2ac-04db6d5090f7" (UID: "56a934e2-3374-4e2e-a2ac-04db6d5090f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:18:59.788669 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788637    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56a934e2-3374-4e2e-a2ac-04db6d5090f7" (UID: "56a934e2-3374-4e2e-a2ac-04db6d5090f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:59.788910 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788883    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:59.788987 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788915    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:59.788987 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788929    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:59.788987 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788944    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:59.788987 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.788979    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "56a934e2-3374-4e2e-a2ac-04db6d5090f7" (UID: "56a934e2-3374-4e2e-a2ac-04db6d5090f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:59.790124 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.790102    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56a934e2-3374-4e2e-a2ac-04db6d5090f7" (UID: "56a934e2-3374-4e2e-a2ac-04db6d5090f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:18:59.790789 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.790684    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "56a934e2-3374-4e2e-a2ac-04db6d5090f7" (UID: "56a934e2-3374-4e2e-a2ac-04db6d5090f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:18:59.790789 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.790759    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56a934e2-3374-4e2e-a2ac-04db6d5090f7" (UID: "56a934e2-3374-4e2e-a2ac-04db6d5090f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:18:59.790789 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.790769    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-kube-api-access-wg5bk" (OuterVolumeSpecName: "kube-api-access-wg5bk") pod "56a934e2-3374-4e2e-a2ac-04db6d5090f7" (UID: "56a934e2-3374-4e2e-a2ac-04db6d5090f7"). InnerVolumeSpecName "kube-api-access-wg5bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:18:59.889842 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.889809    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:59.889842 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.889834    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:59.889842 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.889845    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg5bk\" (UniqueName: \"kubernetes.io/projected/56a934e2-3374-4e2e-a2ac-04db6d5090f7-kube-api-access-wg5bk\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:59.890064 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.889855    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:59.890064 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.889863    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a934e2-3374-4e2e-a2ac-04db6d5090f7-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:18:59.954112 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.954081    2560 generic.go:356] "Generic (PLEG): container finished" podID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerID="11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a" exitCode=0
Jul 21 21:18:59.954312 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.954119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" event={"ID":"56a934e2-3374-4e2e-a2ac-04db6d5090f7","Type":"ContainerDied","Data":"11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a"}
Jul 21 21:18:59.954312 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.954128    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"
Jul 21 21:18:59.954312 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.954160    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4" event={"ID":"56a934e2-3374-4e2e-a2ac-04db6d5090f7","Type":"ContainerDied","Data":"dcfddf6a5fb606baac92ea1e33a48df3df4c8042a498839e5fb8db8351d97088"}
Jul 21 21:18:59.954312 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.954180    2560 scope.go:117] "RemoveContainer" containerID="11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a"
Jul 21 21:18:59.963258 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.963240    2560 scope.go:117] "RemoveContainer" containerID="76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8"
Jul 21 21:18:59.971073 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.971053    2560 scope.go:117] "RemoveContainer" containerID="11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a"
Jul 21 21:18:59.971344 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:18:59.971321    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a\": container with ID starting with 11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a not found: ID does not exist" containerID="11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a"
Jul 21 21:18:59.971387 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.971353    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a"} err="failed to get container status \"11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a\": rpc error: code = NotFound desc = could not find container \"11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a\": container with ID starting with 11660dde04102a6370cb99b30b70e9a83806daa1a00dd4f63d6b6ee65d68ea1a not found: ID does not exist"
Jul 21 21:18:59.971387 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.971378    2560 scope.go:117] "RemoveContainer" containerID="76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8"
Jul 21 21:18:59.971613 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:18:59.971595    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8\": container with ID starting with 76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8 not found: ID does not exist" containerID="76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8"
Jul 21 21:18:59.971650 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.971621    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8"} err="failed to get container status \"76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8\": rpc error: code = NotFound desc = could not find container \"76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8\": container with ID starting with 76235502bd7ec06e618d1062eca8f2d65863676a91a9131b77bc015fea932ba8 not found: ID does not exist"
Jul 21 21:18:59.982378 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.982350    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"]
Jul 21 21:18:59.986623 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:18:59.986602    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c15522-openshift-default-79b5c67d79-2b8h4"]
Jul 21 21:19:00.497850 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:00.497816    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" path="/var/lib/kubelet/pods/56a934e2-3374-4e2e-a2ac-04db6d5090f7/volumes"
Jul 21 21:19:03.735176 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735145    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"]
Jul 21 21:19:03.735586 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735571    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy"
Jul 21 21:19:03.735626 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735588    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy"
Jul 21 21:19:03.735626 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735605    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" containerName="main"
Jul 21 21:19:03.735626 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735611    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" containerName="main"
Jul 21 21:19:03.735626 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735621    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy"
Jul 21 21:19:03.735747 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735627    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy"
Jul 21 21:19:03.735747 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735636    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy"
Jul 21 21:19:03.735747 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735641    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy"
Jul 21 21:19:03.735747 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735650    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy"
Jul 21 21:19:03.735747 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735655    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy"
Jul 21 21:19:03.735747 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735718    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy"
Jul 21 21:19:03.735747 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735727    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy"
Jul 21 21:19:03.735747 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735733    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a934e2-3374-4e2e-a2ac-04db6d5090f7" containerName="istio-proxy"
Jul 21 21:19:03.735747 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735738    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ffb3042-bf5a-4c05-90b2-a3bdab67e9b1" containerName="main"
Jul 21 21:19:03.735747 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.735743    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="70863b2e-f782-4bbf-9f90-d7ce2a5200b7" containerName="istio-proxy"
Jul 21 21:19:03.740427 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.740410    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.743005 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.742985    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-60b004-openshift-default-dockercfg-qblr4\""
Jul 21 21:19:03.754835 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.754812    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"]
Jul 21 21:19:03.824920 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.824891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-data\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.825107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.824929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-certs\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.825107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.825020    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istiod-ca-cert\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.825107 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.825072    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlz84\" (UniqueName: \"kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-kube-api-access-vlz84\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.825269 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.825109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-credential-socket\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.825269 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.825181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-podinfo\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.825269 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.825246    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-token\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.825403 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.825270    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-socket\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.825403 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.825301    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-envoy\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.926024 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.925987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-envoy\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.926229 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.926054    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-data\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.926229 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.926083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-certs\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.926229 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.926145    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istiod-ca-cert\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.926229 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.926196    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlz84\" (UniqueName: \"kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-kube-api-access-vlz84\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.926462 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.926233    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-credential-socket\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.926462 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.926265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-podinfo\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.926462 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.926291    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-token\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.926462 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.926321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-socket\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.926684 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.926509    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-data\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.926999 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.926954    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-certs\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.927106 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.927034    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-socket\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.927244 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.927210    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-credential-socket\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.927350 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.927326    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istiod-ca-cert\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.928799 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.928776    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-envoy\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.929368 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.929346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-podinfo\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.934550 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.934530    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-token\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:03.934738 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:03.934710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlz84\" (UniqueName: \"kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-kube-api-access-vlz84\") pod \"e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") " pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:04.051270 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:04.051139    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:04.200333 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:04.200297    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"]
Jul 21 21:19:04.200500 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:19:04.200349    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2cbc3f_9404_4e13_9022_83ca0c265cd9.slice/crio-d211b4b6e067cb2f9cd06e12f7307f35908e6a50c3ceb624142ac25ef399ffc6 WatchSource:0}: Error finding container d211b4b6e067cb2f9cd06e12f7307f35908e6a50c3ceb624142ac25ef399ffc6: Status 404 returned error can't find the container with id d211b4b6e067cb2f9cd06e12f7307f35908e6a50c3ceb624142ac25ef399ffc6
Jul 21 21:19:04.202839 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:04.202794    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:19:04.202971 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:04.202881    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:19:04.202971 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:04.202924    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:19:04.980790 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:04.980753    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" event={"ID":"fc2cbc3f-9404-4e13-9022-83ca0c265cd9","Type":"ContainerStarted","Data":"2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10"}
Jul 21 21:19:04.981305 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:04.980816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" event={"ID":"fc2cbc3f-9404-4e13-9022-83ca0c265cd9","Type":"ContainerStarted","Data":"d211b4b6e067cb2f9cd06e12f7307f35908e6a50c3ceb624142ac25ef399ffc6"}
Jul 21 21:19:05.008251 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:05.008171    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" podStartSLOduration=2.008155799 podStartE2EDuration="2.008155799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:19:05.005512192 +0000 UTC m=+2371.025920659" watchObservedRunningTime="2026-07-21 21:19:05.008155799 +0000 UTC m=+2371.028564241"
Jul 21 21:19:05.051773 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:05.051743    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:05.056591 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:05.056566    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:05.797016 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:05.796985    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:19:05.985695 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:05.985665    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:05.986569 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:05.986546    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:19.852234 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:19.852173    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"]
Jul 21 21:19:19.856080 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:19.856051    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"
Jul 21 21:19:19.875217 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:19.875177    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 21:19:19.875217 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:19.875209    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmths\""
Jul 21 21:19:19.877934 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:19.877909    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"]
Jul 21 21:19:19.974761 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:19.974726    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e2a32e6-62dc-4c74-b465-75ec14205080-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f64949-5vrqs\" (UID: \"8e2a32e6-62dc-4c74-b465-75ec14205080\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"
Jul 21 21:19:20.075538 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:20.075503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e2a32e6-62dc-4c74-b465-75ec14205080-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f64949-5vrqs\" (UID: \"8e2a32e6-62dc-4c74-b465-75ec14205080\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"
Jul 21 21:19:20.076145 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:20.076123    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e2a32e6-62dc-4c74-b465-75ec14205080-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-f64949-5vrqs\" (UID: \"8e2a32e6-62dc-4c74-b465-75ec14205080\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"
Jul 21 21:19:20.168437 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:20.168346    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"
Jul 21 21:19:20.305581 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:20.305556    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"]
Jul 21 21:19:20.309246 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:19:20.309213    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2a32e6_62dc_4c74_b465_75ec14205080.slice/crio-fcc454676924b497337e616a62b90cd8da6d8f2a60c7df349e08ca1d68888763 WatchSource:0}: Error finding container fcc454676924b497337e616a62b90cd8da6d8f2a60c7df349e08ca1d68888763: Status 404 returned error can't find the container with id fcc454676924b497337e616a62b90cd8da6d8f2a60c7df349e08ca1d68888763
Jul 21 21:19:21.070237 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:21.070196    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs" event={"ID":"8e2a32e6-62dc-4c74-b465-75ec14205080","Type":"ContainerStarted","Data":"8b4eba3dc52081182c88686bca48bdebd3da83e6168016840f921b1660a4091a"}
Jul 21 21:19:21.070643 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:21.070259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs" event={"ID":"8e2a32e6-62dc-4c74-b465-75ec14205080","Type":"ContainerStarted","Data":"fcc454676924b497337e616a62b90cd8da6d8f2a60c7df349e08ca1d68888763"}
Jul 21 21:19:21.086014 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:21.085960    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs" podStartSLOduration=2.0859417 podStartE2EDuration="2.0859417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:19:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:19:21.084559616 +0000 UTC m=+2387.104968076" watchObservedRunningTime="2026-07-21 21:19:21.0859417 +0000 UTC m=+2387.106350163"
Jul 21 21:19:21.803591 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:21.803549    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:19:22.028363 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:22.028321    2560 patch_prober.go:28] interesting pod/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 21 21:19:22.028537 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:22.028395    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 21 21:19:22.075949 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:22.075867    2560 generic.go:356] "Generic (PLEG): container finished" podID="8e2a32e6-62dc-4c74-b465-75ec14205080" containerID="8b4eba3dc52081182c88686bca48bdebd3da83e6168016840f921b1660a4091a" exitCode=0
Jul 21 21:19:22.076344 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:22.075959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs" event={"ID":"8e2a32e6-62dc-4c74-b465-75ec14205080","Type":"ContainerDied","Data":"8b4eba3dc52081182c88686bca48bdebd3da83e6168016840f921b1660a4091a"}
Jul 21 21:19:23.216546 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:23.216522    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"
Jul 21 21:19:23.306351 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:23.306320    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e2a32e6-62dc-4c74-b465-75ec14205080-maas-api-service-ca\") pod \"8e2a32e6-62dc-4c74-b465-75ec14205080\" (UID: \"8e2a32e6-62dc-4c74-b465-75ec14205080\") "
Jul 21 21:19:23.306657 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:23.306622    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e2a32e6-62dc-4c74-b465-75ec14205080-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8e2a32e6-62dc-4c74-b465-75ec14205080" (UID: "8e2a32e6-62dc-4c74-b465-75ec14205080"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:19:23.407945 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:23.407875    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e2a32e6-62dc-4c74-b465-75ec14205080-maas-api-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:19:24.088205 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:24.088169    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"
Jul 21 21:19:24.088401 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:24.088208    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs" event={"ID":"8e2a32e6-62dc-4c74-b465-75ec14205080","Type":"ContainerDied","Data":"fcc454676924b497337e616a62b90cd8da6d8f2a60c7df349e08ca1d68888763"}
Jul 21 21:19:24.088401 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:24.088256    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fcc454676924b497337e616a62b90cd8da6d8f2a60c7df349e08ca1d68888763"
Jul 21 21:19:24.089885 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:24.089853    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerID="2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10" exitCode=0
Jul 21 21:19:24.090003 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:24.089929    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" event={"ID":"fc2cbc3f-9404-4e13-9022-83ca0c265cd9","Type":"ContainerDied","Data":"2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10"}
Jul 21 21:19:24.090324 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:24.090307    2560 scope.go:117] "RemoveContainer" containerID="2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10"
Jul 21 21:19:24.091289 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:24.091258    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:19:24.091348 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:24.091330    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:19:24.091384 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:24.091363    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:19:25.096863 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:25.096828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" event={"ID":"fc2cbc3f-9404-4e13-9022-83ca0c265cd9","Type":"ContainerStarted","Data":"c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7"}
Jul 21 21:19:26.052400 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:26.052363    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:26.052644 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:26.052620    2560 patch_prober.go:28] interesting pod/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 21 21:19:26.052738 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:26.052677    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 21 21:19:27.051915 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:27.051873    2560 patch_prober.go:28] interesting pod/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 21 21:19:27.052532 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:27.052480    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 21 21:19:28.052462 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:28.052417    2560 patch_prober.go:28] interesting pod/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 21 21:19:28.052855 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:28.052479    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 21 21:19:29.052228 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:29.052161    2560 patch_prober.go:28] interesting pod/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 21 21:19:29.052434 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:29.052251    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 21 21:19:30.055398 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:30.055362    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:30.055776 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:30.055630    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:30.056262 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:30.056246    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:19:34.634606 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:34.634577    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 21:19:34.641466 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:34.641439    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:19:34.643626 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:34.643597    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 21:19:34.647330 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:34.647312    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:19:39.117268 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:39.117234    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:19:39.990012 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:39.989972    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"]
Jul 21 21:19:39.994576 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:39.994548    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-f64949-5vrqs"]
Jul 21 21:19:40.497732 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:40.497696    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e2a32e6-62dc-4c74-b465-75ec14205080" path="/var/lib/kubelet/pods/8e2a32e6-62dc-4c74-b465-75ec14205080/volumes"
Jul 21 21:19:47.227412 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.227373    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"]
Jul 21 21:19:47.227821 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.227807    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2a32e6-62dc-4c74-b465-75ec14205080" containerName="revoke-keys"
Jul 21 21:19:47.227866 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.227825    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2a32e6-62dc-4c74-b465-75ec14205080" containerName="revoke-keys"
Jul 21 21:19:47.227901 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.227889    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2a32e6-62dc-4c74-b465-75ec14205080" containerName="revoke-keys"
Jul 21 21:19:47.231050 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.231033    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"
Jul 21 21:19:47.237138 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.237103    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 21:19:47.237310 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.237103    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmths\""
Jul 21 21:19:47.250173 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.250144    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b916c6e3-bb3d-4878-8959-2552b121368c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-60b004-mb2xv\" (UID: \"b916c6e3-bb3d-4878-8959-2552b121368c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"
Jul 21 21:19:47.257157 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.257128    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"]
Jul 21 21:19:47.351278 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.351247    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b916c6e3-bb3d-4878-8959-2552b121368c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-60b004-mb2xv\" (UID: \"b916c6e3-bb3d-4878-8959-2552b121368c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"
Jul 21 21:19:47.351893 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.351874    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b916c6e3-bb3d-4878-8959-2552b121368c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-60b004-mb2xv\" (UID: \"b916c6e3-bb3d-4878-8959-2552b121368c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"
Jul 21 21:19:47.541369 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.541278    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"
Jul 21 21:19:47.886061 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:47.886027    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"]
Jul 21 21:19:47.888498 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:19:47.888471    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb916c6e3_bb3d_4878_8959_2552b121368c.slice/crio-c3963be01835c03216bb0dc1b9fc13e6c8b435a1376e46788981c5bac610b364 WatchSource:0}: Error finding container c3963be01835c03216bb0dc1b9fc13e6c8b435a1376e46788981c5bac610b364: Status 404 returned error can't find the container with id c3963be01835c03216bb0dc1b9fc13e6c8b435a1376e46788981c5bac610b364
Jul 21 21:19:48.212406 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:48.212371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv" event={"ID":"b916c6e3-bb3d-4878-8959-2552b121368c","Type":"ContainerStarted","Data":"37dc2e986e3159fd961c375a534e3f0b75241340d2196f12cf1520942f96fe5c"}
Jul 21 21:19:48.212550 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:48.212426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv" event={"ID":"b916c6e3-bb3d-4878-8959-2552b121368c","Type":"ContainerStarted","Data":"c3963be01835c03216bb0dc1b9fc13e6c8b435a1376e46788981c5bac610b364"}
Jul 21 21:19:48.235688 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:48.235639    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv" podStartSLOduration=1.235623898 podStartE2EDuration="1.235623898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:19:48.234356272 +0000 UTC m=+2414.254764736" watchObservedRunningTime="2026-07-21 21:19:48.235623898 +0000 UTC m=+2414.256032361"
Jul 21 21:19:49.218421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:49.218380    2560 generic.go:356] "Generic (PLEG): container finished" podID="b916c6e3-bb3d-4878-8959-2552b121368c" containerID="37dc2e986e3159fd961c375a534e3f0b75241340d2196f12cf1520942f96fe5c" exitCode=0
Jul 21 21:19:49.218627 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:49.218465    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv" event={"ID":"b916c6e3-bb3d-4878-8959-2552b121368c","Type":"ContainerDied","Data":"37dc2e986e3159fd961c375a534e3f0b75241340d2196f12cf1520942f96fe5c"}
Jul 21 21:19:50.352885 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:50.352855    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"
Jul 21 21:19:50.379616 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:50.379587    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b916c6e3-bb3d-4878-8959-2552b121368c-maas-api-service-ca\") pod \"b916c6e3-bb3d-4878-8959-2552b121368c\" (UID: \"b916c6e3-bb3d-4878-8959-2552b121368c\") "
Jul 21 21:19:50.379957 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:50.379934    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b916c6e3-bb3d-4878-8959-2552b121368c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b916c6e3-bb3d-4878-8959-2552b121368c" (UID: "b916c6e3-bb3d-4878-8959-2552b121368c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:19:50.480660 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:50.480582    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b916c6e3-bb3d-4878-8959-2552b121368c-maas-api-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:19:51.229124 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:51.229092    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"
Jul 21 21:19:51.229124 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:51.229104    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv" event={"ID":"b916c6e3-bb3d-4878-8959-2552b121368c","Type":"ContainerDied","Data":"c3963be01835c03216bb0dc1b9fc13e6c8b435a1376e46788981c5bac610b364"}
Jul 21 21:19:51.229431 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:19:51.229175    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3963be01835c03216bb0dc1b9fc13e6c8b435a1376e46788981c5bac610b364"
Jul 21 21:20:07.203474 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:07.203395    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:20:07.294592 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:07.294556    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"]
Jul 21 21:20:07.296428 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:07.296402    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-60b004-mb2xv"]
Jul 21 21:20:08.497723 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:08.497681    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b916c6e3-bb3d-4878-8959-2552b121368c" path="/var/lib/kubelet/pods/b916c6e3-bb3d-4878-8959-2552b121368c/volumes"
Jul 21 21:20:15.054463 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:15.054428    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"]
Jul 21 21:20:15.054934 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:15.054622    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy" containerID="cri-o://c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7" gracePeriod=30
Jul 21 21:20:15.058259 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:15.058231    2560 patch_prober.go:28] interesting pod/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 21:20:15.058381 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:15.058283    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 21:20:16.260339 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.260306    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"]
Jul 21 21:20:16.260719 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.260705    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b916c6e3-bb3d-4878-8959-2552b121368c" containerName="revoke-keys"
Jul 21 21:20:16.260764 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.260720    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b916c6e3-bb3d-4878-8959-2552b121368c" containerName="revoke-keys"
Jul 21 21:20:16.260812 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.260786    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b916c6e3-bb3d-4878-8959-2552b121368c" containerName="revoke-keys"
Jul 21 21:20:16.263783 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.263767    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.266811 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.266793    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0c5ebd-openshift-default-dockercfg-r2fbt\""
Jul 21 21:20:16.298900 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.298878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"]
Jul 21 21:20:16.416826 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.416795    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-socket\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.417017 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.416842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-credential-socket\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.417017 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.416882    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-data\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.417017 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.416945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-podinfo\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.417017 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.416979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-envoy\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.417279 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.417023    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3f6c2a-0025-466f-988c-d38611ceb44d-istiod-ca-cert\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.417279 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.417082    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-certs\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.417279 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.417135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-token\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.417279 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.417157    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8nwm\" (UniqueName: \"kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-kube-api-access-b8nwm\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518083 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-socket\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518083 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518048    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-credential-socket\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518083 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-data\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518083 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-podinfo\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518453 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518241    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-envoy\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518453 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518321    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3f6c2a-0025-466f-988c-d38611ceb44d-istiod-ca-cert\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518453 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518355    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-certs\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518453 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518406    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-token\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518453 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8nwm\" (UniqueName: \"kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-kube-api-access-b8nwm\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518707 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518471    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-socket\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518707 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518531    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-data\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518707 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518571    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-credential-socket\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.518861 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.518763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-certs\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.519168 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.519141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3f6c2a-0025-466f-988c-d38611ceb44d-istiod-ca-cert\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.520595 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.520568    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-envoy\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.520655 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.520631    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-podinfo\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.531711 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.531681    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8nwm\" (UniqueName: \"kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-kube-api-access-b8nwm\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.532077 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.532060    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-token\") pod \"e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") " pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.574078 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.574056    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:16.758559 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.758530    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"]
Jul 21 21:20:16.761003 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:20:16.760971    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3f6c2a_0025_466f_988c_d38611ceb44d.slice/crio-a2c38e1d12e0a08b72fd180d659c216d78e7ded56d1b0112dae89a16d9c652c4 WatchSource:0}: Error finding container a2c38e1d12e0a08b72fd180d659c216d78e7ded56d1b0112dae89a16d9c652c4: Status 404 returned error can't find the container with id a2c38e1d12e0a08b72fd180d659c216d78e7ded56d1b0112dae89a16d9c652c4
Jul 21 21:20:16.763038 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.763008    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:20:16.763105 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.763068    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:20:16.763105 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:16.763093    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:20:17.365785 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:17.365722    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" event={"ID":"1c3f6c2a-0025-466f-988c-d38611ceb44d","Type":"ContainerStarted","Data":"77d2cd9667467d27f1fbce2838e613f1f9f49b2f8e7ab78f2243a4dd6d3cd39e"}
Jul 21 21:20:17.366249 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:17.365832    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" event={"ID":"1c3f6c2a-0025-466f-988c-d38611ceb44d","Type":"ContainerStarted","Data":"a2c38e1d12e0a08b72fd180d659c216d78e7ded56d1b0112dae89a16d9c652c4"}
Jul 21 21:20:17.441642 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:17.441585    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" podStartSLOduration=1.441567429 podStartE2EDuration="1.441567429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:20:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:20:17.439558031 +0000 UTC m=+2443.459966494" watchObservedRunningTime="2026-07-21 21:20:17.441567429 +0000 UTC m=+2443.461975892"
Jul 21 21:20:17.574982 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:17.574948    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:17.580108 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:17.580082    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:18.371772 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:18.371733    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:18.372770 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:18.372747    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:20.306846 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.306823    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:20:20.383622 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.383531    2560 generic.go:356] "Generic (PLEG): container finished" podID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerID="c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7" exitCode=0
Jul 21 21:20:20.383622 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.383580    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"
Jul 21 21:20:20.383860 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.383617    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" event={"ID":"fc2cbc3f-9404-4e13-9022-83ca0c265cd9","Type":"ContainerDied","Data":"c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7"}
Jul 21 21:20:20.383860 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.383676    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm" event={"ID":"fc2cbc3f-9404-4e13-9022-83ca0c265cd9","Type":"ContainerDied","Data":"d211b4b6e067cb2f9cd06e12f7307f35908e6a50c3ceb624142ac25ef399ffc6"}
Jul 21 21:20:20.383860 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.383702    2560 scope.go:117] "RemoveContainer" containerID="c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7"
Jul 21 21:20:20.392621 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.392608    2560 scope.go:117] "RemoveContainer" containerID="2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10"
Jul 21 21:20:20.400540 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.400523    2560 scope.go:117] "RemoveContainer" containerID="c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7"
Jul 21 21:20:20.400806 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:20:20.400787    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7\": container with ID starting with c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7 not found: ID does not exist" containerID="c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7"
Jul 21 21:20:20.400854 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.400819    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7"} err="failed to get container status \"c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7\": rpc error: code = NotFound desc = could not find container \"c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7\": container with ID starting with c7141108f33687597a605da57a689febe913cd2df136a6db83e49aca59a15db7 not found: ID does not exist"
Jul 21 21:20:20.400854 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.400838    2560 scope.go:117] "RemoveContainer" containerID="2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10"
Jul 21 21:20:20.401095 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:20:20.401070    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10\": container with ID starting with 2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10 not found: ID does not exist" containerID="2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10"
Jul 21 21:20:20.401215 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.401099    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10"} err="failed to get container status \"2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10\": rpc error: code = NotFound desc = could not find container \"2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10\": container with ID starting with 2c3641cab65202439c42c3a675c7b72dbf1212c99a7c39429a77da8e991aeb10 not found: ID does not exist"
Jul 21 21:20:20.460456 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.460430    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlz84\" (UniqueName: \"kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-kube-api-access-vlz84\") pod \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") "
Jul 21 21:20:20.460567 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.460479    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istiod-ca-cert\") pod \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") "
Jul 21 21:20:20.460567 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.460513    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-token\") pod \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") "
Jul 21 21:20:20.460649 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.460567    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-credential-socket\") pod \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") "
Jul 21 21:20:20.460649 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.460596    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-envoy\") pod \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") "
Jul 21 21:20:20.460734 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.460704    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-socket\") pod \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") "
Jul 21 21:20:20.460786 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.460734    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-podinfo\") pod \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") "
Jul 21 21:20:20.460786 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.460780    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-certs\") pod \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") "
Jul 21 21:20:20.460899 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.460810    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-data\") pod \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\" (UID: \"fc2cbc3f-9404-4e13-9022-83ca0c265cd9\") "
Jul 21 21:20:20.460993 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.460966    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc2cbc3f-9404-4e13-9022-83ca0c265cd9" (UID: "fc2cbc3f-9404-4e13-9022-83ca0c265cd9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:20:20.461080 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.461003    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc2cbc3f-9404-4e13-9022-83ca0c265cd9" (UID: "fc2cbc3f-9404-4e13-9022-83ca0c265cd9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:20:20.461308 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.461285    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc2cbc3f-9404-4e13-9022-83ca0c265cd9" (UID: "fc2cbc3f-9404-4e13-9022-83ca0c265cd9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:20:20.461414 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.461305    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:20:20.461414 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.461346    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:20:20.461529 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.461434    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc2cbc3f-9404-4e13-9022-83ca0c265cd9" (UID: "fc2cbc3f-9404-4e13-9022-83ca0c265cd9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:20:20.461849 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.461822    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc2cbc3f-9404-4e13-9022-83ca0c265cd9" (UID: "fc2cbc3f-9404-4e13-9022-83ca0c265cd9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:20:20.462835 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.462813    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc2cbc3f-9404-4e13-9022-83ca0c265cd9" (UID: "fc2cbc3f-9404-4e13-9022-83ca0c265cd9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:20:20.462957 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.462935    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc2cbc3f-9404-4e13-9022-83ca0c265cd9" (UID: "fc2cbc3f-9404-4e13-9022-83ca0c265cd9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:20:20.463117 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.463093    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc2cbc3f-9404-4e13-9022-83ca0c265cd9" (UID: "fc2cbc3f-9404-4e13-9022-83ca0c265cd9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:20:20.463117 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.463102    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-kube-api-access-vlz84" (OuterVolumeSpecName: "kube-api-access-vlz84") pod "fc2cbc3f-9404-4e13-9022-83ca0c265cd9" (UID: "fc2cbc3f-9404-4e13-9022-83ca0c265cd9"). InnerVolumeSpecName "kube-api-access-vlz84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:20:20.562275 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.562243    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:20:20.562275 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.562272    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:20:20.562443 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.562286    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:20:20.562443 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.562299    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:20:20.562443 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.562310    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:20:20.562443 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.562322    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlz84\" (UniqueName: \"kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-kube-api-access-vlz84\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:20:20.562443 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.562337    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc2cbc3f-9404-4e13-9022-83ca0c265cd9-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:20:20.723927 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.723847    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"]
Jul 21 21:20:20.748061 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:20.748030    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-60b004-openshift-default-5bb76dcf89-8wzgm"]
Jul 21 21:20:22.497414 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:22.497379    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" path="/var/lib/kubelet/pods/fc2cbc3f-9404-4e13-9022-83ca0c265cd9/volumes"
Jul 21 21:20:25.064019 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:25.063975    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:20:32.447243 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:32.447207    2560 generic.go:356] "Generic (PLEG): container finished" podID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerID="77d2cd9667467d27f1fbce2838e613f1f9f49b2f8e7ab78f2243a4dd6d3cd39e" exitCode=0
Jul 21 21:20:32.447658 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:32.447223    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" event={"ID":"1c3f6c2a-0025-466f-988c-d38611ceb44d","Type":"ContainerDied","Data":"77d2cd9667467d27f1fbce2838e613f1f9f49b2f8e7ab78f2243a4dd6d3cd39e"}
Jul 21 21:20:32.447816 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:32.447799    2560 scope.go:117] "RemoveContainer" containerID="77d2cd9667467d27f1fbce2838e613f1f9f49b2f8e7ab78f2243a4dd6d3cd39e"
Jul 21 21:20:32.448845 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:32.448812    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:20:32.448940 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:32.448879    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:20:32.448940 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:32.448914    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 21 21:20:33.372345 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:33.372312    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:33.458220 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:33.457390    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" event={"ID":"1c3f6c2a-0025-466f-988c-d38611ceb44d","Type":"ContainerStarted","Data":"b76fe4b816775c885044ce45a0fe509c543ac035b947e5c70243cb220bed44b8"}
Jul 21 21:20:33.574338 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:33.574304    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:33.575369 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:33.575336    2560 patch_prober.go:28] interesting pod/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 21 21:20:33.575496 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:33.575388    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 21 21:20:34.067084 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:34.067053    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:20:34.574557 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:34.574526    2560 patch_prober.go:28] interesting pod/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 21 21:20:34.574940 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:34.574576    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 21 21:20:34.801057 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:34.801023    2560 scope.go:117] "RemoveContainer" containerID="bd9d7185107e6df4787849996ef46ef7da50b496b604bb9af272ac6125f6db46"
Jul 21 21:20:35.574889 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:35.574852    2560 patch_prober.go:28] interesting pod/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 21 21:20:35.575322 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:35.574912    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 21 21:20:36.574691 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:36.574656    2560 patch_prober.go:28] interesting pod/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 21 21:20:36.574859 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:36.574711    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 21 21:20:37.575254 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:37.575212    2560 patch_prober.go:28] interesting pod/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 21 21:20:37.575721 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:37.575275    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 21 21:20:38.578312 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:38.578280    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:38.578691 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:38.578547    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:38.579299 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:38.579282    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:20:40.760492 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.760458    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"]
Jul 21 21:20:40.760865 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.760853    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy"
Jul 21 21:20:40.760865 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.760866    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy"
Jul 21 21:20:40.760938 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.760882    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy"
Jul 21 21:20:40.760938 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.760887    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy"
Jul 21 21:20:40.761001 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.760943    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy"
Jul 21 21:20:40.761001 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.760954    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc2cbc3f-9404-4e13-9022-83ca0c265cd9" containerName="istio-proxy"
Jul 21 21:20:40.765770 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.765752    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.770584 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.770560    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0c5ebd\"/\"default-dockercfg-s7k6h\""
Jul 21 21:20:40.770701 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.770602    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0c5ebd\"/\"openshift-service-ca.crt\""
Jul 21 21:20:40.770701 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.770608    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0c5ebd\"/\"auth-test-model-0c5ebd-kserve-self-signed-certs\""
Jul 21 21:20:40.773091 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.773076    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0c5ebd\"/\"kube-root-ca.crt\""
Jul 21 21:20:40.782471 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.782448    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"]
Jul 21 21:20:40.854476 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.854449    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tls-certs\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.854598 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.854486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-dshm\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.854598 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.854523    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tmp-dir\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.854598 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.854555    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcfxh\" (UniqueName: \"kubernetes.io/projected/c50b5e96-75a5-4ae4-873d-35ffb43108c3-kube-api-access-lcfxh\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.854598 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.854596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-home\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.854733 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.854649    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-model-cache\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.955788 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.955749    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tls-certs\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.955938 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.955800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-dshm\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.955938 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.955836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tmp-dir\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.955938 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.955854    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcfxh\" (UniqueName: \"kubernetes.io/projected/c50b5e96-75a5-4ae4-873d-35ffb43108c3-kube-api-access-lcfxh\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.955938 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.955894    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-home\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.956229 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.955941    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-model-cache\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.956417 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.956391    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-model-cache\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.956417 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.956407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tmp-dir\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.956532 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.956442    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-home\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.958125 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.958107    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-dshm\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.958432 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.958412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tls-certs\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:40.964661 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:40.964637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcfxh\" (UniqueName: \"kubernetes.io/projected/c50b5e96-75a5-4ae4-873d-35ffb43108c3-kube-api-access-lcfxh\") pod \"auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") " pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:41.074777 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:41.074749    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:41.209448 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:41.209423    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"]
Jul 21 21:20:41.211748 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:20:41.211716    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc50b5e96_75a5_4ae4_873d_35ffb43108c3.slice/crio-8cbc3be0e27ec3bc388846b7a410a8436d1f9a1f1de6110b995b01ebda6b2612 WatchSource:0}: Error finding container 8cbc3be0e27ec3bc388846b7a410a8436d1f9a1f1de6110b995b01ebda6b2612: Status 404 returned error can't find the container with id 8cbc3be0e27ec3bc388846b7a410a8436d1f9a1f1de6110b995b01ebda6b2612
Jul 21 21:20:41.500565 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:41.500468    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv" event={"ID":"c50b5e96-75a5-4ae4-873d-35ffb43108c3","Type":"ContainerStarted","Data":"bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5"}
Jul 21 21:20:41.500565 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:41.500520    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv" event={"ID":"c50b5e96-75a5-4ae4-873d-35ffb43108c3","Type":"ContainerStarted","Data":"8cbc3be0e27ec3bc388846b7a410a8436d1f9a1f1de6110b995b01ebda6b2612"}
Jul 21 21:20:41.520901 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:41.520844    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv" podStartSLOduration=1.520823845 podStartE2EDuration="1.520823845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:20:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:20:41.52000239 +0000 UTC m=+2467.540410852" watchObservedRunningTime="2026-07-21 21:20:41.520823845 +0000 UTC m=+2467.541232300"
Jul 21 21:20:47.114855 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:47.114817    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:20:51.074962 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:51.074922    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:51.074962 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:51.074973    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:51.087522 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:51.087497    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:20:51.562029 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:20:51.561996    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:21:15.006311 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:21:15.006270    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:21:29.410274 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:21:29.410173    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:21:48.212899 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:21:48.212862    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:22:02.905881 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:22:02.905844    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:22:20.899963 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:22:20.899923    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:22:40.501845 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:22:40.501810    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:22:59.916488 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:22:59.916410    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:23:15.213435 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:15.213402    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"]
Jul 21 21:23:18.532702 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:18.532667    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:23:26.221557 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.221517    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"]
Jul 21 21:23:26.225297 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.225276    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.231148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.231125    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0c5ebd\"/\"sub-test-model-0c5ebd-kserve-self-signed-certs\""
Jul 21 21:23:26.240369 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.240345    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"]
Jul 21 21:23:26.312459 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.312424    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-model-cache\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.312646 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.312470    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a058a78b-aace-4242-89e5-a604002c1a71-tls-certs\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.312646 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.312531    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-home\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.312646 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.312585    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-tmp-dir\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.312782 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.312648    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdzn5\" (UniqueName: \"kubernetes.io/projected/a058a78b-aace-4242-89e5-a604002c1a71-kube-api-access-fdzn5\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.312782 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.312674    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-dshm\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.413524 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.413490    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-dshm\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.413702 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.413559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-model-cache\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.413702 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.413595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a058a78b-aace-4242-89e5-a604002c1a71-tls-certs\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.413702 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.413633    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-home\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.413702 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.413674    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-tmp-dir\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.413913 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.413725    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdzn5\" (UniqueName: \"kubernetes.io/projected/a058a78b-aace-4242-89e5-a604002c1a71-kube-api-access-fdzn5\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.414029 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.414006    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-model-cache\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.414095 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.414047    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-home\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.414147 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.414124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-tmp-dir\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.415820 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.415797    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-dshm\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.416069 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.416051    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a058a78b-aace-4242-89e5-a604002c1a71-tls-certs\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.423868 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.423843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdzn5\" (UniqueName: \"kubernetes.io/projected/a058a78b-aace-4242-89e5-a604002c1a71-kube-api-access-fdzn5\") pod \"sub-test-model-0c5ebd-kserve-d479f7945-kn264\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") " pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.533921 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.533834    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:26.677616 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:26.677589    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"]
Jul 21 21:23:26.680354 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:23:26.680322    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda058a78b_aace_4242_89e5_a604002c1a71.slice/crio-7ebf92cacc98cfabf164af4d71034851101b809717f507cdd90d72739ec5e194 WatchSource:0}: Error finding container 7ebf92cacc98cfabf164af4d71034851101b809717f507cdd90d72739ec5e194: Status 404 returned error can't find the container with id 7ebf92cacc98cfabf164af4d71034851101b809717f507cdd90d72739ec5e194
Jul 21 21:23:27.327889 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:27.327851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264" event={"ID":"a058a78b-aace-4242-89e5-a604002c1a71","Type":"ContainerStarted","Data":"3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839"}
Jul 21 21:23:27.327889 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:27.327896    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264" event={"ID":"a058a78b-aace-4242-89e5-a604002c1a71","Type":"ContainerStarted","Data":"7ebf92cacc98cfabf164af4d71034851101b809717f507cdd90d72739ec5e194"}
Jul 21 21:23:27.349815 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:27.349767    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264" podStartSLOduration=1.349752199 podStartE2EDuration="1.349752199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:23:27.349078248 +0000 UTC m=+2633.369486712" watchObservedRunningTime="2026-07-21 21:23:27.349752199 +0000 UTC m=+2633.370160710"
Jul 21 21:23:30.233040 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.232980    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv" podUID="c50b5e96-75a5-4ae4-873d-35ffb43108c3" containerName="main" containerID="cri-o://bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5" gracePeriod=45
Jul 21 21:23:30.488368 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.488307    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:23:30.551670 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.551638    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-home\") pod \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") "
Jul 21 21:23:30.551820 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.551679    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tmp-dir\") pod \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") "
Jul 21 21:23:30.551820 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.551726    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tls-certs\") pod \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") "
Jul 21 21:23:30.551820 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.551764    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcfxh\" (UniqueName: \"kubernetes.io/projected/c50b5e96-75a5-4ae4-873d-35ffb43108c3-kube-api-access-lcfxh\") pod \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") "
Jul 21 21:23:30.551820 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.551799    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-dshm\") pod \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") "
Jul 21 21:23:30.552021 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.551835    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-model-cache\") pod \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\" (UID: \"c50b5e96-75a5-4ae4-873d-35ffb43108c3\") "
Jul 21 21:23:30.552021 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.551938    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-home" (OuterVolumeSpecName: "home") pod "c50b5e96-75a5-4ae4-873d-35ffb43108c3" (UID: "c50b5e96-75a5-4ae4-873d-35ffb43108c3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:23:30.552021 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.551966    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c50b5e96-75a5-4ae4-873d-35ffb43108c3" (UID: "c50b5e96-75a5-4ae4-873d-35ffb43108c3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:23:30.552209 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.552162    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-model-cache" (OuterVolumeSpecName: "model-cache") pod "c50b5e96-75a5-4ae4-873d-35ffb43108c3" (UID: "c50b5e96-75a5-4ae4-873d-35ffb43108c3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:23:30.552209 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.552202    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-home\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:23:30.552318 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.552222    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tmp-dir\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:23:30.554049 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.554021    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c50b5e96-75a5-4ae4-873d-35ffb43108c3" (UID: "c50b5e96-75a5-4ae4-873d-35ffb43108c3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 21:23:30.554049 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.554021    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-dshm" (OuterVolumeSpecName: "dshm") pod "c50b5e96-75a5-4ae4-873d-35ffb43108c3" (UID: "c50b5e96-75a5-4ae4-873d-35ffb43108c3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:23:30.554220 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.554105    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c50b5e96-75a5-4ae4-873d-35ffb43108c3-kube-api-access-lcfxh" (OuterVolumeSpecName: "kube-api-access-lcfxh") pod "c50b5e96-75a5-4ae4-873d-35ffb43108c3" (UID: "c50b5e96-75a5-4ae4-873d-35ffb43108c3"). InnerVolumeSpecName "kube-api-access-lcfxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:23:30.652948 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.652924    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c50b5e96-75a5-4ae4-873d-35ffb43108c3-tls-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:23:30.652948 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.652949    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcfxh\" (UniqueName: \"kubernetes.io/projected/c50b5e96-75a5-4ae4-873d-35ffb43108c3-kube-api-access-lcfxh\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:23:30.653222 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.652958    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-dshm\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:23:30.653222 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:30.652967    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c50b5e96-75a5-4ae4-873d-35ffb43108c3-model-cache\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:23:31.348849 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:31.348815    2560 generic.go:356] "Generic (PLEG): container finished" podID="c50b5e96-75a5-4ae4-873d-35ffb43108c3" containerID="bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5" exitCode=0
Jul 21 21:23:31.349314 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:31.348853    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"
Jul 21 21:23:31.349314 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:31.348887    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv" event={"ID":"c50b5e96-75a5-4ae4-873d-35ffb43108c3","Type":"ContainerDied","Data":"bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5"}
Jul 21 21:23:31.349314 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:31.348918    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv" event={"ID":"c50b5e96-75a5-4ae4-873d-35ffb43108c3","Type":"ContainerDied","Data":"8cbc3be0e27ec3bc388846b7a410a8436d1f9a1f1de6110b995b01ebda6b2612"}
Jul 21 21:23:31.349314 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:31.348934    2560 scope.go:117] "RemoveContainer" containerID="bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5"
Jul 21 21:23:31.358014 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:31.357997    2560 scope.go:117] "RemoveContainer" containerID="bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5"
Jul 21 21:23:31.358300 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:23:31.358282    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5\": container with ID starting with bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5 not found: ID does not exist" containerID="bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5"
Jul 21 21:23:31.358403 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:31.358309    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5"} err="failed to get container status \"bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5\": rpc error: code = NotFound desc = could not find container \"bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5\": container with ID starting with bfb76656cd0c80d0614e36d33ba35d656700f4161392932be2994842f48c02b5 not found: ID does not exist"
Jul 21 21:23:31.371381 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:31.371351    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"]
Jul 21 21:23:31.375507 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:31.375482    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/auth-test-model-0c5ebd-kserve-6db8f4d555-2dqxv"]
Jul 21 21:23:31.814335 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:31.814302    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:23:32.498662 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:32.498630    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c50b5e96-75a5-4ae4-873d-35ffb43108c3" path="/var/lib/kubelet/pods/c50b5e96-75a5-4ae4-873d-35ffb43108c3/volumes"
Jul 21 21:23:36.533985 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:36.533929    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:36.533985 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:36.533990    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:36.546504 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:36.546468    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:23:37.390316 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:23:37.390287    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:24:01.006092 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:01.006056    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:24:17.930280 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:17.930238    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:24:34.668089 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:34.668009    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 21:24:34.671917 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:34.671895    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:24:34.675085 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:34.675067    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 21:24:34.678951 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:34.678933    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:24:35.317447 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:35.317413    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"]
Jul 21 21:24:40.301503 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:40.301463    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:24:44.892913 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.892873    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"]
Jul 21 21:24:44.893491 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.893470    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c50b5e96-75a5-4ae4-873d-35ffb43108c3" containerName="main"
Jul 21 21:24:44.893579 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.893493    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c50b5e96-75a5-4ae4-873d-35ffb43108c3" containerName="main"
Jul 21 21:24:44.893635 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.893589    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c50b5e96-75a5-4ae4-873d-35ffb43108c3" containerName="main"
Jul 21 21:24:44.896438 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.896418    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:44.899179 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.899158    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0c5ebd\"/\"rate-test-model-0c5ebd-kserve-self-signed-certs\""
Jul 21 21:24:44.912517 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.912494    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"]
Jul 21 21:24:44.921634 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.921614    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-home\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:44.921733 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.921655    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tls-certs\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:44.921733 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.921676    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86q7z\" (UniqueName: \"kubernetes.io/projected/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-kube-api-access-86q7z\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:44.921830 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.921746    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-dshm\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:44.921830 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.921775    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tmp-dir\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:44.921830 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:44.921814    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-model-cache\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.023005 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.022974    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-dshm\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.023182 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.023022    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tmp-dir\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.023182 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.023079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-model-cache\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.023182 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.023114    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-home\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.023182 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.023156    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tls-certs\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.023442 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.023182    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86q7z\" (UniqueName: \"kubernetes.io/projected/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-kube-api-access-86q7z\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.023538 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.023516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tmp-dir\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.023600 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.023566    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-model-cache\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.023651 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.023593    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-home\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.025480 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.025454    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-dshm\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.025636 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.025620    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tls-certs\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.033870 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.033848    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86q7z\" (UniqueName: \"kubernetes.io/projected/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-kube-api-access-86q7z\") pod \"rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") " pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.205148 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.205054    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:45.348581 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.348414    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"]
Jul 21 21:24:45.350850 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:24:45.350824    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf2f508fe_3c6f_4fff_8b7f_655a2cde6cae.slice/crio-c2f227fd77530dcf32b137133c1d426bb154d26822e3fc027578055348896499 WatchSource:0}: Error finding container c2f227fd77530dcf32b137133c1d426bb154d26822e3fc027578055348896499: Status 404 returned error can't find the container with id c2f227fd77530dcf32b137133c1d426bb154d26822e3fc027578055348896499
Jul 21 21:24:45.712270 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.712220    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm" event={"ID":"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae","Type":"ContainerStarted","Data":"4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290"}
Jul 21 21:24:45.712270 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.712277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm" event={"ID":"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae","Type":"ContainerStarted","Data":"c2f227fd77530dcf32b137133c1d426bb154d26822e3fc027578055348896499"}
Jul 21 21:24:45.731392 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:45.731346    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm" podStartSLOduration=1.731330719 podStartE2EDuration="1.731330719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:24:45.729815329 +0000 UTC m=+2711.750223791" watchObservedRunningTime="2026-07-21 21:24:45.731330719 +0000 UTC m=+2711.751739183"
Jul 21 21:24:50.338001 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.337938    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264" podUID="a058a78b-aace-4242-89e5-a604002c1a71" containerName="main" containerID="cri-o://3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839" gracePeriod=45
Jul 21 21:24:50.593444 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.593385    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:24:50.677919 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.677889    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-model-cache\") pod \"a058a78b-aace-4242-89e5-a604002c1a71\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") "
Jul 21 21:24:50.678089 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.677930    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-home\") pod \"a058a78b-aace-4242-89e5-a604002c1a71\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") "
Jul 21 21:24:50.678089 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.677992    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-dshm\") pod \"a058a78b-aace-4242-89e5-a604002c1a71\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") "
Jul 21 21:24:50.678089 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.678055    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-tmp-dir\") pod \"a058a78b-aace-4242-89e5-a604002c1a71\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") "
Jul 21 21:24:50.678281 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.678099    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a058a78b-aace-4242-89e5-a604002c1a71-tls-certs\") pod \"a058a78b-aace-4242-89e5-a604002c1a71\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") "
Jul 21 21:24:50.678281 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.678121    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdzn5\" (UniqueName: \"kubernetes.io/projected/a058a78b-aace-4242-89e5-a604002c1a71-kube-api-access-fdzn5\") pod \"a058a78b-aace-4242-89e5-a604002c1a71\" (UID: \"a058a78b-aace-4242-89e5-a604002c1a71\") "
Jul 21 21:24:50.678281 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.678176    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-model-cache" (OuterVolumeSpecName: "model-cache") pod "a058a78b-aace-4242-89e5-a604002c1a71" (UID: "a058a78b-aace-4242-89e5-a604002c1a71"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:24:50.678281 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.678212    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-home" (OuterVolumeSpecName: "home") pod "a058a78b-aace-4242-89e5-a604002c1a71" (UID: "a058a78b-aace-4242-89e5-a604002c1a71"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:24:50.678470 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.678395    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a058a78b-aace-4242-89e5-a604002c1a71" (UID: "a058a78b-aace-4242-89e5-a604002c1a71"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:24:50.678555 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.678536    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-tmp-dir\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:24:50.678609 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.678557    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-model-cache\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:24:50.678609 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.678565    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-home\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:24:50.680131 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.680103    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-dshm" (OuterVolumeSpecName: "dshm") pod "a058a78b-aace-4242-89e5-a604002c1a71" (UID: "a058a78b-aace-4242-89e5-a604002c1a71"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:24:50.680253 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.680155    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a058a78b-aace-4242-89e5-a604002c1a71-kube-api-access-fdzn5" (OuterVolumeSpecName: "kube-api-access-fdzn5") pod "a058a78b-aace-4242-89e5-a604002c1a71" (UID: "a058a78b-aace-4242-89e5-a604002c1a71"). InnerVolumeSpecName "kube-api-access-fdzn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:24:50.680253 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.680161    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a058a78b-aace-4242-89e5-a604002c1a71-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a058a78b-aace-4242-89e5-a604002c1a71" (UID: "a058a78b-aace-4242-89e5-a604002c1a71"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 21:24:50.744065 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.744029    2560 generic.go:356] "Generic (PLEG): container finished" podID="a058a78b-aace-4242-89e5-a604002c1a71" containerID="3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839" exitCode=0
Jul 21 21:24:50.744233 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.744070    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"
Jul 21 21:24:50.744233 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.744122    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264" event={"ID":"a058a78b-aace-4242-89e5-a604002c1a71","Type":"ContainerDied","Data":"3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839"}
Jul 21 21:24:50.744233 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.744172    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264" event={"ID":"a058a78b-aace-4242-89e5-a604002c1a71","Type":"ContainerDied","Data":"7ebf92cacc98cfabf164af4d71034851101b809717f507cdd90d72739ec5e194"}
Jul 21 21:24:50.744233 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.744209    2560 scope.go:117] "RemoveContainer" containerID="3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839"
Jul 21 21:24:50.752924 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.752910    2560 scope.go:117] "RemoveContainer" containerID="3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839"
Jul 21 21:24:50.753154 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:24:50.753137    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839\": container with ID starting with 3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839 not found: ID does not exist" containerID="3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839"
Jul 21 21:24:50.753226 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.753162    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839"} err="failed to get container status \"3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839\": rpc error: code = NotFound desc = could not find container \"3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839\": container with ID starting with 3a4a81e740e01cc101458e0338daa1543f24af05433fc1f9b4c8264c102f9839 not found: ID does not exist"
Jul 21 21:24:50.765722 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.765701    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"]
Jul 21 21:24:50.769721 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.769699    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/sub-test-model-0c5ebd-kserve-d479f7945-kn264"]
Jul 21 21:24:50.779054 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.779035    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a058a78b-aace-4242-89e5-a604002c1a71-dshm\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:24:50.779137 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.779062    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a058a78b-aace-4242-89e5-a604002c1a71-tls-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:24:50.779137 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.779073    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdzn5\" (UniqueName: \"kubernetes.io/projected/a058a78b-aace-4242-89e5-a604002c1a71-kube-api-access-fdzn5\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:24:50.894152 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:50.894088    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:24:52.498264 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:52.498227    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a058a78b-aace-4242-89e5-a604002c1a71" path="/var/lib/kubelet/pods/a058a78b-aace-4242-89e5-a604002c1a71/volumes"
Jul 21 21:24:55.205243 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:55.205211    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:55.205699 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:55.205265    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:55.219785 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:55.219762    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:24:55.780481 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:24:55.780452    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:25:00.081702 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.081669    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"]
Jul 21 21:25:00.082057 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.082045    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a058a78b-aace-4242-89e5-a604002c1a71" containerName="main"
Jul 21 21:25:00.082057 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.082056    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a058a78b-aace-4242-89e5-a604002c1a71" containerName="main"
Jul 21 21:25:00.082136 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.082120    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a058a78b-aace-4242-89e5-a604002c1a71" containerName="main"
Jul 21 21:25:00.086396 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.086379    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.089447 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.089423    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-80e9ec\"/\"kube-root-ca.crt\""
Jul 21 21:25:00.089581 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.089474    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-80e9ec\"/\"rate-test-model-80e9ec-kserve-self-signed-certs\""
Jul 21 21:25:00.089581 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.089499    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-80e9ec\"/\"openshift-service-ca.crt\""
Jul 21 21:25:00.089581 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.089473    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-80e9ec\"/\"default-dockercfg-j5dgq\""
Jul 21 21:25:00.096760 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.096731    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"]
Jul 21 21:25:00.163878 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.163843    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-dshm\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.163878 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.163886    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-home\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.164074 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.163959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-tmp-dir\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.164074 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.163999    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64755c23-d17f-4151-91ab-2120dc66da65-tls-certs\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.164074 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.164033    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8qr2\" (UniqueName: \"kubernetes.io/projected/64755c23-d17f-4151-91ab-2120dc66da65-kube-api-access-d8qr2\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.164222 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.164123    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-model-cache\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.264895 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.264862    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-dshm\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.264895 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.264898    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-home\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.265100 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.264937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-tmp-dir\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.265100 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.264957    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64755c23-d17f-4151-91ab-2120dc66da65-tls-certs\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.265100 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.264983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8qr2\" (UniqueName: \"kubernetes.io/projected/64755c23-d17f-4151-91ab-2120dc66da65-kube-api-access-d8qr2\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.265100 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.265056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-model-cache\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.265435 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.265412    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-home\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.265537 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.265446    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-model-cache\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.265537 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.265510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-tmp-dir\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.267122 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.267103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-dshm\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.267533 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.267518    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64755c23-d17f-4151-91ab-2120dc66da65-tls-certs\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.272781 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.272761    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8qr2\" (UniqueName: \"kubernetes.io/projected/64755c23-d17f-4151-91ab-2120dc66da65-kube-api-access-d8qr2\") pod \"rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") " pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.396983 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.396895    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:00.528217 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.528064    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"]
Jul 21 21:25:00.530525 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:25:00.530492    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64755c23_d17f_4151_91ab_2120dc66da65.slice/crio-a9d9ff0b6d16f8b020af7d407723d47f7c9b9d1d82b3feec624ee28de99f331e WatchSource:0}: Error finding container a9d9ff0b6d16f8b020af7d407723d47f7c9b9d1d82b3feec624ee28de99f331e: Status 404 returned error can't find the container with id a9d9ff0b6d16f8b020af7d407723d47f7c9b9d1d82b3feec624ee28de99f331e
Jul 21 21:25:00.793931 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.793845    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg" event={"ID":"64755c23-d17f-4151-91ab-2120dc66da65","Type":"ContainerStarted","Data":"50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef"}
Jul 21 21:25:00.793931 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.793889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg" event={"ID":"64755c23-d17f-4151-91ab-2120dc66da65","Type":"ContainerStarted","Data":"a9d9ff0b6d16f8b020af7d407723d47f7c9b9d1d82b3feec624ee28de99f331e"}
Jul 21 21:25:00.811878 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:00.811832    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg" podStartSLOduration=0.811818438 podStartE2EDuration="811.818438ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:25:00.809986075 +0000 UTC m=+2726.830394537" watchObservedRunningTime="2026-07-21 21:25:00.811818438 +0000 UTC m=+2726.832226900"
Jul 21 21:25:05.003833 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:05.003800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:25:10.397356 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:10.397283    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:10.397826 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:10.397378    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:10.409944 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:10.409917    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:10.854252 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:10.854215    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:25:27.601496 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:27.601460    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:25:34.857557 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:34.857522    2560 scope.go:117] "RemoveContainer" containerID="8b4eba3dc52081182c88686bca48bdebd3da83e6168016840f921b1660a4091a"
Jul 21 21:25:42.302616 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:42.302578    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:25:50.462643 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:50.462594    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"]
Jul 21 21:25:51.404074 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:51.404044    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"]
Jul 21 21:25:57.495486 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:25:57.495409    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:26:05.482587 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.482514    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm" podUID="f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" containerName="main" containerID="cri-o://4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290" gracePeriod=45
Jul 21 21:26:05.746110 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.746038    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:26:05.764794 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.764764    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-dshm\") pod \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") "
Jul 21 21:26:05.764949 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.764848    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-home\") pod \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") "
Jul 21 21:26:05.764949 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.764920    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-model-cache\") pod \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") "
Jul 21 21:26:05.765069 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.764948    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tls-certs\") pod \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") "
Jul 21 21:26:05.765069 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.764977    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86q7z\" (UniqueName: \"kubernetes.io/projected/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-kube-api-access-86q7z\") pod \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") "
Jul 21 21:26:05.765069 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.765025    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tmp-dir\") pod \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\" (UID: \"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae\") "
Jul 21 21:26:05.765257 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.765164    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-model-cache" (OuterVolumeSpecName: "model-cache") pod "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" (UID: "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:05.765441 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.765420    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-model-cache\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:05.765441 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.765419    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" (UID: "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:05.765616 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.765177    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-home" (OuterVolumeSpecName: "home") pod "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" (UID: "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:05.767468 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.767441    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-dshm" (OuterVolumeSpecName: "dshm") pod "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" (UID: "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:05.767587 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.767539    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" (UID: "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 21:26:05.767674 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.767656    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-kube-api-access-86q7z" (OuterVolumeSpecName: "kube-api-access-86q7z") pod "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" (UID: "f2f508fe-3c6f-4fff-8b7f-655a2cde6cae"). InnerVolumeSpecName "kube-api-access-86q7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:26:05.866932 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.866901    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-dshm\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:05.866932 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.866928    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-home\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:05.866932 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.866938    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tls-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:05.867162 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.866948    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86q7z\" (UniqueName: \"kubernetes.io/projected/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-kube-api-access-86q7z\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:05.867162 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:05.866957    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae-tmp-dir\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:06.121382 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.121343    2560 generic.go:356] "Generic (PLEG): container finished" podID="f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" containerID="4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290" exitCode=0
Jul 21 21:26:06.121595 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.121389    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"
Jul 21 21:26:06.121595 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.121426    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm" event={"ID":"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae","Type":"ContainerDied","Data":"4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290"}
Jul 21 21:26:06.121595 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.121470    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm" event={"ID":"f2f508fe-3c6f-4fff-8b7f-655a2cde6cae","Type":"ContainerDied","Data":"c2f227fd77530dcf32b137133c1d426bb154d26822e3fc027578055348896499"}
Jul 21 21:26:06.121595 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.121487    2560 scope.go:117] "RemoveContainer" containerID="4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290"
Jul 21 21:26:06.130850 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.130833    2560 scope.go:117] "RemoveContainer" containerID="4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290"
Jul 21 21:26:06.131137 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:26:06.131114    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290\": container with ID starting with 4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290 not found: ID does not exist" containerID="4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290"
Jul 21 21:26:06.131229 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.131149    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290"} err="failed to get container status \"4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290\": rpc error: code = NotFound desc = could not find container \"4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290\": container with ID starting with 4cc6f498d6f4ead96469b960fa02868a0349f45f0eca8a1fce8526b05635e290 not found: ID does not exist"
Jul 21 21:26:06.142957 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.142931    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"]
Jul 21 21:26:06.149307 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.149286    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0c5ebd/rate-test-model-0c5ebd-kserve-5585dcc64c-zj7rm"]
Jul 21 21:26:06.424778 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.424675    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg" podUID="64755c23-d17f-4151-91ab-2120dc66da65" containerName="main" containerID="cri-o://50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef" gracePeriod=45
Jul 21 21:26:06.498076 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.498044    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" path="/var/lib/kubelet/pods/f2f508fe-3c6f-4fff-8b7f-655a2cde6cae/volumes"
Jul 21 21:26:06.684819 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.684757    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:26:06.775144 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775107    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-model-cache\") pod \"64755c23-d17f-4151-91ab-2120dc66da65\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") "
Jul 21 21:26:06.775144 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775146    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-tmp-dir\") pod \"64755c23-d17f-4151-91ab-2120dc66da65\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") "
Jul 21 21:26:06.775421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775175    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-dshm\") pod \"64755c23-d17f-4151-91ab-2120dc66da65\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") "
Jul 21 21:26:06.775421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775226    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64755c23-d17f-4151-91ab-2120dc66da65-tls-certs\") pod \"64755c23-d17f-4151-91ab-2120dc66da65\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") "
Jul 21 21:26:06.775421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775274    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-home\") pod \"64755c23-d17f-4151-91ab-2120dc66da65\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") "
Jul 21 21:26:06.775421 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775307    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8qr2\" (UniqueName: \"kubernetes.io/projected/64755c23-d17f-4151-91ab-2120dc66da65-kube-api-access-d8qr2\") pod \"64755c23-d17f-4151-91ab-2120dc66da65\" (UID: \"64755c23-d17f-4151-91ab-2120dc66da65\") "
Jul 21 21:26:06.775610 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775452    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-model-cache" (OuterVolumeSpecName: "model-cache") pod "64755c23-d17f-4151-91ab-2120dc66da65" (UID: "64755c23-d17f-4151-91ab-2120dc66da65"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:06.775610 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775463    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "64755c23-d17f-4151-91ab-2120dc66da65" (UID: "64755c23-d17f-4151-91ab-2120dc66da65"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:06.775610 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775573    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-home" (OuterVolumeSpecName: "home") pod "64755c23-d17f-4151-91ab-2120dc66da65" (UID: "64755c23-d17f-4151-91ab-2120dc66da65"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:06.775720 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775691    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-model-cache\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:06.775720 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775712    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-tmp-dir\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:06.775786 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.775724    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-home\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:06.777661 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.777637    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64755c23-d17f-4151-91ab-2120dc66da65-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "64755c23-d17f-4151-91ab-2120dc66da65" (UID: "64755c23-d17f-4151-91ab-2120dc66da65"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 21:26:06.777756 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.777655    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64755c23-d17f-4151-91ab-2120dc66da65-kube-api-access-d8qr2" (OuterVolumeSpecName: "kube-api-access-d8qr2") pod "64755c23-d17f-4151-91ab-2120dc66da65" (UID: "64755c23-d17f-4151-91ab-2120dc66da65"). InnerVolumeSpecName "kube-api-access-d8qr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:26:06.777756 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.777639    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-dshm" (OuterVolumeSpecName: "dshm") pod "64755c23-d17f-4151-91ab-2120dc66da65" (UID: "64755c23-d17f-4151-91ab-2120dc66da65"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:06.876511 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.876475    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64755c23-d17f-4151-91ab-2120dc66da65-dshm\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:06.876511 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.876502    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64755c23-d17f-4151-91ab-2120dc66da65-tls-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:06.876511 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:06.876514    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8qr2\" (UniqueName: \"kubernetes.io/projected/64755c23-d17f-4151-91ab-2120dc66da65-kube-api-access-d8qr2\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:07.127477 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.127437    2560 generic.go:356] "Generic (PLEG): container finished" podID="64755c23-d17f-4151-91ab-2120dc66da65" containerID="50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef" exitCode=0
Jul 21 21:26:07.127477 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.127472    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"
Jul 21 21:26:07.127724 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.127506    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg" event={"ID":"64755c23-d17f-4151-91ab-2120dc66da65","Type":"ContainerDied","Data":"50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef"}
Jul 21 21:26:07.127724 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.127549    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg" event={"ID":"64755c23-d17f-4151-91ab-2120dc66da65","Type":"ContainerDied","Data":"a9d9ff0b6d16f8b020af7d407723d47f7c9b9d1d82b3feec624ee28de99f331e"}
Jul 21 21:26:07.127724 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.127566    2560 scope.go:117] "RemoveContainer" containerID="50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef"
Jul 21 21:26:07.136398 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.136377    2560 scope.go:117] "RemoveContainer" containerID="50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef"
Jul 21 21:26:07.136646 ip-10-0-134-121 kubenswrapper[2560]: E0721 21:26:07.136627    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef\": container with ID starting with 50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef not found: ID does not exist" containerID="50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef"
Jul 21 21:26:07.136715 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.136659    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef"} err="failed to get container status \"50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef\": rpc error: code = NotFound desc = could not find container \"50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef\": container with ID starting with 50fa4b54bcebd0c3c8170c61223a333c0c8171856d7317b15ff29e725a31c4ef not found: ID does not exist"
Jul 21 21:26:07.148523 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.148499    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"]
Jul 21 21:26:07.152573 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.152551    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-80e9ec/rate-test-model-80e9ec-kserve-5b578bb6b7-5ddrg"]
Jul 21 21:26:07.221290 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.221251    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7801-140225617061904"]
Jul 21 21:26:07.221711 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.221691    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" containerName="main"
Jul 21 21:26:07.221711 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.221711    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" containerName="main"
Jul 21 21:26:07.221873 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.221782    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64755c23-d17f-4151-91ab-2120dc66da65" containerName="main"
Jul 21 21:26:07.221873 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.221791    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="64755c23-d17f-4151-91ab-2120dc66da65" containerName="main"
Jul 21 21:26:07.221958 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.221874    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="64755c23-d17f-4151-91ab-2120dc66da65" containerName="main"
Jul 21 21:26:07.221958 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.221884    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2f508fe-3c6f-4fff-8b7f-655a2cde6cae" containerName="main"
Jul 21 21:26:07.226625 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.226602    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7801-140225617061904"]
Jul 21 21:26:07.226718 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.226685    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-140225617061904"
Jul 21 21:26:07.229203 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.229166    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-m67qh\""
Jul 21 21:26:07.280750 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.280724    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g5tz\" (UniqueName: \"kubernetes.io/projected/97277bc0-0fba-4671-9596-93c7055d2d3b-kube-api-access-5g5tz\") pod \"test-curl-7801-140225617061904\" (UID: \"97277bc0-0fba-4671-9596-93c7055d2d3b\") " pod="opendatahub/test-curl-7801-140225617061904"
Jul 21 21:26:07.381323 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.381235    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g5tz\" (UniqueName: \"kubernetes.io/projected/97277bc0-0fba-4671-9596-93c7055d2d3b-kube-api-access-5g5tz\") pod \"test-curl-7801-140225617061904\" (UID: \"97277bc0-0fba-4671-9596-93c7055d2d3b\") " pod="opendatahub/test-curl-7801-140225617061904"
Jul 21 21:26:07.389925 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.389890    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g5tz\" (UniqueName: \"kubernetes.io/projected/97277bc0-0fba-4671-9596-93c7055d2d3b-kube-api-access-5g5tz\") pod \"test-curl-7801-140225617061904\" (UID: \"97277bc0-0fba-4671-9596-93c7055d2d3b\") " pod="opendatahub/test-curl-7801-140225617061904"
Jul 21 21:26:07.536000 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.535966    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-140225617061904"
Jul 21 21:26:07.663272 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.663247    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7801-140225617061904"]
Jul 21 21:26:07.665847 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:26:07.665818    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97277bc0_0fba_4671_9596_93c7055d2d3b.slice/crio-825c8f40ee1d2010f18ec6d916b0ea5d0db0619e9d20dbb73bb69f1d17d58456 WatchSource:0}: Error finding container 825c8f40ee1d2010f18ec6d916b0ea5d0db0619e9d20dbb73bb69f1d17d58456: Status 404 returned error can't find the container with id 825c8f40ee1d2010f18ec6d916b0ea5d0db0619e9d20dbb73bb69f1d17d58456
Jul 21 21:26:07.667271 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:07.667254    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 21:26:08.136561 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:08.136517    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7801-140225617061904" event={"ID":"97277bc0-0fba-4671-9596-93c7055d2d3b","Type":"ContainerStarted","Data":"825c8f40ee1d2010f18ec6d916b0ea5d0db0619e9d20dbb73bb69f1d17d58456"}
Jul 21 21:26:08.497707 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:08.497683    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64755c23-d17f-4151-91ab-2120dc66da65" path="/var/lib/kubelet/pods/64755c23-d17f-4151-91ab-2120dc66da65/volumes"
Jul 21 21:26:09.143957 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:09.143926    2560 generic.go:356] "Generic (PLEG): container finished" podID="97277bc0-0fba-4671-9596-93c7055d2d3b" containerID="35be022fed0c719ae003d0e6c6d7b4f6d811e544f3e4eab75a32e7a3d240795f" exitCode=0
Jul 21 21:26:09.144354 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:09.144009    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7801-140225617061904" event={"ID":"97277bc0-0fba-4671-9596-93c7055d2d3b","Type":"ContainerDied","Data":"35be022fed0c719ae003d0e6c6d7b4f6d811e544f3e4eab75a32e7a3d240795f"}
Jul 21 21:26:10.277887 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.277861    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-140225617061904"
Jul 21 21:26:10.307487 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.307453    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g5tz\" (UniqueName: \"kubernetes.io/projected/97277bc0-0fba-4671-9596-93c7055d2d3b-kube-api-access-5g5tz\") pod \"97277bc0-0fba-4671-9596-93c7055d2d3b\" (UID: \"97277bc0-0fba-4671-9596-93c7055d2d3b\") "
Jul 21 21:26:10.309799 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.309766    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97277bc0-0fba-4671-9596-93c7055d2d3b-kube-api-access-5g5tz" (OuterVolumeSpecName: "kube-api-access-5g5tz") pod "97277bc0-0fba-4671-9596-93c7055d2d3b" (UID: "97277bc0-0fba-4671-9596-93c7055d2d3b"). InnerVolumeSpecName "kube-api-access-5g5tz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:26:10.312921 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.312892    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7801-140225617061904_97277bc0-0fba-4671-9596-93c7055d2d3b/test-curl-7801-140225617061904/0.log"
Jul 21 21:26:10.334859 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.334823    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7801-140225617061904"]
Jul 21 21:26:10.338416 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.338391    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7801-140225617061904"]
Jul 21 21:26:10.408472 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.408392    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g5tz\" (UniqueName: \"kubernetes.io/projected/97277bc0-0fba-4671-9596-93c7055d2d3b-kube-api-access-5g5tz\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:10.497256 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.497220    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97277bc0-0fba-4671-9596-93c7055d2d3b" path="/var/lib/kubelet/pods/97277bc0-0fba-4671-9596-93c7055d2d3b/volumes"
Jul 21 21:26:10.533593 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.533562    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"]
Jul 21 21:26:10.533939 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.533927    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97277bc0-0fba-4671-9596-93c7055d2d3b" containerName="test-curl-7801-140225617061904"
Jul 21 21:26:10.533991 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.533940    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="97277bc0-0fba-4671-9596-93c7055d2d3b" containerName="test-curl-7801-140225617061904"
Jul 21 21:26:10.534029 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.534002    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="97277bc0-0fba-4671-9596-93c7055d2d3b" containerName="test-curl-7801-140225617061904"
Jul 21 21:26:10.537088 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.537071    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"
Jul 21 21:26:10.539442 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.539427    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmths\""
Jul 21 21:26:10.539524 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.539453    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 21:26:10.544345 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.544319    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"]
Jul 21 21:26:10.610816 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.610782    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d585eb43-93b8-415a-988b-bf5c9ca6a453-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl\" (UID: \"d585eb43-93b8-415a-988b-bf5c9ca6a453\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"
Jul 21 21:26:10.711676 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.711600    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d585eb43-93b8-415a-988b-bf5c9ca6a453-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl\" (UID: \"d585eb43-93b8-415a-988b-bf5c9ca6a453\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"
Jul 21 21:26:10.712226 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.712209    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d585eb43-93b8-415a-988b-bf5c9ca6a453-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl\" (UID: \"d585eb43-93b8-415a-988b-bf5c9ca6a453\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"
Jul 21 21:26:10.848956 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:10.848926    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"
Jul 21 21:26:11.155453 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:11.155420    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7801-140225617061904"
Jul 21 21:26:11.155645 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:11.155467    2560 scope.go:117] "RemoveContainer" containerID="35be022fed0c719ae003d0e6c6d7b4f6d811e544f3e4eab75a32e7a3d240795f"
Jul 21 21:26:11.187392 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:11.187358    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"]
Jul 21 21:26:11.189813 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:26:11.189782    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd585eb43_93b8_415a_988b_bf5c9ca6a453.slice/crio-12dbcf8c8247897d50d7f83bcbacfd21754c8a3f43845c1456f7c0231dde0d08 WatchSource:0}: Error finding container 12dbcf8c8247897d50d7f83bcbacfd21754c8a3f43845c1456f7c0231dde0d08: Status 404 returned error can't find the container with id 12dbcf8c8247897d50d7f83bcbacfd21754c8a3f43845c1456f7c0231dde0d08
Jul 21 21:26:12.163707 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:12.163607    2560 generic.go:356] "Generic (PLEG): container finished" podID="d585eb43-93b8-415a-988b-bf5c9ca6a453" containerID="791095bd85a3ec0b998e90384d253fc186b33c96cea573acbddb1d56ef77e2aa" exitCode=0
Jul 21 21:26:12.163707 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:12.163669    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl" event={"ID":"d585eb43-93b8-415a-988b-bf5c9ca6a453","Type":"ContainerDied","Data":"791095bd85a3ec0b998e90384d253fc186b33c96cea573acbddb1d56ef77e2aa"}
Jul 21 21:26:12.163707 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:12.163705    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl" event={"ID":"d585eb43-93b8-415a-988b-bf5c9ca6a453","Type":"ContainerStarted","Data":"12dbcf8c8247897d50d7f83bcbacfd21754c8a3f43845c1456f7c0231dde0d08"}
Jul 21 21:26:13.306411 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:13.306390    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"
Jul 21 21:26:13.438926 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:13.438830    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d585eb43-93b8-415a-988b-bf5c9ca6a453-maas-api-service-ca\") pod \"d585eb43-93b8-415a-988b-bf5c9ca6a453\" (UID: \"d585eb43-93b8-415a-988b-bf5c9ca6a453\") "
Jul 21 21:26:13.439215 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:13.439136    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d585eb43-93b8-415a-988b-bf5c9ca6a453-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d585eb43-93b8-415a-988b-bf5c9ca6a453" (UID: "d585eb43-93b8-415a-988b-bf5c9ca6a453"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:26:13.439285 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:13.439257    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d585eb43-93b8-415a-988b-bf5c9ca6a453-maas-api-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:14.174667 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:14.174638    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"
Jul 21 21:26:14.174907 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:14.174635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl" event={"ID":"d585eb43-93b8-415a-988b-bf5c9ca6a453","Type":"ContainerDied","Data":"12dbcf8c8247897d50d7f83bcbacfd21754c8a3f43845c1456f7c0231dde0d08"}
Jul 21 21:26:14.174907 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:14.174765    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12dbcf8c8247897d50d7f83bcbacfd21754c8a3f43845c1456f7c0231dde0d08"
Jul 21 21:26:23.798620 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:23.798582    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:26:25.631434 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:25.631396    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"]
Jul 21 21:26:25.635139 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:25.635113    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0c5ebd-f7znl"]
Jul 21 21:26:26.498547 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:26.498513    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d585eb43-93b8-415a-988b-bf5c9ca6a453" path="/var/lib/kubelet/pods/d585eb43-93b8-415a-988b-bf5c9ca6a453/volumes"
Jul 21 21:26:32.168551 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.168515    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"]
Jul 21 21:26:32.168953 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.168859    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy" containerID="cri-o://b76fe4b816775c885044ce45a0fe509c543ac035b947e5c70243cb220bed44b8" gracePeriod=30
Jul 21 21:26:32.539867 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.539790    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"]
Jul 21 21:26:32.540146 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.540135    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d585eb43-93b8-415a-988b-bf5c9ca6a453" containerName="revoke-keys"
Jul 21 21:26:32.540213 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.540148    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d585eb43-93b8-415a-988b-bf5c9ca6a453" containerName="revoke-keys"
Jul 21 21:26:32.540274 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.540264    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d585eb43-93b8-415a-988b-bf5c9ca6a453" containerName="revoke-keys"
Jul 21 21:26:32.543746 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.543725    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"
Jul 21 21:26:32.546194 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.546162    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 21:26:32.546291 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.546176    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zmths\""
Jul 21 21:26:32.553040 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.553015    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"]
Jul 21 21:26:32.720974 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.720937    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b2167d-280e-482a-b81e-5434aff4cc8a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4\" (UID: \"c3b2167d-280e-482a-b81e-5434aff4cc8a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"
Jul 21 21:26:32.821610 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.821575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b2167d-280e-482a-b81e-5434aff4cc8a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4\" (UID: \"c3b2167d-280e-482a-b81e-5434aff4cc8a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"
Jul 21 21:26:32.822227 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.822175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b2167d-280e-482a-b81e-5434aff4cc8a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4\" (UID: \"c3b2167d-280e-482a-b81e-5434aff4cc8a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"
Jul 21 21:26:32.854607 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.854583    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"
Jul 21 21:26:32.987004 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:32.986977    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"]
Jul 21 21:26:32.988590 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:26:32.988565    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3b2167d_280e_482a_b81e_5434aff4cc8a.slice/crio-a56b4792de07d8095aad4ef31641b41ebddc76fadf5a63e47cb197d8faa7e328 WatchSource:0}: Error finding container a56b4792de07d8095aad4ef31641b41ebddc76fadf5a63e47cb197d8faa7e328: Status 404 returned error can't find the container with id a56b4792de07d8095aad4ef31641b41ebddc76fadf5a63e47cb197d8faa7e328
Jul 21 21:26:33.271378 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:33.271342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4" event={"ID":"c3b2167d-280e-482a-b81e-5434aff4cc8a","Type":"ContainerStarted","Data":"db035b81a7ab83ecf4d7c30cb88f2b0b407e96c62f63937ab3094c3c4389b8c7"}
Jul 21 21:26:33.271740 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:33.271405    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4" event={"ID":"c3b2167d-280e-482a-b81e-5434aff4cc8a","Type":"ContainerStarted","Data":"a56b4792de07d8095aad4ef31641b41ebddc76fadf5a63e47cb197d8faa7e328"}
Jul 21 21:26:33.291760 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:33.291713    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4" podStartSLOduration=1.291696793 podStartE2EDuration="1.291696793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:26:33.29044654 +0000 UTC m=+2819.310855004" watchObservedRunningTime="2026-07-21 21:26:33.291696793 +0000 UTC m=+2819.312105256"
Jul 21 21:26:34.277583 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:34.277552    2560 generic.go:356] "Generic (PLEG): container finished" podID="c3b2167d-280e-482a-b81e-5434aff4cc8a" containerID="db035b81a7ab83ecf4d7c30cb88f2b0b407e96c62f63937ab3094c3c4389b8c7" exitCode=0
Jul 21 21:26:34.277987 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:34.277593    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4" event={"ID":"c3b2167d-280e-482a-b81e-5434aff4cc8a","Type":"ContainerDied","Data":"db035b81a7ab83ecf4d7c30cb88f2b0b407e96c62f63937ab3094c3c4389b8c7"}
Jul 21 21:26:34.887282 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:34.887249    2560 scope.go:117] "RemoveContainer" containerID="37dc2e986e3159fd961c375a534e3f0b75241340d2196f12cf1520942f96fe5c"
Jul 21 21:26:35.415539 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:35.415515    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"
Jul 21 21:26:35.546813 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:35.546717    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b2167d-280e-482a-b81e-5434aff4cc8a-maas-api-service-ca\") pod \"c3b2167d-280e-482a-b81e-5434aff4cc8a\" (UID: \"c3b2167d-280e-482a-b81e-5434aff4cc8a\") "
Jul 21 21:26:35.547053 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:35.547031    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3b2167d-280e-482a-b81e-5434aff4cc8a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c3b2167d-280e-482a-b81e-5434aff4cc8a" (UID: "c3b2167d-280e-482a-b81e-5434aff4cc8a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:26:35.647566 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:35.647525    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b2167d-280e-482a-b81e-5434aff4cc8a-maas-api-service-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:36.288173 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:36.288136    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4" event={"ID":"c3b2167d-280e-482a-b81e-5434aff4cc8a","Type":"ContainerDied","Data":"a56b4792de07d8095aad4ef31641b41ebddc76fadf5a63e47cb197d8faa7e328"}
Jul 21 21:26:36.288173 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:36.288168    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"
Jul 21 21:26:36.288387 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:36.288202    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a56b4792de07d8095aad4ef31641b41ebddc76fadf5a63e47cb197d8faa7e328"
Jul 21 21:26:37.296333 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.296292    2560 generic.go:356] "Generic (PLEG): container finished" podID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerID="b76fe4b816775c885044ce45a0fe509c543ac035b947e5c70243cb220bed44b8" exitCode=0
Jul 21 21:26:37.296333 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.296323    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" event={"ID":"1c3f6c2a-0025-466f-988c-d38611ceb44d","Type":"ContainerDied","Data":"b76fe4b816775c885044ce45a0fe509c543ac035b947e5c70243cb220bed44b8"}
Jul 21 21:26:37.296717 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.296390    2560 scope.go:117] "RemoveContainer" containerID="77d2cd9667467d27f1fbce2838e613f1f9f49b2f8e7ab78f2243a4dd6d3cd39e"
Jul 21 21:26:37.426414 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.426392    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:26:37.563716 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.563688    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-credential-socket\") pod \"1c3f6c2a-0025-466f-988c-d38611ceb44d\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") "
Jul 21 21:26:37.563895 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.563732    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-podinfo\") pod \"1c3f6c2a-0025-466f-988c-d38611ceb44d\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") "
Jul 21 21:26:37.563895 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.563756    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-certs\") pod \"1c3f6c2a-0025-466f-988c-d38611ceb44d\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") "
Jul 21 21:26:37.563895 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.563785    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3f6c2a-0025-466f-988c-d38611ceb44d-istiod-ca-cert\") pod \"1c3f6c2a-0025-466f-988c-d38611ceb44d\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") "
Jul 21 21:26:37.563895 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.563807    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-socket\") pod \"1c3f6c2a-0025-466f-988c-d38611ceb44d\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") "
Jul 21 21:26:37.563895 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.563835    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-token\") pod \"1c3f6c2a-0025-466f-988c-d38611ceb44d\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") "
Jul 21 21:26:37.563895 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.563855    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-envoy\") pod \"1c3f6c2a-0025-466f-988c-d38611ceb44d\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") "
Jul 21 21:26:37.563895 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.563894    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-data\") pod \"1c3f6c2a-0025-466f-988c-d38611ceb44d\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") "
Jul 21 21:26:37.564301 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.563931    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8nwm\" (UniqueName: \"kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-kube-api-access-b8nwm\") pod \"1c3f6c2a-0025-466f-988c-d38611ceb44d\" (UID: \"1c3f6c2a-0025-466f-988c-d38611ceb44d\") "
Jul 21 21:26:37.564301 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.564002    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c3f6c2a-0025-466f-988c-d38611ceb44d" (UID: "1c3f6c2a-0025-466f-988c-d38611ceb44d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:37.564301 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.564230    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c3f6c2a-0025-466f-988c-d38611ceb44d" (UID: "1c3f6c2a-0025-466f-988c-d38611ceb44d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:37.564301 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.564242    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c3f6c2a-0025-466f-988c-d38611ceb44d" (UID: "1c3f6c2a-0025-466f-988c-d38611ceb44d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:37.564301 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.564277    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:37.564539 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.564325    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c3f6c2a-0025-466f-988c-d38611ceb44d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c3f6c2a-0025-466f-988c-d38611ceb44d" (UID: "1c3f6c2a-0025-466f-988c-d38611ceb44d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 21:26:37.564918 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.564897    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c3f6c2a-0025-466f-988c-d38611ceb44d" (UID: "1c3f6c2a-0025-466f-988c-d38611ceb44d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:37.566324 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.566290    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-kube-api-access-b8nwm" (OuterVolumeSpecName: "kube-api-access-b8nwm") pod "1c3f6c2a-0025-466f-988c-d38611ceb44d" (UID: "1c3f6c2a-0025-466f-988c-d38611ceb44d"). InnerVolumeSpecName "kube-api-access-b8nwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:26:37.566324 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.566297    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c3f6c2a-0025-466f-988c-d38611ceb44d" (UID: "1c3f6c2a-0025-466f-988c-d38611ceb44d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 21:26:37.566474 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.566442    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c3f6c2a-0025-466f-988c-d38611ceb44d" (UID: "1c3f6c2a-0025-466f-988c-d38611ceb44d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 21 21:26:37.566474 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.566453    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c3f6c2a-0025-466f-988c-d38611ceb44d" (UID: "1c3f6c2a-0025-466f-988c-d38611ceb44d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 21:26:37.665247 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.665212    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:37.665247 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.665243    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3f6c2a-0025-466f-988c-d38611ceb44d-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:37.665409 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.665256    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:37.665409 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.665271    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:37.665409 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.665284    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:37.665409 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.665295    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:37.665409 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.665306    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8nwm\" (UniqueName: \"kubernetes.io/projected/1c3f6c2a-0025-466f-988c-d38611ceb44d-kube-api-access-b8nwm\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:37.665409 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:37.665318    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3f6c2a-0025-466f-988c-d38611ceb44d-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 21 21:26:38.303010 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:38.302977    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"
Jul 21 21:26:38.303448 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:38.303017    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5" event={"ID":"1c3f6c2a-0025-466f-988c-d38611ceb44d","Type":"ContainerDied","Data":"a2c38e1d12e0a08b72fd180d659c216d78e7ded56d1b0112dae89a16d9c652c4"}
Jul 21 21:26:38.303448 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:38.303076    2560 scope.go:117] "RemoveContainer" containerID="b76fe4b816775c885044ce45a0fe509c543ac035b947e5c70243cb220bed44b8"
Jul 21 21:26:38.325277 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:38.325246    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"]
Jul 21 21:26:38.330155 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:38.330130    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0c5ebd-openshift-default-657fd64dff-4nbw5"]
Jul 21 21:26:38.497241 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:38.497180    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" path="/var/lib/kubelet/pods/1c3f6c2a-0025-466f-988c-d38611ceb44d/volumes"
Jul 21 21:26:46.097664 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:46.097623    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mh7g8"]
Jul 21 21:26:47.635244 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:47.635200    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"]
Jul 21 21:26:47.639524 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:47.639501    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-80e9ec-ztqz4"]
Jul 21 21:26:48.497131 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:26:48.497090    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3b2167d-280e-482a-b81e-5434aff4cc8a" path="/var/lib/kubelet/pods/c3b2167d-280e-482a-b81e-5434aff4cc8a/volumes"
Jul 21 21:27:01.192098 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:01.192064    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-49cml_29e3913a-b89c-48b7-9cf2-95eef8b1fd8b/manager/0.log"
Jul 21 21:27:01.832277 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:01.832241    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647bdf6675-4d7pt_11751f16-0e4e-4904-9cd8-d428de2dd34a/copy-manifests/0.log"
Jul 21 21:27:01.839584 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:01.839556    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647bdf6675-4d7pt_11751f16-0e4e-4904-9cd8-d428de2dd34a/manager/0.log"
Jul 21 21:27:02.746694 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:02.746655    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744475-h494c_0a3be218-9900-4aa5-a2b1-3f6ddca9a0c4/cleanup/0.log"
Jul 21 21:27:04.431294 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:04.431262    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d4c8b_90a4f073-10d2-4ca2-80c9-150ff1471e9a/manager/0.log"
Jul 21 21:27:04.810760 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:04.810731    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xf4pd_50cf08c1-edca-4922-806e-1810c8251a98/registry-server/0.log"
Jul 21 21:27:05.075837 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:05.075752    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mh7g8_a7b76d39-116b-4bbb-b06d-e41908a9439a/limitador/0.log"
Jul 21 21:27:05.204267 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:05.204236    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mdbgx_cd38af5b-5544-4574-95c4-f429738d9125/manager/0.log"
Jul 21 21:27:05.567906 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:05.567870    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42hn98_a83dfd72-d4cd-409b-9496-828fd4f3153f/istio-proxy/0.log"
Jul 21 21:27:06.426538 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:06.426503    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-858667f5f4-smlg6_ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b/router/0.log"
Jul 21 21:27:13.712546 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.712511    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-75fnx/must-gather-4c8lz"]
Jul 21 21:27:13.712922 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.712852    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3b2167d-280e-482a-b81e-5434aff4cc8a" containerName="revoke-keys"
Jul 21 21:27:13.712922 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.712864    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3b2167d-280e-482a-b81e-5434aff4cc8a" containerName="revoke-keys"
Jul 21 21:27:13.712922 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.712874    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy"
Jul 21 21:27:13.712922 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.712880    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy"
Jul 21 21:27:13.713110 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.712948    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy"
Jul 21 21:27:13.713110 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.712960    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy"
Jul 21 21:27:13.713110 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.712967    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3b2167d-280e-482a-b81e-5434aff4cc8a" containerName="revoke-keys"
Jul 21 21:27:13.713110 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.713040    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy"
Jul 21 21:27:13.713110 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.713046    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3f6c2a-0025-466f-988c-d38611ceb44d" containerName="istio-proxy"
Jul 21 21:27:13.717387 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.717367    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-75fnx/must-gather-4c8lz"
Jul 21 21:27:13.719942 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.719915    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-75fnx\"/\"openshift-service-ca.crt\""
Jul 21 21:27:13.720060 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.719921    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-75fnx\"/\"default-dockercfg-6ncg2\""
Jul 21 21:27:13.720571 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.720551    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-75fnx\"/\"kube-root-ca.crt\""
Jul 21 21:27:13.725257 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.725237    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-75fnx/must-gather-4c8lz"]
Jul 21 21:27:13.895992 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.895953    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3d6eb118-6652-4e6f-91b2-5017f3858028-must-gather-output\") pod \"must-gather-4c8lz\" (UID: \"3d6eb118-6652-4e6f-91b2-5017f3858028\") " pod="openshift-must-gather-75fnx/must-gather-4c8lz"
Jul 21 21:27:13.896163 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.896003    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lggxc\" (UniqueName: \"kubernetes.io/projected/3d6eb118-6652-4e6f-91b2-5017f3858028-kube-api-access-lggxc\") pod \"must-gather-4c8lz\" (UID: \"3d6eb118-6652-4e6f-91b2-5017f3858028\") " pod="openshift-must-gather-75fnx/must-gather-4c8lz"
Jul 21 21:27:13.997086 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.997001    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lggxc\" (UniqueName: \"kubernetes.io/projected/3d6eb118-6652-4e6f-91b2-5017f3858028-kube-api-access-lggxc\") pod \"must-gather-4c8lz\" (UID: \"3d6eb118-6652-4e6f-91b2-5017f3858028\") " pod="openshift-must-gather-75fnx/must-gather-4c8lz"
Jul 21 21:27:13.997244 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.997113    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3d6eb118-6652-4e6f-91b2-5017f3858028-must-gather-output\") pod \"must-gather-4c8lz\" (UID: \"3d6eb118-6652-4e6f-91b2-5017f3858028\") " pod="openshift-must-gather-75fnx/must-gather-4c8lz"
Jul 21 21:27:13.997419 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:13.997403    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3d6eb118-6652-4e6f-91b2-5017f3858028-must-gather-output\") pod \"must-gather-4c8lz\" (UID: \"3d6eb118-6652-4e6f-91b2-5017f3858028\") " pod="openshift-must-gather-75fnx/must-gather-4c8lz"
Jul 21 21:27:14.006221 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:14.006179    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lggxc\" (UniqueName: \"kubernetes.io/projected/3d6eb118-6652-4e6f-91b2-5017f3858028-kube-api-access-lggxc\") pod \"must-gather-4c8lz\" (UID: \"3d6eb118-6652-4e6f-91b2-5017f3858028\") " pod="openshift-must-gather-75fnx/must-gather-4c8lz"
Jul 21 21:27:14.026981 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:14.026953    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-75fnx/must-gather-4c8lz"
Jul 21 21:27:14.158129 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:14.158099    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-75fnx/must-gather-4c8lz"]
Jul 21 21:27:14.161652 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:27:14.161630    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d6eb118_6652_4e6f_91b2_5017f3858028.slice/crio-e37ceaf091e85ca32d58ebe6c9910a1e13c861923ea1d8ff34c5518f4807ddc8 WatchSource:0}: Error finding container e37ceaf091e85ca32d58ebe6c9910a1e13c861923ea1d8ff34c5518f4807ddc8: Status 404 returned error can't find the container with id e37ceaf091e85ca32d58ebe6c9910a1e13c861923ea1d8ff34c5518f4807ddc8
Jul 21 21:27:14.483874 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:14.483843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-75fnx/must-gather-4c8lz" event={"ID":"3d6eb118-6652-4e6f-91b2-5017f3858028","Type":"ContainerStarted","Data":"e37ceaf091e85ca32d58ebe6c9910a1e13c861923ea1d8ff34c5518f4807ddc8"}
Jul 21 21:27:15.492726 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:15.492685    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-75fnx/must-gather-4c8lz" event={"ID":"3d6eb118-6652-4e6f-91b2-5017f3858028","Type":"ContainerStarted","Data":"2b11e2afb6f7a2eb77592a0e9b89211acf8397240113850196ad8c077c10e603"}
Jul 21 21:27:15.492726 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:15.492727    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-75fnx/must-gather-4c8lz" event={"ID":"3d6eb118-6652-4e6f-91b2-5017f3858028","Type":"ContainerStarted","Data":"90f6e175b279b448f3f45c68d08c8b9d16626d88c0fc445a47b01211f95c805b"}
Jul 21 21:27:15.509627 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:15.509573    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-75fnx/must-gather-4c8lz" podStartSLOduration=1.6558410810000002 podStartE2EDuration="2.509556167s" totalImagesPullingTime="853.715086ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 21:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:27:15.508444502 +0000 UTC m=+2861.528852966" watchObservedRunningTime="2026-07-21 21:27:15.509556167 +0000 UTC m=+2861.529964630"
Jul 21 21:27:16.659913 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:16.659865    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qs2qx_734e584c-d5a4-47a4-b073-00fe97a35f37/global-pull-secret-syncer/0.log"
Jul 21 21:27:16.783782 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:16.783736    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wxbfz_51d7a014-3816-4594-bfaf-075941847018/konnectivity-agent/0.log"
Jul 21 21:27:16.856950 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:16.856923    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-121.ec2.internal_e39b9f23455a45c102012bdb6cd46aeb/haproxy/0.log"
Jul 21 21:27:21.146349 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:21.146165    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d4c8b_90a4f073-10d2-4ca2-80c9-150ff1471e9a/manager/0.log"
Jul 21 21:27:21.272330 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:21.272292    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xf4pd_50cf08c1-edca-4922-806e-1810c8251a98/registry-server/0.log"
Jul 21 21:27:21.470552 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:21.467329    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mh7g8_a7b76d39-116b-4bbb-b06d-e41908a9439a/limitador/0.log"
Jul 21 21:27:21.553736 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:21.553678    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mdbgx_cd38af5b-5544-4574-95c4-f429738d9125/manager/0.log"
Jul 21 21:27:23.436714 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:23.436685    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-627hl_6ceef5da-a77f-4254-a857-b151c1c34c96/kube-state-metrics/0.log"
Jul 21 21:27:23.456786 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:23.456744    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-627hl_6ceef5da-a77f-4254-a857-b151c1c34c96/kube-rbac-proxy-main/0.log"
Jul 21 21:27:23.482648 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:23.482605    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-627hl_6ceef5da-a77f-4254-a857-b151c1c34c96/kube-rbac-proxy-self/0.log"
Jul 21 21:27:23.511756 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:23.511730    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-87764c7ff-zdfk6_15e98367-9089-48e7-9b19-84258f2f995d/metrics-server/0.log"
Jul 21 21:27:23.540764 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:23.540738    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-rn5gr_d5150880-e508-4073-8e80-d288c6236d21/monitoring-plugin/0.log"
Jul 21 21:27:23.590668 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:23.590640    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7s7hw_f2aff829-77be-4510-bca7-37840fc5e7b2/node-exporter/0.log"
Jul 21 21:27:23.617345 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:23.617311    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7s7hw_f2aff829-77be-4510-bca7-37840fc5e7b2/kube-rbac-proxy/0.log"
Jul 21 21:27:23.640404 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:23.640313    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7s7hw_f2aff829-77be-4510-bca7-37840fc5e7b2/init-textfile/0.log"
Jul 21 21:27:23.966740 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:23.966602    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_55dd9a73-4dfd-4601-926f-0fc553434e22/prometheus/0.log"
Jul 21 21:27:23.994433 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:23.994403    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_55dd9a73-4dfd-4601-926f-0fc553434e22/config-reloader/0.log"
Jul 21 21:27:24.029207 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:24.028354    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_55dd9a73-4dfd-4601-926f-0fc553434e22/thanos-sidecar/0.log"
Jul 21 21:27:24.061745 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:24.061689    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_55dd9a73-4dfd-4601-926f-0fc553434e22/kube-rbac-proxy-web/0.log"
Jul 21 21:27:24.087601 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:24.087569    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_55dd9a73-4dfd-4601-926f-0fc553434e22/kube-rbac-proxy/0.log"
Jul 21 21:27:24.137733 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:24.137694    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_55dd9a73-4dfd-4601-926f-0fc553434e22/kube-rbac-proxy-thanos/0.log"
Jul 21 21:27:24.194337 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:24.194306    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_55dd9a73-4dfd-4601-926f-0fc553434e22/init-config-reloader/0.log"
Jul 21 21:27:24.256523 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:24.256490    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-pwp2c_d9b1384b-6791-4ea2-a913-866e5fb4eeff/prometheus-operator/0.log"
Jul 21 21:27:24.291008 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:24.290968    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-pwp2c_d9b1384b-6791-4ea2-a913-866e5fb4eeff/kube-rbac-proxy/0.log"
Jul 21 21:27:24.321718 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:24.321686    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-2d2qx_8d85b877-8d6c-40d5-98e4-77128dd846ef/prometheus-operator-admission-webhook/0.log"
Jul 21 21:27:26.523109 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:26.523078    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/1.log"
Jul 21 21:27:26.529634 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:26.529593    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-clm54_3406f6f7-46e6-481a-9a7d-3d30ce70130d/console-operator/2.log"
Jul 21 21:27:27.075742 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.075708    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b9995ff55-2qtqg_5821f194-fc0a-4e0a-8c6a-82f5090fc635/console/0.log"
Jul 21 21:27:27.113756 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.113674    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-fljcg_e6930338-b310-4e27-a51d-353a3df90ffc/download-server/0.log"
Jul 21 21:27:27.498321 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.498243    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"]
Jul 21 21:27:27.506072 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.506043    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.512230 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.512175    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"]
Jul 21 21:27:27.540623 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.540584    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-lib-modules\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.541170 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.541144    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-proc\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.541341 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.541326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-sys\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.541518 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.541503    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4bzw\" (UniqueName: \"kubernetes.io/projected/7890b4db-49c3-4413-8180-c648b865d8ef-kube-api-access-s4bzw\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.541650 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.541635    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-podres\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.642782 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.642744    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4bzw\" (UniqueName: \"kubernetes.io/projected/7890b4db-49c3-4413-8180-c648b865d8ef-kube-api-access-s4bzw\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.643111 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.643090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-podres\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.643302 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.643278    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-podres\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.643450 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.643431    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-lib-modules\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.643749 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.643730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-proc\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.643880 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.643857    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-proc\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.644049 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.643880    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-sys\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.644245 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.643920    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-lib-modules\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.644361 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.643975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7890b4db-49c3-4413-8180-c648b865d8ef-sys\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.652419 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.652393    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4bzw\" (UniqueName: \"kubernetes.io/projected/7890b4db-49c3-4413-8180-c648b865d8ef-kube-api-access-s4bzw\") pod \"perf-node-gather-daemonset-65rs4\" (UID: \"7890b4db-49c3-4413-8180-c648b865d8ef\") " pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.819793 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.819759    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:27.887561 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:27.887513    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-k7k2l_6a47c153-818b-49de-9cde-ccb74a18f9b0/volume-data-source-validator/0.log"
Jul 21 21:27:28.005149 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:28.003408    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"]
Jul 21 21:27:28.008218 ip-10-0-134-121 kubenswrapper[2560]: W0721 21:27:28.007817    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7890b4db_49c3_4413_8180_c648b865d8ef.slice/crio-695cdad4a5e7f641857225bdb7f59e4df9da5624d97407d4850db8025a0488cc WatchSource:0}: Error finding container 695cdad4a5e7f641857225bdb7f59e4df9da5624d97407d4850db8025a0488cc: Status 404 returned error can't find the container with id 695cdad4a5e7f641857225bdb7f59e4df9da5624d97407d4850db8025a0488cc
Jul 21 21:27:28.598312 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:28.598247    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4" event={"ID":"7890b4db-49c3-4413-8180-c648b865d8ef","Type":"ContainerStarted","Data":"b78dbb9cd9e0876c067742e3bfd94acb4f8a9543cae850b530b65317ef8fc076"}
Jul 21 21:27:28.598772 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:28.598385    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:28.598772 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:28.598433    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4" event={"ID":"7890b4db-49c3-4413-8180-c648b865d8ef","Type":"ContainerStarted","Data":"695cdad4a5e7f641857225bdb7f59e4df9da5624d97407d4850db8025a0488cc"}
Jul 21 21:27:28.616908 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:28.616846    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4" podStartSLOduration=1.616825256 podStartE2EDuration="1.616825256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 21:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 21:27:28.614268139 +0000 UTC m=+2874.634676602" watchObservedRunningTime="2026-07-21 21:27:28.616825256 +0000 UTC m=+2874.637233721"
Jul 21 21:27:29.042084 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:29.042005    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p2mfz_790e4ae8-009b-4a5d-8cb4-7eea0cb22d41/dns/0.log"
Jul 21 21:27:29.064207 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:29.064164    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p2mfz_790e4ae8-009b-4a5d-8cb4-7eea0cb22d41/kube-rbac-proxy/0.log"
Jul 21 21:27:29.184546 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:29.184509    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zhm2n_23a0b2eb-4908-4197-acb7-11dfe462f642/dns-node-resolver/0.log"
Jul 21 21:27:29.741630 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:29.741599    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4mcr8_ad08e483-50bc-440d-8a37-7b47614c25aa/node-ca/0.log"
Jul 21 21:27:30.720631 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:30.720592    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42hn98_a83dfd72-d4cd-409b-9496-828fd4f3153f/istio-proxy/0.log"
Jul 21 21:27:31.037573 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:31.037486    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-858667f5f4-smlg6_ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b/router/0.log"
Jul 21 21:27:31.749139 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:31.749107    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ckl2m_7f7626cf-986d-42d3-8614-28c140d2491f/serve-healthcheck-canary/0.log"
Jul 21 21:27:32.402389 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:32.402357    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hbxk8_e9cddf20-eb0c-4623-b217-7b1fc6aee91b/kube-rbac-proxy/0.log"
Jul 21 21:27:32.425785 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:32.425753    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hbxk8_e9cddf20-eb0c-4623-b217-7b1fc6aee91b/exporter/0.log"
Jul 21 21:27:32.449090 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:32.449062    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hbxk8_e9cddf20-eb0c-4623-b217-7b1fc6aee91b/extractor/0.log"
Jul 21 21:27:34.615904 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:34.615872    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-75fnx/perf-node-gather-daemonset-65rs4"
Jul 21 21:27:34.623480 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:34.623453    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-49cml_29e3913a-b89c-48b7-9cf2-95eef8b1fd8b/manager/0.log"
Jul 21 21:27:35.036233 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:35.036160    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647bdf6675-4d7pt_11751f16-0e4e-4904-9cd8-d428de2dd34a/manager/0.log"
Jul 21 21:27:35.057794 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:35.057750    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-647bdf6675-4d7pt_11751f16-0e4e-4904-9cd8-d428de2dd34a/copy-manifests/0.log"
Jul 21 21:27:36.515993 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:36.515956    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66f9b7665f-bfsj2_3958f856-4f5a-49fb-b430-a23e9440e12e/manager/0.log"
Jul 21 21:27:36.545102 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:36.545061    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9lg6z_690fe550-c0c8-42bf-981b-897c18b2972c/openshift-lws-operator/0.log"
Jul 21 21:27:37.189350 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:37.189320    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42hn98_a83dfd72-d4cd-409b-9496-828fd4f3153f/istio-proxy/0.log"
Jul 21 21:27:37.453462 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:37.453434    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-858667f5f4-smlg6_ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b/router/0.log"
Jul 21 21:27:38.643329 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:38.643295    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf42hn98_a83dfd72-d4cd-409b-9496-828fd4f3153f/istio-proxy/0.log"
Jul 21 21:27:38.915983 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:38.915876    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-858667f5f4-smlg6_ea61a2d0-1cb4-49a1-9ce7-a6d7d66ea13b/router/0.log"
Jul 21 21:27:42.233729 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:42.233670    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-cjgjq_d8ca0682-3f4e-422a-943b-7f345b0716e2/kube-storage-version-migrator-operator/1.log"
Jul 21 21:27:42.235009 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:42.234946    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-cjgjq_d8ca0682-3f4e-422a-943b-7f345b0716e2/kube-storage-version-migrator-operator/0.log"
Jul 21 21:27:43.402580 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:43.402550    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvsbr_8bc46535-1233-48ac-a6be-ebb82083e332/kube-multus-additional-cni-plugins/0.log"
Jul 21 21:27:43.425819 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:43.425794    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvsbr_8bc46535-1233-48ac-a6be-ebb82083e332/egress-router-binary-copy/0.log"
Jul 21 21:27:43.448101 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:43.448076    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvsbr_8bc46535-1233-48ac-a6be-ebb82083e332/cni-plugins/0.log"
Jul 21 21:27:43.469159 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:43.469132    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvsbr_8bc46535-1233-48ac-a6be-ebb82083e332/bond-cni-plugin/0.log"
Jul 21 21:27:43.489835 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:43.489803    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvsbr_8bc46535-1233-48ac-a6be-ebb82083e332/routeoverride-cni/0.log"
Jul 21 21:27:43.512321 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:43.512295    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvsbr_8bc46535-1233-48ac-a6be-ebb82083e332/whereabouts-cni-bincopy/0.log"
Jul 21 21:27:43.532389 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:43.532363    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lvsbr_8bc46535-1233-48ac-a6be-ebb82083e332/whereabouts-cni/0.log"
Jul 21 21:27:43.753311 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:43.753232    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pnwmz_d1f870a9-5f4a-4213-9fa1-e93eee8e1662/kube-multus/0.log"
Jul 21 21:27:43.774325 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:43.774295    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c6mdf_0b527024-4b36-41f9-844e-c932757f0b46/network-metrics-daemon/0.log"
Jul 21 21:27:43.791839 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:43.791816    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c6mdf_0b527024-4b36-41f9-844e-c932757f0b46/kube-rbac-proxy/0.log"
Jul 21 21:27:44.700591 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:44.700486    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-controller/0.log"
Jul 21 21:27:44.717049 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:44.717023    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/1.log"
Jul 21 21:27:44.717049 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:44.717042    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovn-acl-logging/0.log"
Jul 21 21:27:44.737554 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:44.737534    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/kube-rbac-proxy-node/0.log"
Jul 21 21:27:44.761773 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:44.761746    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/kube-rbac-proxy-ovn-metrics/0.log"
Jul 21 21:27:44.781264 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:44.781240    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/northd/0.log"
Jul 21 21:27:44.802112 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:44.802090    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/nbdb/0.log"
Jul 21 21:27:44.822376 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:44.822355    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/sbdb/0.log"
Jul 21 21:27:44.896048 ip-10-0-134-121 kubenswrapper[2560]: I0721 21:27:44.896011    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqbp6_c58ec16f-a76f-40c2-b56a-8c78fbbe4e6d/ovnkube-controller/0.log"