Jul 06 21:19:22.118560 ip-10-0-128-90 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 06 21:19:22.118568 ip-10-0-128-90 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 06 21:19:22.118575 ip-10-0-128-90 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 06 21:19:22.118838 ip-10-0-128-90 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 06 21:19:32.138067 ip-10-0-128-90 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 06 21:19:32.138085 ip-10-0-128-90 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot af21e976d384493795fc5855cd07a105 --
Jul 06 21:21:31.413186 ip-10-0-128-90 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 21:21:31.803089 ip-10-0-128-90 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 21:21:31.803089 ip-10-0-128-90 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 21:21:31.803089 ip-10-0-128-90 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 21:21:31.803089 ip-10-0-128-90 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 21:21:31.803089 ip-10-0-128-90 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 21:21:31.803746 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.803094    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 21:21:31.808482 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808458    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.808482 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808475    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.808482 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808479    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.808482 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808483    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.808482 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808486    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.808482 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808489    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808493    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808496    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808499    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808501    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808504    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808507    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808510    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808512    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808515    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808518    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808520    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808522    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808525    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808532    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808535    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808537    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808541    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808546    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.808710 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808549    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808552    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808555    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808557    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808562    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808565    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808568    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808572    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808575    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808578    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808581    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808584    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808586    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808589    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808592    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808596    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808599    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808601    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808605    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808607    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.809224 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808610    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808613    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808616    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808618    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808621    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808623    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808626    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808629    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808631    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808634    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808636    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808639    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808641    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808644    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808646    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808649    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808651    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808654    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808656    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808659    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.809750 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808661    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808663    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808666    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808668    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808671    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808675    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808677    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808680    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808683    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808685    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808688    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808690    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808693    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808695    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808697    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808700    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808703    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808705    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808708    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.810248 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808711    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808714    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808716    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808719    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808722    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808726    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808729    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808731    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808734    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808736    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808738    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808741    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808743    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808746    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808748    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.808751    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809529    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809537    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809540    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.810701 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809543    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809546    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809549    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809552    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809556    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809560    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809562    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809565    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809568    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809571    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809574    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809576    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809579    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809582    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809585    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809588    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809590    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809593    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809595    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.811200 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809598    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809600    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809603    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809605    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809608    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809611    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809613    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809616    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809618    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809621    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809624    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809627    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809630    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809633    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809636    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809638    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809641    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809643    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809646    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809648    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.811670 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809650    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809653    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809655    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809658    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809660    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809663    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809665    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809667    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809671    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809673    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809676    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809678    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809680    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809683    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809685    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809687    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809690    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809693    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809696    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809702    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.812204 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809704    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809707    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809709    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809712    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809714    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809717    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809720    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809722    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809725    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809727    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809730    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809732    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809735    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809739    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809742    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809745    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809747    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809750    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809754    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.812697 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809757    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809760    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809764    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809766    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809769    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809771    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809773    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809776    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809778    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809781    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809783    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809786    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809790    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809792    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809795    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809798    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809800    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.809804    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810205    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.813206 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810211    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810214    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810216    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810219    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810222    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810224    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810227    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810229    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810232    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810234    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810237    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810239    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810242    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810244    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810247    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810250    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810253    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810256    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810259    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810261    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.813675 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810264    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810266    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810268    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810271    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810273    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810277    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810279    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810282    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810284    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810286    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810288    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810291    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810294    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810296    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810299    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810301    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810304    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810307    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810310    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.814174 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810313    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810315    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810318    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810320    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810323    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810326    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810330    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810332    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810334    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810338    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810340    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810343    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810345    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810347    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810350    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810352    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810355    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810357    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810360    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.814626 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810362    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810365    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810367    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810369    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810372    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810375    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810377    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810379    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810382    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810384    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810387    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810389    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810392    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810395    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810397    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810400    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810402    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810404    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810407    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810411    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.815091 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810413    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810416    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810418    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810421    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810424    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810427    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810429    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810432    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810436    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810439    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810442    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810446    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810449    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810451    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810455    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810458    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810461    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810464    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810466    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.815569 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.810469    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810543    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810550    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810556    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810560    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810564    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810567    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810571    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810575    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810578    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810581    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810584    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810589    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810592    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810595    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810598    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810601    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810604    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810607    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810612    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810615    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810617    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810620    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810624    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 21:21:31.816040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810628    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810630    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810633    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810636    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810639    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810642    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810645    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810648    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810650    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810654    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810657    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810660    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810663    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810666    2564 flags.go:64] FLAG: --enable-server="true"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810668    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810672    2564 flags.go:64] FLAG: --event-burst="100"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810675    2564 flags.go:64] FLAG: --event-qps="50"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810678    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810681    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810683    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810688    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810691    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810693    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810696    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810699    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 21:21:31.816611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810701    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810705    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810708    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810711    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810713    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810717    2564 flags.go:64] FLAG: --feature-gates=""
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810721    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810724    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810727    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810730    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810733    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810735    2564 flags.go:64] FLAG: --help="false"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810738    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-128-90.ec2.internal"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810741    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810744    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810747    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810750    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810753    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810756    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810758    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810761    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810764    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810766    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810769    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 21:21:31.817318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810772    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810774    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810777    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810781    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810784    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810786    2564 flags.go:64] FLAG: --lock-file=""
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810789    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810792    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810795    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810800    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810803    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810806    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810809    2564 flags.go:64] FLAG: --logging-format="text"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810813    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810816    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810818    2564 flags.go:64] FLAG: --manifest-url=""
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810821    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810825    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810828    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810832    2564 flags.go:64] FLAG: --max-pods="110"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810834    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810837    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810840    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810843    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810846    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 21:21:31.817913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810848    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810851    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810858    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810861    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810864    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810866    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810869    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810874    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810877    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810880    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810883    2564 flags.go:64] FLAG: --port="10250"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810886    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810889    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e929c8301ff6fd2a"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810892    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810909    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810912    2564 flags.go:64] FLAG: --register-node="true"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810915    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810918    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810921    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810924    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810927    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810931    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810934    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810937    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810940    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 21:21:31.818516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810942    2564 flags.go:64] FLAG: --runonce="false"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810945    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810948    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810950    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810953    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810956    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810959    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810961    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810964    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810967    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810970    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810972    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810975    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810978    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810981    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810984    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810989    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810994    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.810996    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.811000    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.811003    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.811006    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.811008    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.811011    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.811014    2564 flags.go:64] FLAG: --v="2"
Jul 06 21:21:31.819147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.811018    2564 flags.go:64] FLAG: --version="false"
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.811022    2564 flags.go:64] FLAG: --vmodule=""
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.811026    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.811030    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811145    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811149    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811152    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811155    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811158    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811160    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811162    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811165    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811167    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811170    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811172    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811175    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811177    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811179    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811182    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811184    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811187    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.819748 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811189    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811192    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811194    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811198    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811200    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811203    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811206    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811208    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811211    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811215    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811218    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811222    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811225    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811230    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811234    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811237    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811240    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811242    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811245    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.820275 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811248    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811250    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811253    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811255    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811258    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811260    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811263    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811265    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811267    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811270    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811272    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811275    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811277    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811280    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811282    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811285    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811289    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811292    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811294    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811296    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811299    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.820760 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811301    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811304    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811306    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811308    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811311    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811313    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811318    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811320    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811323    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811325    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811328    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811330    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811332    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811335    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811337    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811339    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811342    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811345    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811347    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811350    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.821290 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811352    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811355    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811357    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811360    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811362    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811365    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811367    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811371    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811373    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811376    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811378    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811380    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811384    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811387    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811390    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811393    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811396    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811398    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811402    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.821792 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811405    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811407    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.811410    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.812053    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.818467    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.818481    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.818499    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.818505    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818561    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818565    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818569    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818572    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818574    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818577    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.822314 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818580    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818582    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818585    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818587    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818589    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818592    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818594    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818597    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818599    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818602    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818605    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818607    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818610    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818613    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818616    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818618    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818620    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818623    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818625    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818627    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.822658 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818630    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818633    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818636    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818639    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818641    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818644    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818647    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818649    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818651    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818654    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818656    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818658    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818662    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818666    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818668    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818671    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818673    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818676    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.823154 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818678    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818682    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818685    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818689    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818692    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818695    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818698    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818702    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818706    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818709    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818712    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818715    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818717    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818720    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818722    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818725    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818728    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818730    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818733    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.823594 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818736    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818738    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818740    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818743    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818745    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818748    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818750    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818753    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818755    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818758    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818760    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818762    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818765    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818767    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818769    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818772    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818775    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818777    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818780    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818783    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.824073 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818785    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818788    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818790    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818793    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818795    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818797    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818800    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818802    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818805    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818808    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818810    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818812    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818815    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818818    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818820    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.824548 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818822    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.818828    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818965    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818970    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818973    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818976    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818979    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818982    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818984    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818987    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818989    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818992    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818994    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818997    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.818999    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 21:21:31.824956 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819002    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819004    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819008    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819010    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819012    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819015    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819017    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819020    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819022    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819025    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819029    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819033    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819036    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819039    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819041    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819044    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819047    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819050    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819052    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819055    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 21:21:31.825350 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819057    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819060    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819063    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819065    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819068    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819071    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819073    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819075    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819078    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819080    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819083    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819086    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819089    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819091    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819094    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819096    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819098    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819100    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819103    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819106    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 21:21:31.825834 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819108    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819110    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819113    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819115    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819118    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819121    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819123    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819125    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819129    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819131    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819133    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819136    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819138    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819141    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819143    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819145    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819148    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819150    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819153    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819156    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 21:21:31.826440 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819158    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819161    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819163    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819166    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819168    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819171    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819173    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819176    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819178    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819181    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819183    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819185    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819188    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819190    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819193    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819195    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819198    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819200    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819203    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 21:21:31.826925 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819206    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819209    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819212    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819215    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819218    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819221    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:31.819223    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.819228    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.819319    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.821148    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.822741    2564 server.go:1019] "Starting client certificate rotation"
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.822886    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.823569    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 21:21:31.827405 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.825185    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 21:21:31.828633 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.828618    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 21:21:31.841855 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.841838    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 06 21:21:31.843697 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.843681    2564 log.go:25] "Validated CRI v1 image API"
Jul 06 21:21:31.844462 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.844444    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 21:21:31.846778 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.846760    2564 fs.go:135] Filesystem UUIDs: map[61366698-5775-4032-a77b-862e3cf7ef25:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7d20e4cb-06fa-4d72-9384-38f0e602ef48:/dev/nvme0n1p4]
Jul 06 21:21:31.846830 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.846777    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 21:21:31.852914 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.852787    2564 manager.go:216] Machine: {Timestamp:2026-07-06 21:21:31.851461766 +0000 UTC m=+0.324659377 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099043 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27bbbc8f1a99354226081114a70800 SystemUUID:ec27bbbc-8f1a-9935-4226-081114a70800 BootID:af21e976-d384-4937-95fc-5855cd07a105 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:94:a7:36:f7:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:94:a7:36:f7:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:f3:0c:f6:3e:7f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 21:21:31.852914 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.852912    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 21:21:31.853017 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.852989    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 21:21:31.855978 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.855959    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 21:21:31.856137 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.855981    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 21:21:31.856764 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.856751    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 21:21:31.856764 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.856766    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 21:21:31.856849 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.856773    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 21:21:31.857439 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.857428    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 21:21:31.858811 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.858800    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 21:21:31.859013 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.858995    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 21:21:31.861737 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.861725    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 21:21:31.861850 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.861841    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 21:21:31.861884 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.861870    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 21:21:31.861932 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.861885    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 21:21:31.861932 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.861918    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 21:21:31.861932 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.861929    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 06 21:21:31.862046 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.861946    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 21:21:31.862386 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.862375    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 21:21:31.862438 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.862393    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 21:21:31.864912 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.864877    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 21:21:31.866795 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.866780    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 21:21:31.866853 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.866821    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 21:21:31.867778 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867767    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 21:21:31.867829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867784    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 21:21:31.867829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867790    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 21:21:31.867829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867796    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 21:21:31.867829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867804    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 21:21:31.867829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867810    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 21:21:31.867829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867817    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 21:21:31.867829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867822    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 21:21:31.867829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867829    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 21:21:31.868155 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867834    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 21:21:31.868155 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867843    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 21:21:31.868155 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867848    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 21:21:31.868155 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867869    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 21:21:31.868155 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.867875    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 21:21:31.870937 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.870918    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 21:21:31.870997 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:31.870924    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 21:21:31.871627 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.871597    2564 server.go:1268] "Started kubelet"
Jul 06 21:21:31.871999 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:31.871976    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 21:21:31.872099 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.872058    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 21:21:31.872250 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.872179    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 21:21:31.872336 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.872257    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 21:21:31.872410 ip-10-0-128-90 systemd[1]: Started Kubernetes Kubelet.
Jul 06 21:21:31.874195 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.874176    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 21:21:31.875070 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.875054    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 21:21:31.878986 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:31.878966    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 21:21:31.879944 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.879928    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 21:21:31.879944 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.879940    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 21:21:31.880161 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:31.880140    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:31.880782 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.880763    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 21:21:31.880874 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.880835    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 21:21:31.880874 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.880848    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 21:21:31.881019 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.880953    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 21:21:31.881019 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.880961    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 21:21:31.881123 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.881109    2564 factory.go:55] Registering systemd factory
Jul 06 21:21:31.881182 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.881125    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 06 21:21:31.881351 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.881338    2564 factory.go:153] Registering CRI-O factory
Jul 06 21:21:31.881390 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.881372    2564 factory.go:223] Registration of the crio container factory successfully
Jul 06 21:21:31.881423 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.881413    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 21:21:31.881453 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.881433    2564 factory.go:103] Registering Raw factory
Jul 06 21:21:31.881453 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.881443    2564 manager.go:1196] Started watching for new ooms in manager
Jul 06 21:21:31.881719 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:31.880792    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-90.ec2.internal.18bfd0324a0e1547  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-90.ec2.internal,UID:ip-10-0-128-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-90.ec2.internal,},FirstTimestamp:2026-07-06 21:21:31.871384903 +0000 UTC m=+0.344582515,LastTimestamp:2026-07-06 21:21:31.871384903 +0000 UTC m=+0.344582515,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-90.ec2.internal,}"
Jul 06 21:21:31.882002 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.881986    2564 manager.go:349] Starting recovery of all containers
Jul 06 21:21:31.888642 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.888618    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 21:21:31.889653 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:31.889626    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 21:21:31.889748 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:31.889727    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 21:21:31.890874 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.890861    2564 manager.go:354] Recovery completed
Jul 06 21:21:31.895677 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.895568    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:31.896699 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.896684    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrcnw"
Jul 06 21:21:31.897504 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.897489    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:31.897565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.897517    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:31.897565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.897529    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:31.898092 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.898079    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 21:21:31.898173 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.898093    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 21:21:31.898173 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.898112    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 21:21:31.898173 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.898084    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:31.899053 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.899040    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:31.899097 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.899066    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:31.899097 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.899075    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:31.899285 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.899272    2564 policy_none.go:49] "None policy: Start"
Jul 06 21:21:31.899340 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.899292    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 21:21:31.899340 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.899316    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 21:21:31.900374 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.900362    2564 policy_none.go:47] "Start"
Jul 06 21:21:31.905694 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.905646    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jrcnw"
Jul 06 21:21:31.908097 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:31.908028    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-90.ec2.internal.18bfd0324b9ca324  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-90.ec2.internal,UID:ip-10-0-128-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-90.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-90.ec2.internal,},FirstTimestamp:2026-07-06 21:21:31.897504548 +0000 UTC m=+0.370702158,LastTimestamp:2026-07-06 21:21:31.897504548 +0000 UTC m=+0.370702158,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-90.ec2.internal,}"
Jul 06 21:21:31.927471 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.927456    2564 manager.go:337] "Starting Device Plugin manager"
Jul 06 21:21:31.927581 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:31.927489    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 21:21:31.927581 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.927498    2564 server.go:87] "Starting device plugin registration server"
Jul 06 21:21:31.927760 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.927746    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 21:21:31.927840 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.927762    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 21:21:31.927925 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.927843    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 21:21:31.927975 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.927934    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 21:21:31.927975 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:31.927948    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 21:21:31.928471 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:31.928452    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 21:21:31.928553 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:31.928500    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:32.028283 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.028250    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:32.029562 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.029292    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:32.029562 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.029326    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:32.029562 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.029337    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:32.029562 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.029366    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.041836 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.041813    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.041950 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.041838    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-90.ec2.internal\": node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:32.055925 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.055860    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 21:21:32.055925 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.055914    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 21:21:32.056048 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.055937    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 21:21:32.056048 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.055965    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 21:21:32.058217 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.058202    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 21:21:32.068170 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.068149    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:32.156376 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.156347    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-90.ec2.internal"]
Jul 06 21:21:32.156462 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.156419    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:32.158095 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.158077    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:32.158172 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.158108    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:32.158172 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.158118    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:32.159304 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.159293    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:32.159432 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.159418    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.159474 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.159451    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:32.160052 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.160034    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:32.160126 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.160068    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:32.160126 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.160082    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:32.160126 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.160042    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:32.160258 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.160136    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:32.160258 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.160147    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:32.161397 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.161384    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.161453 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.161410    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:32.162062 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.162045    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:32.162120 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.162069    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:32.162120 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.162081    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:32.168201 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.168186    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:32.188604 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.188586    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-90.ec2.internal\" not found" node="ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.193302 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.193285    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-90.ec2.internal\" not found" node="ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.269007 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.268974    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:32.282511 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.282487    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c180b285dae9c23a92c7b57652f6e20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal\" (UID: \"3c180b285dae9c23a92c7b57652f6e20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.282605 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.282513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c180b285dae9c23a92c7b57652f6e20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal\" (UID: \"3c180b285dae9c23a92c7b57652f6e20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.282605 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.282532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8965c7d69ec2392d3020ca0546d1c79-config\") pod \"kube-apiserver-proxy-ip-10-0-128-90.ec2.internal\" (UID: \"a8965c7d69ec2392d3020ca0546d1c79\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.369099 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.369029    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:32.383427 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.383404    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c180b285dae9c23a92c7b57652f6e20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal\" (UID: \"3c180b285dae9c23a92c7b57652f6e20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.383427 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.383423    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c180b285dae9c23a92c7b57652f6e20-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal\" (UID: \"3c180b285dae9c23a92c7b57652f6e20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.383575 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.383467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c180b285dae9c23a92c7b57652f6e20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal\" (UID: \"3c180b285dae9c23a92c7b57652f6e20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.383575 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.383487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8965c7d69ec2392d3020ca0546d1c79-config\") pod \"kube-apiserver-proxy-ip-10-0-128-90.ec2.internal\" (UID: \"a8965c7d69ec2392d3020ca0546d1c79\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.383575 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.383520    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8965c7d69ec2392d3020ca0546d1c79-config\") pod \"kube-apiserver-proxy-ip-10-0-128-90.ec2.internal\" (UID: \"a8965c7d69ec2392d3020ca0546d1c79\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.383679 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.383572    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c180b285dae9c23a92c7b57652f6e20-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal\" (UID: \"3c180b285dae9c23a92c7b57652f6e20\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.469741 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.469706    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:32.491168 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.491133    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.496636 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.496622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:32.570205 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.570170    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:32.670826 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.670741    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:32.744093 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.744063    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 21:21:32.771845 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.771822    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:32.822235 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.822211    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 21:21:32.822715 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.822348    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 21:21:32.822715 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.822395    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 21:21:32.871935 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.871888    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:32.907677 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.907641    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 21:16:32 +0000 UTC" deadline="2027-12-31 08:08:13.286283079 +0000 UTC"
Jul 06 21:21:32.907677 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.907674    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13018h46m40.378614057s"
Jul 06 21:21:32.934986 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.934957    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 21:21:32.936465 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.936432    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 21:21:32.936557 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.936477    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 21:21:32.936557 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.936495    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeHasSufficientPID"
Jul 06 21:21:32.970949 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:32.970924    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 21:21:32.972096 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:32.972062    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:33.029277 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:33.029243    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8965c7d69ec2392d3020ca0546d1c79.slice/crio-ac28f762fe7bf414d39c00fd728a18b1757cd7501c3795597c86a4c75b83f07d WatchSource:0}: Error finding container ac28f762fe7bf414d39c00fd728a18b1757cd7501c3795597c86a4c75b83f07d: Status 404 returned error can't find the container with id ac28f762fe7bf414d39c00fd728a18b1757cd7501c3795597c86a4c75b83f07d
Jul 06 21:21:33.029692 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:33.029671    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c180b285dae9c23a92c7b57652f6e20.slice/crio-ad1e7271327563c1ee95c715328f75c6e58d09a41733b182b9a87767c8454a5d WatchSource:0}: Error finding container ad1e7271327563c1ee95c715328f75c6e58d09a41733b182b9a87767c8454a5d: Status 404 returned error can't find the container with id ad1e7271327563c1ee95c715328f75c6e58d09a41733b182b9a87767c8454a5d
Jul 06 21:21:33.034027 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.034010    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 21:21:33.060553 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.060506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal" event={"ID":"3c180b285dae9c23a92c7b57652f6e20","Type":"ContainerStarted","Data":"ad1e7271327563c1ee95c715328f75c6e58d09a41733b182b9a87767c8454a5d"}
Jul 06 21:21:33.061458 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.061436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-90.ec2.internal" event={"ID":"a8965c7d69ec2392d3020ca0546d1c79","Type":"ContainerStarted","Data":"ac28f762fe7bf414d39c00fd728a18b1757cd7501c3795597c86a4c75b83f07d"}
Jul 06 21:21:33.072621 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:33.072603    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:33.173197 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:33.173144    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-90.ec2.internal\" not found"
Jul 06 21:21:33.200858 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.200840    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 21:21:33.281170 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.281149    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:33.309736 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.309706    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 21:21:33.310894 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.310881    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-90.ec2.internal"
Jul 06 21:21:33.332451 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.332431    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 21:21:33.862963 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.862929    2564 apiserver.go:52] "Watching apiserver"
Jul 06 21:21:33.872070 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.872041    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 21:21:33.873085 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.872520    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9","openshift-cluster-node-tuning-operator/tuned-kk6nm","openshift-image-registry/node-ca-6j9h5","openshift-multus/multus-additional-cni-plugins-cm6sd","openshift-multus/multus-xwnjx","openshift-multus/network-metrics-daemon-5vcrb","kube-system/konnectivity-agent-gbsx5","openshift-dns/node-resolver-pkdw8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal","openshift-network-diagnostics/network-check-target-42kbp","openshift-network-operator/iptables-alerter-f5smb","openshift-ovn-kubernetes/ovnkube-node-d2nlk","kube-system/global-pull-secret-syncer-9c4l2","kube-system/kube-apiserver-proxy-ip-10-0-128-90.ec2.internal"]
Jul 06 21:21:33.875314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.875290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:21:33.878466 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.878443    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 21:21:33.878575 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.878494    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-577qj\""
Jul 06 21:21:33.878653 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.878606    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 21:21:33.878712 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.878682    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:33.878858 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:33.878762    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:33.880399 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.880380    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 21:21:33.881043 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.881024    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6j9h5"
Jul 06 21:21:33.883471 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.883450    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.887066 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.887033    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.887265 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.887245    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nl8nk\""
Jul 06 21:21:33.887545 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.887525    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 21:21:33.887651 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.887626    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.887771 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.887756    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 21:21:33.887851 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.887828    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 21:21:33.887930 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.887879    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 21:21:33.887930 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.887910    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.888086 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.888068    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-thzln\""
Jul 06 21:21:33.888177 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.888161    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.888584 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.888405    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.889804 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.889714    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:33.889804 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:33.889773    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:33.891495 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-os-release\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.891585 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f9c936d-426b-4bb4-b9e3-de34c4269a89-agent-certs\") pod \"konnectivity-agent-gbsx5\" (UID: \"4f9c936d-426b-4bb4-b9e3-de34c4269a89\") " pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:21:33.891585 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f9c936d-426b-4bb4-b9e3-de34c4269a89-konnectivity-ca\") pod \"konnectivity-agent-gbsx5\" (UID: \"4f9c936d-426b-4bb4-b9e3-de34c4269a89\") " pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:21:33.891585 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71a13f26-90e5-41fe-abc1-49d5cfd57701-kubelet-config\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:33.891720 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:33.891720 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvh5h\" (UniqueName: \"kubernetes.io/projected/f757d911-9917-454b-a588-22665813cd3f-kube-api-access-zvh5h\") pod \"node-ca-6j9h5\" (UID: \"f757d911-9917-454b-a588-22665813cd3f\") " pod="openshift-image-registry/node-ca-6j9h5"
Jul 06 21:21:33.891720 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-cnibin\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.891720 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891664    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6b28796-6170-410a-a51d-888fcda16922-cni-binary-copy\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.891885 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6b28796-6170-410a-a51d-888fcda16922-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.891885 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6b28796-6170-410a-a51d-888fcda16922-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.891885 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71a13f26-90e5-41fe-abc1-49d5cfd57701-dbus\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:33.891885 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f757d911-9917-454b-a588-22665813cd3f-host\") pod \"node-ca-6j9h5\" (UID: \"f757d911-9917-454b-a588-22665813cd3f\") " pod="openshift-image-registry/node-ca-6j9h5"
Jul 06 21:21:33.891885 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891854    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f757d911-9917-454b-a588-22665813cd3f-serviceca\") pod \"node-ca-6j9h5\" (UID: \"f757d911-9917-454b-a588-22665813cd3f\") " pod="openshift-image-registry/node-ca-6j9h5"
Jul 06 21:21:33.892206 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-system-cni-dir\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.892206 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891924    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.892206 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.891953    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9f2h\" (UniqueName: \"kubernetes.io/projected/e6b28796-6170-410a-a51d-888fcda16922-kube-api-access-x9f2h\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.892206 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.892159    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pkdw8"
Jul 06 21:21:33.892754 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.892736    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9b46j\""
Jul 06 21:21:33.892922 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.892907    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 21:21:33.895424 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.895402    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:33.899828 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.899808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.900426 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.900405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:33.900532 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:33.900504    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:33.901156 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.900726    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.901156 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.900765    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.901156 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.900823    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.901156 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.900726    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cztsh\""
Jul 06 21:21:33.901156 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.900880    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sb888\""
Jul 06 21:21:33.901156 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.901006    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.901156 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.901055    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 21:21:33.903999 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.902577    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f5smb"
Jul 06 21:21:33.906099 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.906076    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.906197 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.906185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.906532 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.906507    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.908017 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.907994    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 21:21:33.908225 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.908203    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-smmrp\""
Jul 06 21:21:33.908373 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.908359    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.908519 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.908504    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.908694 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.908679    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5f297\""
Jul 06 21:21:33.911697 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.911652    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5hv6b\""
Jul 06 21:21:33.911697 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.911688    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 21:21:33.913112 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.913093    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 21:21:33.913112 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.913101    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 21:21:33.913570 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.913551    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 21:21:33.913830 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.913551    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 21:21:33.913910 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.913830    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 21:21:33.915546 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.915519    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 21:21:33.965630 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.965611    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9nn8h"
Jul 06 21:21:33.982380 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.982347    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 21:21:33.985655 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.985633    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9nn8h"
Jul 06 21:21:33.993180 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993147    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4046b7-27e0-4d20-8d6f-42176dc76870-tmp\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.993285 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv2rd\" (UniqueName: \"kubernetes.io/projected/4d4046b7-27e0-4d20-8d6f-42176dc76870-kube-api-access-xv2rd\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.993285 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-etc-openvswitch\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.993408 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71a13f26-90e5-41fe-abc1-49d5cfd57701-kubelet-config\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:33.993408 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993326    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:33.993408 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993352    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b652d91-c369-4441-95fb-ebc6bd1a4cf3-hosts-file\") pod \"node-resolver-pkdw8\" (UID: \"8b652d91-c369-4441-95fb-ebc6bd1a4cf3\") " pod="openshift-dns/node-resolver-pkdw8"
Jul 06 21:21:33.993408 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:33.993595 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.993595 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993417    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71a13f26-90e5-41fe-abc1-49d5cfd57701-kubelet-config\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:33.993595 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993431    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7957755-15f5-4903-b1e7-b434c3fdecee-ovnkube-config\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.993595 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6b28796-6170-410a-a51d-888fcda16922-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.993595 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993509    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b652d91-c369-4441-95fb-ebc6bd1a4cf3-tmp-dir\") pod \"node-resolver-pkdw8\" (UID: \"8b652d91-c369-4441-95fb-ebc6bd1a4cf3\") " pod="openshift-dns/node-resolver-pkdw8"
Jul 06 21:21:33.993595 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-cnibin\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.993595 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:33.993550    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:33.993595 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-run-netns\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.993878 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.993604    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-var-lib-cni-bin\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.993878 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:33.993639    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret podName:71a13f26-90e5-41fe-abc1-49d5cfd57701 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:34.493599324 +0000 UTC m=+2.966796932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret") pod "global-pull-secret-syncer-9c4l2" (UID: "71a13f26-90e5-41fe-abc1-49d5cfd57701") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:33.994431 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994371    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6b28796-6170-410a-a51d-888fcda16922-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.994431 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-hostroot\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.994547 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpjnj\" (UniqueName: \"kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj\") pod \"network-check-target-42kbp\" (UID: \"0231785a-2385-4fcf-9791-594f396fed37\") " pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:33.994547 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994519    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-run-ovn-kubernetes\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.994647 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f757d911-9917-454b-a588-22665813cd3f-serviceca\") pod \"node-ca-6j9h5\" (UID: \"f757d911-9917-454b-a588-22665813cd3f\") " pod="openshift-image-registry/node-ca-6j9h5"
Jul 06 21:21:33.994647 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea32b888-333e-4d20-96fa-def5d6a5bb40-host-slash\") pod \"iptables-alerter-f5smb\" (UID: \"ea32b888-333e-4d20-96fa-def5d6a5bb40\") " pod="openshift-network-operator/iptables-alerter-f5smb"
Jul 06 21:21:33.994647 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-kubernetes\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.994647 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-var-lib-kubelet\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.994835 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994659    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-node-log\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.994835 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7957755-15f5-4903-b1e7-b434c3fdecee-env-overrides\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.994835 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5rs9\" (UniqueName: \"kubernetes.io/projected/f7957755-15f5-4903-b1e7-b434c3fdecee-kube-api-access-k5rs9\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.994835 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-registration-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:33.994835 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994805    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-device-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:33.995034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-system-cni-dir\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.995034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-os-release\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.995034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994914    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f9c936d-426b-4bb4-b9e3-de34c4269a89-agent-certs\") pod \"konnectivity-agent-gbsx5\" (UID: \"4f9c936d-426b-4bb4-b9e3-de34c4269a89\") " pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:21:33.995034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-multus-cni-dir\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.995034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.994999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-multus-conf-dir\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.995034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995028    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-etc-kubernetes\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.995257 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brttx\" (UniqueName: \"kubernetes.io/projected/83a702da-0cfc-4565-9019-7c55b2b58677-kube-api-access-brttx\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.995257 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995088    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f757d911-9917-454b-a588-22665813cd3f-serviceca\") pod \"node-ca-6j9h5\" (UID: \"f757d911-9917-454b-a588-22665813cd3f\") " pod="openshift-image-registry/node-ca-6j9h5"
Jul 06 21:21:33.995257 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-kubelet\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.995257 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-run-netns\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.995257 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-run-systemd\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.995433 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6b28796-6170-410a-a51d-888fcda16922-cni-binary-copy\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.995433 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-999d9\" (UniqueName: \"kubernetes.io/projected/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-kube-api-access-999d9\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:33.995433 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995319    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-sys-fs\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:33.995433 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea32b888-333e-4d20-96fa-def5d6a5bb40-iptables-alerter-script\") pod \"iptables-alerter-f5smb\" (UID: \"ea32b888-333e-4d20-96fa-def5d6a5bb40\") " pod="openshift-network-operator/iptables-alerter-f5smb"
Jul 06 21:21:33.995433 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-run-ovn\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.995433 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71a13f26-90e5-41fe-abc1-49d5cfd57701-dbus\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:33.995630 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995448    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-system-cni-dir\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.995630 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9f2h\" (UniqueName: \"kubernetes.io/projected/e6b28796-6170-410a-a51d-888fcda16922-kube-api-access-x9f2h\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.995630 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:33.995630 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995521    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 21:21:33.995630 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995562    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-run-k8s-cni-cncf-io\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.995630 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-modprobe-d\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.995857 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9265\" (UniqueName: \"kubernetes.io/projected/8b652d91-c369-4441-95fb-ebc6bd1a4cf3-kube-api-access-m9265\") pod \"node-resolver-pkdw8\" (UID: \"8b652d91-c369-4441-95fb-ebc6bd1a4cf3\") " pod="openshift-dns/node-resolver-pkdw8"
Jul 06 21:21:33.995857 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-run-multus-certs\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.995857 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995696    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-systemd-units\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.995857 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvh5h\" (UniqueName: \"kubernetes.io/projected/f757d911-9917-454b-a588-22665813cd3f-kube-api-access-zvh5h\") pod \"node-ca-6j9h5\" (UID: \"f757d911-9917-454b-a588-22665813cd3f\") " pod="openshift-image-registry/node-ca-6j9h5"
Jul 06 21:21:33.995857 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995751    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-cnibin\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.995857 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9dc8\" (UniqueName: \"kubernetes.io/projected/665c9baa-e425-4c6e-8790-3749bd8af7c4-kube-api-access-l9dc8\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:33.995857 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-sysctl-d\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.995857 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995846    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-systemd\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6b28796-6170-410a-a51d-888fcda16922-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995898    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83a702da-0cfc-4565-9019-7c55b2b58677-multus-daemon-config\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995924    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-run\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-lib-modules\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.995997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-log-socket\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-multus-socket-dir-parent\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-sysconfig\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-tuned\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-slash\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996189    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-cnibin\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.996215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-var-lib-openvswitch\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-socket-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996243    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-var-lib-kubelet\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996266    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-cni-netd\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7957755-15f5-4903-b1e7-b434c3fdecee-ovn-node-metrics-cert\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f9c936d-426b-4bb4-b9e3-de34c4269a89-konnectivity-ca\") pod \"konnectivity-agent-gbsx5\" (UID: \"4f9c936d-426b-4bb4-b9e3-de34c4269a89\") " pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996368    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-var-lib-cni-multus\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996375    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71a13f26-90e5-41fe-abc1-49d5cfd57701-dbus\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-cni-bin\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83a702da-0cfc-4565-9019-7c55b2b58677-cni-binary-copy\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996422    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-system-cni-dir\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996470    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-sysctl-conf\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-sys\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-run-openvswitch\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.996629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f757d911-9917-454b-a588-22665813cd3f-host\") pod \"node-ca-6j9h5\" (UID: \"f757d911-9917-454b-a588-22665813cd3f\") " pod="openshift-image-registry/node-ca-6j9h5"
Jul 06 21:21:33.997293 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:33.997293 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.996788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7957755-15f5-4903-b1e7-b434c3fdecee-ovnkube-script-lib\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:33.997293 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.997046    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6b28796-6170-410a-a51d-888fcda16922-cni-binary-copy\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.997293 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.997057    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6b28796-6170-410a-a51d-888fcda16922-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.997293 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.997142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-os-release\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.997293 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.997181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbs2d\" (UniqueName: \"kubernetes.io/projected/ea32b888-333e-4d20-96fa-def5d6a5bb40-kube-api-access-vbs2d\") pod \"iptables-alerter-f5smb\" (UID: \"ea32b888-333e-4d20-96fa-def5d6a5bb40\") " pod="openshift-network-operator/iptables-alerter-f5smb"
Jul 06 21:21:33.997293 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.997216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-host\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:33.997644 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.997313    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f757d911-9917-454b-a588-22665813cd3f-host\") pod \"node-ca-6j9h5\" (UID: \"f757d911-9917-454b-a588-22665813cd3f\") " pod="openshift-image-registry/node-ca-6j9h5"
Jul 06 21:21:33.997644 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.997318    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.997644 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.997393    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6b28796-6170-410a-a51d-888fcda16922-os-release\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:33.998025 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.997906    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f9c936d-426b-4bb4-b9e3-de34c4269a89-konnectivity-ca\") pod \"konnectivity-agent-gbsx5\" (UID: \"4f9c936d-426b-4bb4-b9e3-de34c4269a89\") " pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:21:33.999801 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:33.999699    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f9c936d-426b-4bb4-b9e3-de34c4269a89-agent-certs\") pod \"konnectivity-agent-gbsx5\" (UID: \"4f9c936d-426b-4bb4-b9e3-de34c4269a89\") " pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:21:34.023708 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.023674    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvh5h\" (UniqueName: \"kubernetes.io/projected/f757d911-9917-454b-a588-22665813cd3f-kube-api-access-zvh5h\") pod \"node-ca-6j9h5\" (UID: \"f757d911-9917-454b-a588-22665813cd3f\") " pod="openshift-image-registry/node-ca-6j9h5"
Jul 06 21:21:34.029308 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.029278    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9f2h\" (UniqueName: \"kubernetes.io/projected/e6b28796-6170-410a-a51d-888fcda16922-kube-api-access-x9f2h\") pod \"multus-additional-cni-plugins-cm6sd\" (UID: \"e6b28796-6170-410a-a51d-888fcda16922\") " pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:34.098147 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-etc-openvswitch\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.098342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b652d91-c369-4441-95fb-ebc6bd1a4cf3-hosts-file\") pod \"node-resolver-pkdw8\" (UID: \"8b652d91-c369-4441-95fb-ebc6bd1a4cf3\") " pod="openshift-dns/node-resolver-pkdw8"
Jul 06 21:21:34.098342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.098342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098231    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-etc-openvswitch\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.098342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.098342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7957755-15f5-4903-b1e7-b434c3fdecee-ovnkube-config\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.098342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098319    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.098342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098327    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b652d91-c369-4441-95fb-ebc6bd1a4cf3-hosts-file\") pod \"node-resolver-pkdw8\" (UID: \"8b652d91-c369-4441-95fb-ebc6bd1a4cf3\") " pod="openshift-dns/node-resolver-pkdw8"
Jul 06 21:21:34.098342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b652d91-c369-4441-95fb-ebc6bd1a4cf3-tmp-dir\") pod \"node-resolver-pkdw8\" (UID: \"8b652d91-c369-4441-95fb-ebc6bd1a4cf3\") " pod="openshift-dns/node-resolver-pkdw8"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098368    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-cnibin\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098397    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098408    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-run-netns\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-var-lib-cni-bin\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098463    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-cnibin\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-hostroot\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098509    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-var-lib-cni-bin\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjnj\" (UniqueName: \"kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj\") pod \"network-check-target-42kbp\" (UID: \"0231785a-2385-4fcf-9791-594f396fed37\") " pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-run-ovn-kubernetes\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea32b888-333e-4d20-96fa-def5d6a5bb40-host-slash\") pod \"iptables-alerter-f5smb\" (UID: \"ea32b888-333e-4d20-96fa-def5d6a5bb40\") " pod="openshift-network-operator/iptables-alerter-f5smb"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098554    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-run-netns\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098606    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-hostroot\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098632    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-kubernetes\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098662    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea32b888-333e-4d20-96fa-def5d6a5bb40-host-slash\") pod \"iptables-alerter-f5smb\" (UID: \"ea32b888-333e-4d20-96fa-def5d6a5bb40\") " pod="openshift-network-operator/iptables-alerter-f5smb"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098583    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-kubernetes\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-var-lib-kubelet\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098700    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8b652d91-c369-4441-95fb-ebc6bd1a4cf3-tmp-dir\") pod \"node-resolver-pkdw8\" (UID: \"8b652d91-c369-4441-95fb-ebc6bd1a4cf3\") " pod="openshift-dns/node-resolver-pkdw8"
Jul 06 21:21:34.098762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098722    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-node-log\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-node-log\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098755    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-var-lib-kubelet\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7957755-15f5-4903-b1e7-b434c3fdecee-env-overrides\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5rs9\" (UniqueName: \"kubernetes.io/projected/f7957755-15f5-4903-b1e7-b434c3fdecee-kube-api-access-k5rs9\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-registration-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098860    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-run-ovn-kubernetes\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-device-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-system-cni-dir\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-os-release\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098943    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-multus-cni-dir\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.098996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-multus-conf-dir\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099021    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-etc-kubernetes\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099045    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f7957755-15f5-4903-b1e7-b434c3fdecee-ovnkube-config\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099047    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brttx\" (UniqueName: \"kubernetes.io/projected/83a702da-0cfc-4565-9019-7c55b2b58677-kube-api-access-brttx\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-kubelet\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099109    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-registration-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.099683 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-run-netns\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-run-systemd\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999d9\" (UniqueName: \"kubernetes.io/projected/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-kube-api-access-999d9\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099168    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-device-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-sys-fs\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea32b888-333e-4d20-96fa-def5d6a5bb40-iptables-alerter-script\") pod \"iptables-alerter-f5smb\" (UID: \"ea32b888-333e-4d20-96fa-def5d6a5bb40\") " pod="openshift-network-operator/iptables-alerter-f5smb"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-run-ovn\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099219    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-system-cni-dir\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099250    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-run-k8s-cni-cncf-io\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099266    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-modprobe-d\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099274    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-os-release\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9265\" (UniqueName: \"kubernetes.io/projected/8b652d91-c369-4441-95fb-ebc6bd1a4cf3-kube-api-access-m9265\") pod \"node-resolver-pkdw8\" (UID: \"8b652d91-c369-4441-95fb-ebc6bd1a4cf3\") " pod="openshift-dns/node-resolver-pkdw8"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-run-multus-certs\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-systemd-units\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099348    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-run-systemd\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099374    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9dc8\" (UniqueName: \"kubernetes.io/projected/665c9baa-e425-4c6e-8790-3749bd8af7c4-kube-api-access-l9dc8\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.100565 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-sysctl-d\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099417    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-sys-fs\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-systemd\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83a702da-0cfc-4565-9019-7c55b2b58677-multus-daemon-config\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099463    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-kubelet\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-run\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099508    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-modprobe-d\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-lib-modules\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-log-socket\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099548    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-multus-cni-dir\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-multus-socket-dir-parent\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099600    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-sysconfig\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-tuned\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-slash\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-var-lib-openvswitch\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-socket-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099730    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-sysctl-d\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-var-lib-kubelet\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.101243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099756    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-etc-kubernetes\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-cni-netd\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099780    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-multus-conf-dir\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7957755-15f5-4903-b1e7-b434c3fdecee-ovn-node-metrics-cert\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099804    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-run-multus-certs\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099821    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-var-lib-cni-multus\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099826    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-systemd-units\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099341    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f7957755-15f5-4903-b1e7-b434c3fdecee-env-overrides\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-cni-bin\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099858    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-run-k8s-cni-cncf-io\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83a702da-0cfc-4565-9019-7c55b2b58677-cni-binary-copy\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-sysctl-conf\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-sys\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-run-openvswitch\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099999    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100018    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-run-ovn\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.099505    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-run-netns\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100030    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ea32b888-333e-4d20-96fa-def5d6a5bb40-iptables-alerter-script\") pod \"iptables-alerter-f5smb\" (UID: \"ea32b888-333e-4d20-96fa-def5d6a5bb40\") " pod="openshift-network-operator/iptables-alerter-f5smb"
Jul 06 21:21:34.102313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7957755-15f5-4903-b1e7-b434c3fdecee-ovnkube-script-lib\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.100078    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbs2d\" (UniqueName: \"kubernetes.io/projected/ea32b888-333e-4d20-96fa-def5d6a5bb40-kube-api-access-vbs2d\") pod \"iptables-alerter-f5smb\" (UID: \"ea32b888-333e-4d20-96fa-def5d6a5bb40\") " pod="openshift-network-operator/iptables-alerter-f5smb"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100113    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-systemd\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.100121    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs podName:0d9b6160-3c08-45a1-a0b3-dc682e2ac510 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:34.600108541 +0000 UTC m=+3.073306140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs") pod "network-metrics-daemon-5vcrb" (UID: "0d9b6160-3c08-45a1-a0b3-dc682e2ac510") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-host\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4046b7-27e0-4d20-8d6f-42176dc76870-tmp\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv2rd\" (UniqueName: \"kubernetes.io/projected/4d4046b7-27e0-4d20-8d6f-42176dc76870-kube-api-access-xv2rd\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100234    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-cni-bin\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100263    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-var-lib-kubelet\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100429    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-socket-dir\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100544    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-log-socket\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100577    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f7957755-15f5-4903-b1e7-b434c3fdecee-ovnkube-script-lib\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.100611    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-run\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.101121    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-host-var-lib-cni-multus\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.101373    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/83a702da-0cfc-4565-9019-7c55b2b58677-cni-binary-copy\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.101542    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-sysctl-conf\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.103259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.101608    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-sys\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.101668    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-run-openvswitch\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.101762    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/665c9baa-e425-4c6e-8790-3749bd8af7c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.101822    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-lib-modules\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.102317    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/83a702da-0cfc-4565-9019-7c55b2b58677-multus-daemon-config\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.102391    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-host\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.102434    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-slash\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.102491    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-var-lib-openvswitch\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.102560    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/83a702da-0cfc-4565-9019-7c55b2b58677-multus-socket-dir-parent\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.103928    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f7957755-15f5-4903-b1e7-b434c3fdecee-host-cni-netd\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.104137    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-tuned\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.104183    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f7957755-15f5-4903-b1e7-b434c3fdecee-ovn-node-metrics-cert\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.102613    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4d4046b7-27e0-4d20-8d6f-42176dc76870-etc-sysconfig\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.106686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.105871    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4046b7-27e0-4d20-8d6f-42176dc76870-tmp\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.138041 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.137945    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:34.138041 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.137972    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:34.138041 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.137974    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv2rd\" (UniqueName: \"kubernetes.io/projected/4d4046b7-27e0-4d20-8d6f-42176dc76870-kube-api-access-xv2rd\") pod \"tuned-kk6nm\" (UID: \"4d4046b7-27e0-4d20-8d6f-42176dc76870\") " pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.138041 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.137987    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cpjnj for pod openshift-network-diagnostics/network-check-target-42kbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:34.138332 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.138050    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj podName:0231785a-2385-4fcf-9791-594f396fed37 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:34.638032665 +0000 UTC m=+3.111230266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cpjnj" (UniqueName: "kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj") pod "network-check-target-42kbp" (UID: "0231785a-2385-4fcf-9791-594f396fed37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:34.141005 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.140965    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbs2d\" (UniqueName: \"kubernetes.io/projected/ea32b888-333e-4d20-96fa-def5d6a5bb40-kube-api-access-vbs2d\") pod \"iptables-alerter-f5smb\" (UID: \"ea32b888-333e-4d20-96fa-def5d6a5bb40\") " pod="openshift-network-operator/iptables-alerter-f5smb"
Jul 06 21:21:34.141126 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.140978    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9dc8\" (UniqueName: \"kubernetes.io/projected/665c9baa-e425-4c6e-8790-3749bd8af7c4-kube-api-access-l9dc8\") pod \"aws-ebs-csi-driver-node-wkwn9\" (UID: \"665c9baa-e425-4c6e-8790-3749bd8af7c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.142540 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.142475    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5rs9\" (UniqueName: \"kubernetes.io/projected/f7957755-15f5-4903-b1e7-b434c3fdecee-kube-api-access-k5rs9\") pod \"ovnkube-node-d2nlk\" (UID: \"f7957755-15f5-4903-b1e7-b434c3fdecee\") " pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.144276 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.144250    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9265\" (UniqueName: \"kubernetes.io/projected/8b652d91-c369-4441-95fb-ebc6bd1a4cf3-kube-api-access-m9265\") pod \"node-resolver-pkdw8\" (UID: \"8b652d91-c369-4441-95fb-ebc6bd1a4cf3\") " pod="openshift-dns/node-resolver-pkdw8"
Jul 06 21:21:34.154567 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.154542    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brttx\" (UniqueName: \"kubernetes.io/projected/83a702da-0cfc-4565-9019-7c55b2b58677-kube-api-access-brttx\") pod \"multus-xwnjx\" (UID: \"83a702da-0cfc-4565-9019-7c55b2b58677\") " pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.155721 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.155690    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-999d9\" (UniqueName: \"kubernetes.io/projected/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-kube-api-access-999d9\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:34.188365 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.188338    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:21:34.204988 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.204963    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6j9h5"
Jul 06 21:21:34.225128 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.225098    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xwnjx"
Jul 06 21:21:34.231280 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.231254    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cm6sd"
Jul 06 21:21:34.238891 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.238874    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pkdw8"
Jul 06 21:21:34.246823 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.246805    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9"
Jul 06 21:21:34.256811 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.256789    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk6nm"
Jul 06 21:21:34.265691 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.265671    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f5smb"
Jul 06 21:21:34.268545 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.268514    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 21:21:34.271541 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.271517    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:21:34.502266 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.502180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:34.502438 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.502319    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:34.502438 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.502395    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret podName:71a13f26-90e5-41fe-abc1-49d5cfd57701 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:35.502372611 +0000 UTC m=+3.975570221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret") pod "global-pull-secret-syncer-9c4l2" (UID: "71a13f26-90e5-41fe-abc1-49d5cfd57701") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:34.603188 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.603147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:34.603365 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.603301    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:34.603454 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.603371    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs podName:0d9b6160-3c08-45a1-a0b3-dc682e2ac510 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:35.603352233 +0000 UTC m=+4.076549854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs") pod "network-metrics-daemon-5vcrb" (UID: "0d9b6160-3c08-45a1-a0b3-dc682e2ac510") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:34.703652 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.703607    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjnj\" (UniqueName: \"kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj\") pod \"network-check-target-42kbp\" (UID: \"0231785a-2385-4fcf-9791-594f396fed37\") " pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:34.703841 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.703804    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:34.703841 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.703832    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:34.703841 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.703841    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cpjnj for pod openshift-network-diagnostics/network-check-target-42kbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:34.703988 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:34.703907    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj podName:0231785a-2385-4fcf-9791-594f396fed37 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:35.703886699 +0000 UTC m=+4.177084325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpjnj" (UniqueName: "kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj") pod "network-check-target-42kbp" (UID: "0231785a-2385-4fcf-9791-594f396fed37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:34.989731 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.989621    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 21:16:34 +0000 UTC" deadline="2028-01-11 12:35:05.66848366 +0000 UTC"
Jul 06 21:21:34.989731 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:34.989667    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13287h13m30.678821978s"
Jul 06 21:21:35.157202 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:35.157157    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf757d911_9917_454b_a588_22665813cd3f.slice/crio-dd0ba6ad382e43f186f411e237c9656cb8302c9671eb1d9c8482d3c33b4f37f8 WatchSource:0}: Error finding container dd0ba6ad382e43f186f411e237c9656cb8302c9671eb1d9c8482d3c33b4f37f8: Status 404 returned error can't find the container with id dd0ba6ad382e43f186f411e237c9656cb8302c9671eb1d9c8482d3c33b4f37f8
Jul 06 21:21:35.161557 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:35.161529    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea32b888_333e_4d20_96fa_def5d6a5bb40.slice/crio-26e5a422a0b556cb367d38e4e22e47c321b6b56fd8d9933e26bfe42a80d2e845 WatchSource:0}: Error finding container 26e5a422a0b556cb367d38e4e22e47c321b6b56fd8d9933e26bfe42a80d2e845: Status 404 returned error can't find the container with id 26e5a422a0b556cb367d38e4e22e47c321b6b56fd8d9933e26bfe42a80d2e845
Jul 06 21:21:35.162618 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:21:35.162274    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9c936d_426b_4bb4_b9e3_de34c4269a89.slice/crio-03569d7156d455e37ed46cc7098e73c959ad1542ba6acd7703bbefc1b95f6434 WatchSource:0}: Error finding container 03569d7156d455e37ed46cc7098e73c959ad1542ba6acd7703bbefc1b95f6434: Status 404 returned error can't find the container with id 03569d7156d455e37ed46cc7098e73c959ad1542ba6acd7703bbefc1b95f6434
Jul 06 21:21:35.511389 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:35.511199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:35.511389 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:35.511366    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:35.511581 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:35.511440    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret podName:71a13f26-90e5-41fe-abc1-49d5cfd57701 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:37.511417132 +0000 UTC m=+5.984614732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret") pod "global-pull-secret-syncer-9c4l2" (UID: "71a13f26-90e5-41fe-abc1-49d5cfd57701") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:35.611874 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:35.611785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:35.612045 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:35.612008    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:35.612122 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:35.612077    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs podName:0d9b6160-3c08-45a1-a0b3-dc682e2ac510 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:37.61205596 +0000 UTC m=+6.085253560 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs") pod "network-metrics-daemon-5vcrb" (UID: "0d9b6160-3c08-45a1-a0b3-dc682e2ac510") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:35.713337 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:35.713297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjnj\" (UniqueName: \"kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj\") pod \"network-check-target-42kbp\" (UID: \"0231785a-2385-4fcf-9791-594f396fed37\") " pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:35.713561 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:35.713541    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:35.713640 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:35.713570    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:35.713640 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:35.713585    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cpjnj for pod openshift-network-diagnostics/network-check-target-42kbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:35.713750 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:35.713650    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj podName:0231785a-2385-4fcf-9791-594f396fed37 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:37.713630355 +0000 UTC m=+6.186827960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpjnj" (UniqueName: "kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj") pod "network-check-target-42kbp" (UID: "0231785a-2385-4fcf-9791-594f396fed37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:35.907003 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:35.906881    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 21:21:35.990215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:35.990114    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 21:16:34 +0000 UTC" deadline="2028-01-29 01:15:24.97358968 +0000 UTC"
Jul 06 21:21:35.990215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:35.990179    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13707h53m48.983415205s"
Jul 06 21:21:36.057614 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.056647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:36.057614 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:36.056782    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:36.057614 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.057250    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:36.057614 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:36.057351    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:36.057614 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.057499    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:36.057614 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:36.057594    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:36.075135 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.075106    2564 generic.go:356] "Generic (PLEG): container finished" podID="3c180b285dae9c23a92c7b57652f6e20" containerID="073035d3f0236f2023e24efc0d1a510eacad9f0357978e3a948851de3ea5bac4" exitCode=0
Jul 06 21:21:36.075292 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.075204    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal" event={"ID":"3c180b285dae9c23a92c7b57652f6e20","Type":"ContainerDied","Data":"073035d3f0236f2023e24efc0d1a510eacad9f0357978e3a948851de3ea5bac4"}
Jul 06 21:21:36.083791 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.083760    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9" event={"ID":"665c9baa-e425-4c6e-8790-3749bd8af7c4","Type":"ContainerStarted","Data":"e59658ef02966fc57934104acf1827c10cf997e5457cd777ac713e15c30babc3"}
Jul 06 21:21:36.090624 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.090592    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbsx5" event={"ID":"4f9c936d-426b-4bb4-b9e3-de34c4269a89","Type":"ContainerStarted","Data":"03569d7156d455e37ed46cc7098e73c959ad1542ba6acd7703bbefc1b95f6434"}
Jul 06 21:21:36.108233 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.108162    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6j9h5" event={"ID":"f757d911-9917-454b-a588-22665813cd3f","Type":"ContainerStarted","Data":"dd0ba6ad382e43f186f411e237c9656cb8302c9671eb1d9c8482d3c33b4f37f8"}
Jul 06 21:21:36.116731 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.116703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk6nm" event={"ID":"4d4046b7-27e0-4d20-8d6f-42176dc76870","Type":"ContainerStarted","Data":"639fc13601c139e76ea920f9f2a0b9b194cef9e579529447763e3f83617314bd"}
Jul 06 21:21:36.123466 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.123393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f5smb" event={"ID":"ea32b888-333e-4d20-96fa-def5d6a5bb40","Type":"ContainerStarted","Data":"26e5a422a0b556cb367d38e4e22e47c321b6b56fd8d9933e26bfe42a80d2e845"}
Jul 06 21:21:36.133606 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.133542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-90.ec2.internal" event={"ID":"a8965c7d69ec2392d3020ca0546d1c79","Type":"ContainerStarted","Data":"e6513c33c03c9e3c187442a15acf2c8d4f868a1ceb4ca9f1c0e0e0d13d9bdadc"}
Jul 06 21:21:36.143352 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.143322    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pkdw8" event={"ID":"8b652d91-c369-4441-95fb-ebc6bd1a4cf3","Type":"ContainerStarted","Data":"7960542d1b381e34360058700d2c603a78315a7c422443d07ce5f880a2284d3c"}
Jul 06 21:21:36.147560 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.147475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cm6sd" event={"ID":"e6b28796-6170-410a-a51d-888fcda16922","Type":"ContainerStarted","Data":"903020a03516c4395cbfb43a22f819fc140f236c03f1ab5784952502069cf82f"}
Jul 06 21:21:36.150380 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.150269    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk" event={"ID":"f7957755-15f5-4903-b1e7-b434c3fdecee","Type":"ContainerStarted","Data":"37e8585b842ff1abc6500d0aa7254f840bd35adc7ecbfb3f6c9189666558b745"}
Jul 06 21:21:36.162963 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:36.162900    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xwnjx" event={"ID":"83a702da-0cfc-4565-9019-7c55b2b58677","Type":"ContainerStarted","Data":"bd9e1791d9571f7e3142da7996faebbe39920ac5e8bb98a990fdf944ddb994e9"}
Jul 06 21:21:37.196005 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:37.195926    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal" event={"ID":"3c180b285dae9c23a92c7b57652f6e20","Type":"ContainerStarted","Data":"72e26ca8d359672314907543ee82e99844f7d617811f56192362327bab6f4eff"}
Jul 06 21:21:37.221149 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:37.221089    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-90.ec2.internal" podStartSLOduration=3.221067823 podStartE2EDuration="3.221067823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:36.153797653 +0000 UTC m=+4.626995278" watchObservedRunningTime="2026-07-06 21:21:37.221067823 +0000 UTC m=+5.694265449"
Jul 06 21:21:37.529961 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:37.529874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:37.530136 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:37.530108    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:37.530195 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:37.530177    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret podName:71a13f26-90e5-41fe-abc1-49d5cfd57701 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:41.530157193 +0000 UTC m=+10.003354793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret") pod "global-pull-secret-syncer-9c4l2" (UID: "71a13f26-90e5-41fe-abc1-49d5cfd57701") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:37.630986 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:37.630934    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:37.631160 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:37.631093    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:37.631221 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:37.631187    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs podName:0d9b6160-3c08-45a1-a0b3-dc682e2ac510 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:41.631167069 +0000 UTC m=+10.104364672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs") pod "network-metrics-daemon-5vcrb" (UID: "0d9b6160-3c08-45a1-a0b3-dc682e2ac510") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:37.731988 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:37.731948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjnj\" (UniqueName: \"kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj\") pod \"network-check-target-42kbp\" (UID: \"0231785a-2385-4fcf-9791-594f396fed37\") " pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:37.732164 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:37.732135    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:37.732164 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:37.732153    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:37.732300 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:37.732168    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cpjnj for pod openshift-network-diagnostics/network-check-target-42kbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:37.732300 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:37.732240    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj podName:0231785a-2385-4fcf-9791-594f396fed37 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:41.732219084 +0000 UTC m=+10.205416686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpjnj" (UniqueName: "kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj") pod "network-check-target-42kbp" (UID: "0231785a-2385-4fcf-9791-594f396fed37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:38.057194 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:38.057091    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:38.057194 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:38.057135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:38.057459 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:38.057251    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:38.057728 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:38.057688    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:38.059068 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:38.059013    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:38.059227 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:38.059151    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:40.058142 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:40.058107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:40.058580 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:40.058156    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:40.058580 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:40.058119    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:40.058580 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:40.058267    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:40.058580 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:40.058365    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:40.058580 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:40.058454    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:41.565975 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:41.565911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:41.566432 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:41.566093    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:41.566432 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:41.566165    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret podName:71a13f26-90e5-41fe-abc1-49d5cfd57701 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:49.566143584 +0000 UTC m=+18.039341225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret") pod "global-pull-secret-syncer-9c4l2" (UID: "71a13f26-90e5-41fe-abc1-49d5cfd57701") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:41.666993 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:41.666955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:41.667190 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:41.667130    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:41.667250 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:41.667213    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs podName:0d9b6160-3c08-45a1-a0b3-dc682e2ac510 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:49.667190325 +0000 UTC m=+18.140387926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs") pod "network-metrics-daemon-5vcrb" (UID: "0d9b6160-3c08-45a1-a0b3-dc682e2ac510") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:41.767684 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:41.767650    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjnj\" (UniqueName: \"kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj\") pod \"network-check-target-42kbp\" (UID: \"0231785a-2385-4fcf-9791-594f396fed37\") " pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:41.767855 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:41.767835    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:41.767906 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:41.767860    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:41.767906 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:41.767871    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cpjnj for pod openshift-network-diagnostics/network-check-target-42kbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:41.768000 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:41.767946    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj podName:0231785a-2385-4fcf-9791-594f396fed37 nodeName:}" failed. No retries permitted until 2026-07-06 21:21:49.767930659 +0000 UTC m=+18.241128259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpjnj" (UniqueName: "kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj") pod "network-check-target-42kbp" (UID: "0231785a-2385-4fcf-9791-594f396fed37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:42.057719 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:42.057680    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:42.057939 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:42.057774    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:42.058156 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:42.058142    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:42.058230 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:42.058217    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:42.058429 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:42.058409    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:42.058508 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:42.058495    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:44.056597 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:44.056568    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:44.056597 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:44.056583    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:44.057186 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:44.056679    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:44.057186 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:44.056780    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:44.057186 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:44.056829    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:44.057186 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:44.056878    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:46.058056 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:46.058020    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:46.058486 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:46.058164    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:46.058486 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:46.058025    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:46.058486 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:46.058238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:46.058486 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:46.058341    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:46.058486 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:46.058413    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:48.057103 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:48.057065    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:48.057571 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:48.057065    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:48.057571 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:48.057065    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:48.057571 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:48.057241    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:48.057571 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:48.057304    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:48.057571 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:48.057388    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:49.629001 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:49.628961    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:49.629433 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:49.629147    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:49.629433 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:49.629222    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret podName:71a13f26-90e5-41fe-abc1-49d5cfd57701 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:05.629204926 +0000 UTC m=+34.102402528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret") pod "global-pull-secret-syncer-9c4l2" (UID: "71a13f26-90e5-41fe-abc1-49d5cfd57701") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:21:49.729691 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:49.729647    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:49.729872 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:49.729802    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:49.729954 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:49.729882    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs podName:0d9b6160-3c08-45a1-a0b3-dc682e2ac510 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:05.72986358 +0000 UTC m=+34.203061188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs") pod "network-metrics-daemon-5vcrb" (UID: "0d9b6160-3c08-45a1-a0b3-dc682e2ac510") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:21:49.830265 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:49.830217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjnj\" (UniqueName: \"kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj\") pod \"network-check-target-42kbp\" (UID: \"0231785a-2385-4fcf-9791-594f396fed37\") " pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:49.830437 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:49.830401    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:21:49.830437 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:49.830427    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:21:49.830437 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:49.830438    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cpjnj for pod openshift-network-diagnostics/network-check-target-42kbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:49.830534 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:49.830491    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj podName:0231785a-2385-4fcf-9791-594f396fed37 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:05.830474901 +0000 UTC m=+34.303672499 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpjnj" (UniqueName: "kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj") pod "network-check-target-42kbp" (UID: "0231785a-2385-4fcf-9791-594f396fed37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:21:50.056562 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:50.056531    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:50.056562 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:50.056549    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:50.056748 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:50.056532    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:50.056748 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:50.056662    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:50.056748 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:50.056733    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:50.056850 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:50.056792    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:52.057800 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:52.057764    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:52.058310 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:52.057887    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:52.058310 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:52.057968    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:52.058310 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:52.058065    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:52.058310 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:52.058100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:52.058310 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:52.058165    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:54.057056 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:54.057017    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:54.057653 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:54.057012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:54.057653 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:54.057132    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:54.057653 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:54.057160    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:54.057653 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:54.057252    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:54.057653 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:54.057354    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:55.245818 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.245609    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbsx5" event={"ID":"4f9c936d-426b-4bb4-b9e3-de34c4269a89","Type":"ContainerStarted","Data":"37f45cfb8a32ecba7f724fb3dc2e1f7f683b734d3d10b5f4de2cf3b329869cdd"}
Jul 06 21:21:55.247577 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.247552    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6j9h5" event={"ID":"f757d911-9917-454b-a588-22665813cd3f","Type":"ContainerStarted","Data":"411b0f77f64c3a2005c95a0d76b9ff6826126b7733e0d469134f4ea2bb058f20"}
Jul 06 21:21:55.249255 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.249227    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk6nm" event={"ID":"4d4046b7-27e0-4d20-8d6f-42176dc76870","Type":"ContainerStarted","Data":"2b4af5b74d59c8c9c39143b6f3be894243ad17d4ae25d3ee5c0b23e35a0ef584"}
Jul 06 21:21:55.250822 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.250796    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pkdw8" event={"ID":"8b652d91-c369-4441-95fb-ebc6bd1a4cf3","Type":"ContainerStarted","Data":"d96bd8301b30684fb0e53b29e34ee0b4b0b87f74e2200a600bf6d47de22e2c3e"}
Jul 06 21:21:55.252310 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.252286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cm6sd" event={"ID":"e6b28796-6170-410a-a51d-888fcda16922","Type":"ContainerStarted","Data":"a22b56e2b2ea1f1e8b970e9229a3bd1c3d3ccc4a051f4daf9a560404ec0121c1"}
Jul 06 21:21:55.258291 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.258273    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:21:55.258657 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.258637    2564 generic.go:356] "Generic (PLEG): container finished" podID="f7957755-15f5-4903-b1e7-b434c3fdecee" containerID="cb33d1d4d70ae34a9cc09e64edbdd8999a15b92efd31d17b2cfc1669f0d3a139" exitCode=1
Jul 06 21:21:55.258757 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.258697    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk" event={"ID":"f7957755-15f5-4903-b1e7-b434c3fdecee","Type":"ContainerStarted","Data":"ca1293f801338a42c56c6104351cd0a549720db210a3c1d63596603111099077"}
Jul 06 21:21:55.258757 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.258745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk" event={"ID":"f7957755-15f5-4903-b1e7-b434c3fdecee","Type":"ContainerDied","Data":"cb33d1d4d70ae34a9cc09e64edbdd8999a15b92efd31d17b2cfc1669f0d3a139"}
Jul 06 21:21:55.258865 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.258781    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk" event={"ID":"f7957755-15f5-4903-b1e7-b434c3fdecee","Type":"ContainerStarted","Data":"4135b5b895aeaa713d7bec0301268e1a36a66d46e151d07bec4693cb9fb83b8f"}
Jul 06 21:21:55.260097 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.260077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xwnjx" event={"ID":"83a702da-0cfc-4565-9019-7c55b2b58677","Type":"ContainerStarted","Data":"1c94d96b103a49be0edc3208c9d785c114b9801d5003b29dc9f61dd94505a904"}
Jul 06 21:21:55.261638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.261619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9" event={"ID":"665c9baa-e425-4c6e-8790-3749bd8af7c4","Type":"ContainerStarted","Data":"324d15cdcfc01f1ac46e1384c3e0ab8c54aa13132eef509f1881e46b2836b0f8"}
Jul 06 21:21:55.277592 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.277508    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gbsx5" podStartSLOduration=7.422453963 podStartE2EDuration="22.277494463s" totalImagesPullingTime="14.8550405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:55.277262229 +0000 UTC m=+23.750459849" watchObservedRunningTime="2026-07-06 21:21:55.277494463 +0000 UTC m=+23.750692082"
Jul 06 21:21:55.277716 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.277609    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-90.ec2.internal" podStartSLOduration=21.277605879 podStartE2EDuration="21.277605879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:37.221549115 +0000 UTC m=+5.694746740" watchObservedRunningTime="2026-07-06 21:21:55.277605879 +0000 UTC m=+23.750803499"
Jul 06 21:21:55.327570 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.327524    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6j9h5" podStartSLOduration=2.826475957 podStartE2EDuration="22.327509733s" totalImagesPullingTime="19.501033776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:55.327353221 +0000 UTC m=+23.800550916" watchObservedRunningTime="2026-07-06 21:21:55.327509733 +0000 UTC m=+23.800707352"
Jul 06 21:21:55.391491 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.390883    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xwnjx" podStartSLOduration=2.871972832 podStartE2EDuration="22.390863135s" totalImagesPullingTime="19.518890303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:55.390105934 +0000 UTC m=+23.863303555" watchObservedRunningTime="2026-07-06 21:21:55.390863135 +0000 UTC m=+23.864060757"
Jul 06 21:21:55.413964 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:55.413879    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pkdw8" podStartSLOduration=2.918828677 podStartE2EDuration="22.413861818s" totalImagesPullingTime="19.495033141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:55.413521095 +0000 UTC m=+23.886718716" watchObservedRunningTime="2026-07-06 21:21:55.413861818 +0000 UTC m=+23.887059438"
Jul 06 21:21:56.059126 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.058485    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:56.059126 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:56.058612    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:56.059126 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.058637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:56.059126 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:56.058723    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:56.059126 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.059001    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:56.059126 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:56.059085    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:56.121924 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.121870    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 21:21:56.265353 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.265314    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f5smb" event={"ID":"ea32b888-333e-4d20-96fa-def5d6a5bb40","Type":"ContainerStarted","Data":"a40e2e4c0d6565a237901cb9690c0ee0097164c0e3a3929cf1655572acb600d6"}
Jul 06 21:21:56.267643 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.267611    2564 generic.go:356] "Generic (PLEG): container finished" podID="e6b28796-6170-410a-a51d-888fcda16922" containerID="a22b56e2b2ea1f1e8b970e9229a3bd1c3d3ccc4a051f4daf9a560404ec0121c1" exitCode=0
Jul 06 21:21:56.267775 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.267718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cm6sd" event={"ID":"e6b28796-6170-410a-a51d-888fcda16922","Type":"ContainerDied","Data":"a22b56e2b2ea1f1e8b970e9229a3bd1c3d3ccc4a051f4daf9a560404ec0121c1"}
Jul 06 21:21:56.271127 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.271111    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:21:56.271546 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.271525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk" event={"ID":"f7957755-15f5-4903-b1e7-b434c3fdecee","Type":"ContainerStarted","Data":"f7d5737d7e2f231d47223be44e3cf2f4be56e69720e9c64e1b3b563cc364272d"}
Jul 06 21:21:56.271614 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.271589    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk" event={"ID":"f7957755-15f5-4903-b1e7-b434c3fdecee","Type":"ContainerStarted","Data":"c686bd77f6941f6d53881aa9ef24e1138e5e69f7e3709ff7403abf9cbf81d57e"}
Jul 06 21:21:56.271655 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.271632    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk" event={"ID":"f7957755-15f5-4903-b1e7-b434c3fdecee","Type":"ContainerStarted","Data":"7bc046b613651bd6f8a2c7c70aadf809cb5d3162980580d52feab258c5278fd7"}
Jul 06 21:21:56.273154 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.273135    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9" event={"ID":"665c9baa-e425-4c6e-8790-3749bd8af7c4","Type":"ContainerStarted","Data":"9e722b841f4a3c1f7c6831e91da92515fe8dfa4b05e6f5c8a7514adb3cf9e8bd"}
Jul 06 21:21:56.285350 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.285270    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kk6nm" podStartSLOduration=3.7819459010000003 podStartE2EDuration="23.285256422s" totalImagesPullingTime="19.503310521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:55.436883391 +0000 UTC m=+23.910081012" watchObservedRunningTime="2026-07-06 21:21:56.285256422 +0000 UTC m=+24.758454041"
Jul 06 21:21:56.309397 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.309352    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f5smb" podStartSLOduration=3.8402835939999997 podStartE2EDuration="23.309338527s" totalImagesPullingTime="19.469054933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:56.28539009 +0000 UTC m=+24.758587688" watchObservedRunningTime="2026-07-06 21:21:56.309338527 +0000 UTC m=+24.782536150"
Jul 06 21:21:56.950737 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.950173    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T21:21:56.121886053Z","UUID":"7062d0ba-ba14-4315-9697-c4555b1361b9","Handler":null,"Name":"","Endpoint":""}
Jul 06 21:21:56.952336 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.951796    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 21:21:56.952336 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:56.951837    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 21:21:57.277855 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:57.277824    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9" event={"ID":"665c9baa-e425-4c6e-8790-3749bd8af7c4","Type":"ContainerStarted","Data":"7282b77213271910b1dd503e0ff75cec927e07e6da5a0c73d11fadd563370e1e"}
Jul 06 21:21:57.302990 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:57.302942    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wkwn9" podStartSLOduration=2.9901611470000002 podStartE2EDuration="24.302922911s" totalImagesPullingTime="21.312761764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:21:57.302706577 +0000 UTC m=+25.775904198" watchObservedRunningTime="2026-07-06 21:21:57.302922911 +0000 UTC m=+25.776120534"
Jul 06 21:21:58.056647 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:58.056616    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:21:58.056814 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:58.056622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:21:58.056814 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:58.056725    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:21:58.056814 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:58.056622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:21:58.056981 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:58.056817    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:21:58.056981 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:21:58.056914    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:21:58.283653 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:58.283623    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:21:58.284103 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:58.284079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk" event={"ID":"f7957755-15f5-4903-b1e7-b434c3fdecee","Type":"ContainerStarted","Data":"10e0c346c2810102557ea473cf02ab244105cc472bbea3f60c3304dd3fdb8b62"}
Jul 06 21:21:58.755288 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:58.755138    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:21:58.758252 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:58.756122    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:21:59.286286 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:59.286255    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:21:59.286762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:21:59.286742    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gbsx5"
Jul 06 21:22:00.060731 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:00.060702    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:22:00.060731 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:00.060722    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:22:00.060956 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:00.060747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:22:00.060956 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:00.060822    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:22:00.060956 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:00.060879    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:22:00.061058 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:00.060961    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:22:01.292437 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:01.292102    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cm6sd" event={"ID":"e6b28796-6170-410a-a51d-888fcda16922","Type":"ContainerStarted","Data":"0d05c3f9ce35b3beeaf07e4f22984f7451ca19408bd34e0644ee155a12827964"}
Jul 06 21:22:01.297333 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:01.296159    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:22:01.297333 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:01.296590    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk" event={"ID":"f7957755-15f5-4903-b1e7-b434c3fdecee","Type":"ContainerStarted","Data":"bc4021f7bd27240add41d82a68ea4be49e858e42d863a575b12ab08e65bce29f"}
Jul 06 21:22:01.297333 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:01.296930    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:22:01.297333 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:01.296992    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:22:01.297333 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:01.297041    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:22:01.297333 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:01.297081    2564 scope.go:117] "RemoveContainer" containerID="cb33d1d4d70ae34a9cc09e64edbdd8999a15b92efd31d17b2cfc1669f0d3a139"
Jul 06 21:22:01.319457 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:01.319403    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:22:01.319771 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:01.319753    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:22:02.058002 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:02.057806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:22:02.058244 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:02.057915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:22:02.058244 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:02.058067    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:22:02.058244 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:02.057948    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:22:02.058244 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:02.058148    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:22:02.058397 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:02.058257    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:22:02.300890 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:02.300851    2564 generic.go:356] "Generic (PLEG): container finished" podID="e6b28796-6170-410a-a51d-888fcda16922" containerID="0d05c3f9ce35b3beeaf07e4f22984f7451ca19408bd34e0644ee155a12827964" exitCode=0
Jul 06 21:22:02.301361 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:02.300920    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cm6sd" event={"ID":"e6b28796-6170-410a-a51d-888fcda16922","Type":"ContainerDied","Data":"0d05c3f9ce35b3beeaf07e4f22984f7451ca19408bd34e0644ee155a12827964"}
Jul 06 21:22:02.304813 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:02.304796    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:22:02.305157 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:02.305138    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk" event={"ID":"f7957755-15f5-4903-b1e7-b434c3fdecee","Type":"ContainerStarted","Data":"f82bc3fc9a89908eaada67786cf118598ca08153fa1f2f4a1d56c86c83ffaa25"}
Jul 06 21:22:02.358248 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:02.358150    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk" podStartSLOduration=9.799351301 podStartE2EDuration="29.358135895s" totalImagesPullingTime="19.558784594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:02.357636135 +0000 UTC m=+30.830833754" watchObservedRunningTime="2026-07-06 21:22:02.358135895 +0000 UTC m=+30.831333547"
Jul 06 21:22:03.292846 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:03.292821    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-42kbp"]
Jul 06 21:22:03.293004 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:03.292960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:22:03.294000 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:03.293542    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:22:03.297333 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:03.297304    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5vcrb"]
Jul 06 21:22:03.297585 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:03.297566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:22:03.297704 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:03.297678    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:22:03.298019 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:03.298000    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9c4l2"]
Jul 06 21:22:03.298120 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:03.298077    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:22:03.298183 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:03.298138    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:22:03.309915 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:03.309841    2564 generic.go:356] "Generic (PLEG): container finished" podID="e6b28796-6170-410a-a51d-888fcda16922" containerID="068a7c47578da91ffa46838470be673428a563eb8803bd4b706e95ed8c71eb76" exitCode=0
Jul 06 21:22:03.310264 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:03.309934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cm6sd" event={"ID":"e6b28796-6170-410a-a51d-888fcda16922","Type":"ContainerDied","Data":"068a7c47578da91ffa46838470be673428a563eb8803bd4b706e95ed8c71eb76"}
Jul 06 21:22:05.056994 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:05.056963    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:22:05.057506 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:05.057059    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:22:05.057506 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:05.057065    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:22:05.057506 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:05.057152    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:22:05.057506 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:05.057066    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:22:05.057506 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:05.057231    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:22:05.316475 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:05.316402    2564 generic.go:356] "Generic (PLEG): container finished" podID="e6b28796-6170-410a-a51d-888fcda16922" containerID="ae1b625dcbc44363173d56d19fc2be210fd4cc80696ce03c0f15337ea759e93c" exitCode=0
Jul 06 21:22:05.316475 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:05.316450    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cm6sd" event={"ID":"e6b28796-6170-410a-a51d-888fcda16922","Type":"ContainerDied","Data":"ae1b625dcbc44363173d56d19fc2be210fd4cc80696ce03c0f15337ea759e93c"}
Jul 06 21:22:05.645956 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:05.645863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:22:05.646093 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:05.646011    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 21:22:05.646093 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:05.646069    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret podName:71a13f26-90e5-41fe-abc1-49d5cfd57701 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:37.646054476 +0000 UTC m=+66.119252076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret") pod "global-pull-secret-syncer-9c4l2" (UID: "71a13f26-90e5-41fe-abc1-49d5cfd57701") : object "kube-system"/"original-pull-secret" not registered
Jul 06 21:22:05.746369 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:05.746336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:22:05.746519 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:05.746449    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:22:05.746519 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:05.746505    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs podName:0d9b6160-3c08-45a1-a0b3-dc682e2ac510 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:37.746488819 +0000 UTC m=+66.219686419 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs") pod "network-metrics-daemon-5vcrb" (UID: "0d9b6160-3c08-45a1-a0b3-dc682e2ac510") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 21:22:05.847350 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:05.847317    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjnj\" (UniqueName: \"kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj\") pod \"network-check-target-42kbp\" (UID: \"0231785a-2385-4fcf-9791-594f396fed37\") " pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:22:05.847498 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:05.847428    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 21:22:05.847498 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:05.847442    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 21:22:05.847498 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:05.847450    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cpjnj for pod openshift-network-diagnostics/network-check-target-42kbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:22:05.847498 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:05.847492    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj podName:0231785a-2385-4fcf-9791-594f396fed37 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:37.847480426 +0000 UTC m=+66.320678027 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cpjnj" (UniqueName: "kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj") pod "network-check-target-42kbp" (UID: "0231785a-2385-4fcf-9791-594f396fed37") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 21:22:07.056388 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.056360    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:22:07.056388 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.056369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:22:07.056814 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:07.056471    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5vcrb" podUID="0d9b6160-3c08-45a1-a0b3-dc682e2ac510"
Jul 06 21:22:07.056814 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.056524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:22:07.056814 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:07.056593    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c4l2" podUID="71a13f26-90e5-41fe-abc1-49d5cfd57701"
Jul 06 21:22:07.056814 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:07.056644    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-42kbp" podUID="0231785a-2385-4fcf-9791-594f396fed37"
Jul 06 21:22:07.833282 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.833215    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-90.ec2.internal" event="NodeReady"
Jul 06 21:22:07.833418 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.833356    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 21:22:07.880087 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.880052    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d6487777b-6pzzk"]
Jul 06 21:22:07.896115 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.896093    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:07.899612 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.899592    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 21:22:07.899959 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.899941    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 21:22:07.900046 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.899944    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kq6tm\""
Jul 06 21:22:07.900236 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.900222    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 21:22:07.902165 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.902134    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d6487777b-6pzzk"]
Jul 06 21:22:07.906255 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.906236    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 21:22:07.910120 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.910102    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jfzrw"]
Jul 06 21:22:07.926085 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.926064    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n8lt5"]
Jul 06 21:22:07.926199 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.926167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:07.932611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.929231    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9fg2d\""
Jul 06 21:22:07.932611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.931016    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n8lt5"
Jul 06 21:22:07.933289 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.933263    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 21:22:07.933432 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.933417    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 21:22:07.933698 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.933635    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 21:22:07.934450 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.934429    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jfzrw"]
Jul 06 21:22:07.934561 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.934507    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 21:22:07.934621 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.934595    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v7k9x\""
Jul 06 21:22:07.935251 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.935178    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 21:22:07.937918 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.937885    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n8lt5"]
Jul 06 21:22:07.963709 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.963683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c7271d5-468c-48d3-949a-417c8836ff70-ca-trust-extracted\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:07.963819 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.963719    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-installation-pull-secrets\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:07.963819 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.963738    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-bound-sa-token\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:07.963819 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.963761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-registry-certificates\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:07.963819 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.963801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:07.963959 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.963828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-image-registry-private-configuration\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:07.963959 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.963846    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-trusted-ca\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:07.963959 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:07.963909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf6zl\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-kube-api-access-gf6zl\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.064211 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064178    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bc14ea5-8b5e-450a-805d-2ac426d61f0f-cert\") pod \"ingress-canary-n8lt5\" (UID: \"4bc14ea5-8b5e-450a-805d-2ac426d61f0f\") " pod="openshift-ingress-canary/ingress-canary-n8lt5"
Jul 06 21:22:08.064648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf6zl\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-kube-api-access-gf6zl\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.064648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-tmp-dir\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.064648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c7271d5-468c-48d3-949a-417c8836ff70-ca-trust-extracted\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.064648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-config-volume\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.064648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-installation-pull-secrets\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.064648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-bound-sa-token\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.064648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-registry-certificates\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.064648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.064648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27ltw\" (UniqueName: \"kubernetes.io/projected/4bc14ea5-8b5e-450a-805d-2ac426d61f0f-kube-api-access-27ltw\") pod \"ingress-canary-n8lt5\" (UID: \"4bc14ea5-8b5e-450a-805d-2ac426d61f0f\") " pod="openshift-ingress-canary/ingress-canary-n8lt5"
Jul 06 21:22:08.064648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-image-registry-private-configuration\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.065143 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-trusted-ca\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.065143 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snqld\" (UniqueName: \"kubernetes.io/projected/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-kube-api-access-snqld\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.065143 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064761    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c7271d5-468c-48d3-949a-417c8836ff70-ca-trust-extracted\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.065143 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.064769    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.065143 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:08.064777    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:08.065143 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:08.064792    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6487777b-6pzzk: secret "image-registry-tls" not found
Jul 06 21:22:08.065143 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:08.064935    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls podName:8c7271d5-468c-48d3-949a-417c8836ff70 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:08.56489399 +0000 UTC m=+37.038091591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls") pod "image-registry-5d6487777b-6pzzk" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70") : secret "image-registry-tls" not found
Jul 06 21:22:08.065143 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.065103    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-registry-certificates\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.065665 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.065643    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-trusted-ca\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.069019 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.068995    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-installation-pull-secrets\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.069131 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.069027    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-image-registry-private-configuration\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.075357 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.075337    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-bound-sa-token\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.075696 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.075680    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf6zl\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-kube-api-access-gf6zl\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.165703 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.165621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snqld\" (UniqueName: \"kubernetes.io/projected/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-kube-api-access-snqld\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.165703 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.165684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.165950 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.165713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bc14ea5-8b5e-450a-805d-2ac426d61f0f-cert\") pod \"ingress-canary-n8lt5\" (UID: \"4bc14ea5-8b5e-450a-805d-2ac426d61f0f\") " pod="openshift-ingress-canary/ingress-canary-n8lt5"
Jul 06 21:22:08.165950 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.165735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-tmp-dir\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.165950 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.165763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-config-volume\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.165950 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:08.165887    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:08.166117 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.165953    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27ltw\" (UniqueName: \"kubernetes.io/projected/4bc14ea5-8b5e-450a-805d-2ac426d61f0f-kube-api-access-27ltw\") pod \"ingress-canary-n8lt5\" (UID: \"4bc14ea5-8b5e-450a-805d-2ac426d61f0f\") " pod="openshift-ingress-canary/ingress-canary-n8lt5"
Jul 06 21:22:08.166117 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:08.165987    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls podName:078ef4f4-78e7-481c-8203-bbdaf87ebfc2 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:08.66596415 +0000 UTC m=+37.139161748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls") pod "dns-default-jfzrw" (UID: "078ef4f4-78e7-481c-8203-bbdaf87ebfc2") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:08.166212 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.166188    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-tmp-dir\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.166467 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.166440    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-config-volume\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.168803 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.168782    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bc14ea5-8b5e-450a-805d-2ac426d61f0f-cert\") pod \"ingress-canary-n8lt5\" (UID: \"4bc14ea5-8b5e-450a-805d-2ac426d61f0f\") " pod="openshift-ingress-canary/ingress-canary-n8lt5"
Jul 06 21:22:08.178724 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.178698    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snqld\" (UniqueName: \"kubernetes.io/projected/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-kube-api-access-snqld\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.178976 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.178954    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27ltw\" (UniqueName: \"kubernetes.io/projected/4bc14ea5-8b5e-450a-805d-2ac426d61f0f-kube-api-access-27ltw\") pod \"ingress-canary-n8lt5\" (UID: \"4bc14ea5-8b5e-450a-805d-2ac426d61f0f\") " pod="openshift-ingress-canary/ingress-canary-n8lt5"
Jul 06 21:22:08.245137 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.245099    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n8lt5"
Jul 06 21:22:08.387329 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.387094    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n8lt5"]
Jul 06 21:22:08.392663 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:08.392639    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc14ea5_8b5e_450a_805d_2ac426d61f0f.slice/crio-933ef0ced3435746943ba352cab68552dc3f05b68936711f363989cfc8af6070 WatchSource:0}: Error finding container 933ef0ced3435746943ba352cab68552dc3f05b68936711f363989cfc8af6070: Status 404 returned error can't find the container with id 933ef0ced3435746943ba352cab68552dc3f05b68936711f363989cfc8af6070
Jul 06 21:22:08.569201 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.569172    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:08.569415 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:08.569347    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:08.569415 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:08.569365    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6487777b-6pzzk: secret "image-registry-tls" not found
Jul 06 21:22:08.569527 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:08.569423    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls podName:8c7271d5-468c-48d3-949a-417c8836ff70 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:09.569405762 +0000 UTC m=+38.042603376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls") pod "image-registry-5d6487777b-6pzzk" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70") : secret "image-registry-tls" not found
Jul 06 21:22:08.670551 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:08.670515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:08.670725 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:08.670684    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:08.670798 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:08.670765    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls podName:078ef4f4-78e7-481c-8203-bbdaf87ebfc2 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:09.670741619 +0000 UTC m=+38.143939231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls") pod "dns-default-jfzrw" (UID: "078ef4f4-78e7-481c-8203-bbdaf87ebfc2") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:09.056670 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.056632    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:22:09.056838 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.056677    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:22:09.056838 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.056752    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:22:09.061041 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.061016    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 21:22:09.061186 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.061171    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 21:22:09.061385 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.061363    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m4jxb\""
Jul 06 21:22:09.061475 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.061466    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 21:22:09.061531 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.061480    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 21:22:09.061567 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.061466    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lhqbc\""
Jul 06 21:22:09.328311 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.328228    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n8lt5" event={"ID":"4bc14ea5-8b5e-450a-805d-2ac426d61f0f","Type":"ContainerStarted","Data":"933ef0ced3435746943ba352cab68552dc3f05b68936711f363989cfc8af6070"}
Jul 06 21:22:09.577607 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.577574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:09.577782 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:09.577696    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:09.577782 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:09.577709    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6487777b-6pzzk: secret "image-registry-tls" not found
Jul 06 21:22:09.577782 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:09.577756    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls podName:8c7271d5-468c-48d3-949a-417c8836ff70 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:11.577742484 +0000 UTC m=+40.050940082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls") pod "image-registry-5d6487777b-6pzzk" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70") : secret "image-registry-tls" not found
Jul 06 21:22:09.678485 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:09.678410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:09.678636 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:09.678572    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:09.678636 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:09.678636    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls podName:078ef4f4-78e7-481c-8203-bbdaf87ebfc2 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:11.678623176 +0000 UTC m=+40.151820774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls") pod "dns-default-jfzrw" (UID: "078ef4f4-78e7-481c-8203-bbdaf87ebfc2") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:11.336498 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:11.336462    2564 generic.go:356] "Generic (PLEG): container finished" podID="e6b28796-6170-410a-a51d-888fcda16922" containerID="0802b6d752542aaee45ee331509854ff799cd52766bb7bb51163ca6a2ba6399d" exitCode=0
Jul 06 21:22:11.336868 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:11.336525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cm6sd" event={"ID":"e6b28796-6170-410a-a51d-888fcda16922","Type":"ContainerDied","Data":"0802b6d752542aaee45ee331509854ff799cd52766bb7bb51163ca6a2ba6399d"}
Jul 06 21:22:11.592718 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:11.592635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:11.592864 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:11.592814    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:11.592864 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:11.592833    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6487777b-6pzzk: secret "image-registry-tls" not found
Jul 06 21:22:11.593007 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:11.592890    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls podName:8c7271d5-468c-48d3-949a-417c8836ff70 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:15.592874723 +0000 UTC m=+44.066072321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls") pod "image-registry-5d6487777b-6pzzk" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70") : secret "image-registry-tls" not found
Jul 06 21:22:11.693819 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:11.693786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:11.693999 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:11.693973    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:11.694061 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:11.694050    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls podName:078ef4f4-78e7-481c-8203-bbdaf87ebfc2 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:15.694029548 +0000 UTC m=+44.167227166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls") pod "dns-default-jfzrw" (UID: "078ef4f4-78e7-481c-8203-bbdaf87ebfc2") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:12.342275 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:12.342057    2564 generic.go:356] "Generic (PLEG): container finished" podID="e6b28796-6170-410a-a51d-888fcda16922" containerID="e82fd03cfc14da73fa3388b31d58b8bf3938db655059d90e88af4403d353646c" exitCode=0
Jul 06 21:22:12.342604 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:12.342132    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cm6sd" event={"ID":"e6b28796-6170-410a-a51d-888fcda16922","Type":"ContainerDied","Data":"e82fd03cfc14da73fa3388b31d58b8bf3938db655059d90e88af4403d353646c"}
Jul 06 21:22:13.347520 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:13.347481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cm6sd" event={"ID":"e6b28796-6170-410a-a51d-888fcda16922","Type":"ContainerStarted","Data":"ee9545273a08626e9a4c1ef96841b735806af2a3b2d7f035ec44c737562d3c62"}
Jul 06 21:22:13.348945 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:13.348920    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n8lt5" event={"ID":"4bc14ea5-8b5e-450a-805d-2ac426d61f0f","Type":"ContainerStarted","Data":"6142542a40c917cab2487ea759fe6687e25fdf8e061916fbf98420bf54dd2d04"}
Jul 06 21:22:13.374104 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:13.374061    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cm6sd" podStartSLOduration=8.883653756 podStartE2EDuration="40.374048853s" totalImagesPullingTime="31.490395097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:13.372975248 +0000 UTC m=+41.846172870" watchObservedRunningTime="2026-07-06 21:22:13.374048853 +0000 UTC m=+41.847246473"
Jul 06 21:22:13.398171 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:13.398130    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n8lt5" podStartSLOduration=2.250098883 podStartE2EDuration="6.398118443s" totalImagesPullingTime="4.14801956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:13.396794263 +0000 UTC m=+41.869991883" watchObservedRunningTime="2026-07-06 21:22:13.398118443 +0000 UTC m=+41.871316063"
Jul 06 21:22:15.621462 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:15.621421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:15.621828 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:15.621568    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:15.621828 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:15.621589    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6487777b-6pzzk: secret "image-registry-tls" not found
Jul 06 21:22:15.621828 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:15.621644    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls podName:8c7271d5-468c-48d3-949a-417c8836ff70 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:23.621629686 +0000 UTC m=+52.094827284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls") pod "image-registry-5d6487777b-6pzzk" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70") : secret "image-registry-tls" not found
Jul 06 21:22:15.721860 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:15.721830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:15.722009 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:15.721989    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:15.722060 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:15.722051    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls podName:078ef4f4-78e7-481c-8203-bbdaf87ebfc2 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:23.722036905 +0000 UTC m=+52.195234503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls") pod "dns-default-jfzrw" (UID: "078ef4f4-78e7-481c-8203-bbdaf87ebfc2") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:18.702793 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.702728    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-624xr"]
Jul 06 21:22:18.730069 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.730034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-624xr"]
Jul 06 21:22:18.730218 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.730080    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.732677 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.732655    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 21:22:18.732812 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.732658    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 21:22:18.733090 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.733071    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 21:22:18.733199 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.733116    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 21:22:18.733973 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.733959    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-69gp7\""
Jul 06 21:22:18.844586 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.844544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.844771 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.844626    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.844771 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.844650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzzph\" (UniqueName: \"kubernetes.io/projected/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-api-access-mzzph\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.844771 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.844681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-data-volume\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.844875 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.844772    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-crio-socket\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.946045 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.946013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.946045 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.946051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.946277 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.946069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzzph\" (UniqueName: \"kubernetes.io/projected/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-api-access-mzzph\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.946277 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.946109    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-data-volume\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.946277 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:18.946144    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 21:22:18.946277 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.946163    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-crio-socket\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.946277 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:18.946184    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:18.946277 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:18.946235    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm podName:dfb1b6bf-f4c8-4e61-9099-e6173a60fe77 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:19.446214281 +0000 UTC m=+47.919411882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-624xr" (UID: "dfb1b6bf-f4c8-4e61-9099-e6173a60fe77") : configmap "kube-rbac-proxy" not found
Jul 06 21:22:18.946277 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:18.946255    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls podName:dfb1b6bf-f4c8-4e61-9099-e6173a60fe77 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:19.446245952 +0000 UTC m=+47.919443551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-624xr" (UID: "dfb1b6bf-f4c8-4e61-9099-e6173a60fe77") : secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:18.946277 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.946277    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-crio-socket\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.946611 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.946452    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-data-volume\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:18.958849 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:18.958793    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzzph\" (UniqueName: \"kubernetes.io/projected/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-api-access-mzzph\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:19.449861 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:19.449822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:19.449861 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:19.449865    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:19.450135 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:19.449966    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 21:22:19.450135 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:19.450000    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:19.450135 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:19.450041    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm podName:dfb1b6bf-f4c8-4e61-9099-e6173a60fe77 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:20.450025911 +0000 UTC m=+48.923223509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-624xr" (UID: "dfb1b6bf-f4c8-4e61-9099-e6173a60fe77") : configmap "kube-rbac-proxy" not found
Jul 06 21:22:19.450135 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:19.450080    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls podName:dfb1b6bf-f4c8-4e61-9099-e6173a60fe77 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:20.450065081 +0000 UTC m=+48.923262679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-624xr" (UID: "dfb1b6bf-f4c8-4e61-9099-e6173a60fe77") : secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:20.458067 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:20.458032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:20.458464 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:20.458071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:20.458464 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:20.458163    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 21:22:20.458464 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:20.458177    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:20.458464 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:20.458229    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm podName:dfb1b6bf-f4c8-4e61-9099-e6173a60fe77 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:22.45821393 +0000 UTC m=+50.931411528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-624xr" (UID: "dfb1b6bf-f4c8-4e61-9099-e6173a60fe77") : configmap "kube-rbac-proxy" not found
Jul 06 21:22:20.458464 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:20.458246    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls podName:dfb1b6bf-f4c8-4e61-9099-e6173a60fe77 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:22.458240449 +0000 UTC m=+50.931438047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-624xr" (UID: "dfb1b6bf-f4c8-4e61-9099-e6173a60fe77") : secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:20.478774 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:20.478746    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pkdw8_8b652d91-c369-4441-95fb-ebc6bd1a4cf3/dns-node-resolver/0.log"
Jul 06 21:22:21.453023 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.452986    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-c64q2"]
Jul 06 21:22:21.478681 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.478659    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6j9h5_f757d911-9917-454b-a588-22665813cd3f/node-ca/0.log"
Jul 06 21:22:21.484494 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.484473    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-c64q2"]
Jul 06 21:22:21.484636 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.484578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-c64q2"
Jul 06 21:22:21.487316 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.487298    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 21:22:21.487465 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.487447    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 21:22:21.488471 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.488448    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 21:22:21.488471 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.488462    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 21:22:21.488624 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.488461    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-d4snx\""
Jul 06 21:22:21.669912 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.669872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/437999c3-18ae-4435-9207-323061f4b93c-signing-key\") pod \"service-ca-758f599c5-c64q2\" (UID: \"437999c3-18ae-4435-9207-323061f4b93c\") " pod="openshift-service-ca/service-ca-758f599c5-c64q2"
Jul 06 21:22:21.670069 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.669936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46pdh\" (UniqueName: \"kubernetes.io/projected/437999c3-18ae-4435-9207-323061f4b93c-kube-api-access-46pdh\") pod \"service-ca-758f599c5-c64q2\" (UID: \"437999c3-18ae-4435-9207-323061f4b93c\") " pod="openshift-service-ca/service-ca-758f599c5-c64q2"
Jul 06 21:22:21.670069 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.670036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/437999c3-18ae-4435-9207-323061f4b93c-signing-cabundle\") pod \"service-ca-758f599c5-c64q2\" (UID: \"437999c3-18ae-4435-9207-323061f4b93c\") " pod="openshift-service-ca/service-ca-758f599c5-c64q2"
Jul 06 21:22:21.770864 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.770825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/437999c3-18ae-4435-9207-323061f4b93c-signing-cabundle\") pod \"service-ca-758f599c5-c64q2\" (UID: \"437999c3-18ae-4435-9207-323061f4b93c\") " pod="openshift-service-ca/service-ca-758f599c5-c64q2"
Jul 06 21:22:21.771051 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.770886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/437999c3-18ae-4435-9207-323061f4b93c-signing-key\") pod \"service-ca-758f599c5-c64q2\" (UID: \"437999c3-18ae-4435-9207-323061f4b93c\") " pod="openshift-service-ca/service-ca-758f599c5-c64q2"
Jul 06 21:22:21.771051 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.770944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46pdh\" (UniqueName: \"kubernetes.io/projected/437999c3-18ae-4435-9207-323061f4b93c-kube-api-access-46pdh\") pod \"service-ca-758f599c5-c64q2\" (UID: \"437999c3-18ae-4435-9207-323061f4b93c\") " pod="openshift-service-ca/service-ca-758f599c5-c64q2"
Jul 06 21:22:21.771560 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.771533    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/437999c3-18ae-4435-9207-323061f4b93c-signing-cabundle\") pod \"service-ca-758f599c5-c64q2\" (UID: \"437999c3-18ae-4435-9207-323061f4b93c\") " pod="openshift-service-ca/service-ca-758f599c5-c64q2"
Jul 06 21:22:21.773356 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.773334    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/437999c3-18ae-4435-9207-323061f4b93c-signing-key\") pod \"service-ca-758f599c5-c64q2\" (UID: \"437999c3-18ae-4435-9207-323061f4b93c\") " pod="openshift-service-ca/service-ca-758f599c5-c64q2"
Jul 06 21:22:21.790109 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.790082    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46pdh\" (UniqueName: \"kubernetes.io/projected/437999c3-18ae-4435-9207-323061f4b93c-kube-api-access-46pdh\") pod \"service-ca-758f599c5-c64q2\" (UID: \"437999c3-18ae-4435-9207-323061f4b93c\") " pod="openshift-service-ca/service-ca-758f599c5-c64q2"
Jul 06 21:22:21.793924 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.793887    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-c64q2"
Jul 06 21:22:21.944141 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:21.944113    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-c64q2"]
Jul 06 21:22:21.947266 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:21.947240    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437999c3_18ae_4435_9207_323061f4b93c.slice/crio-b9c62942c88c5fb36d0d53895ddbd3765b3883e5f0006dcf56f66ac535ac58d6 WatchSource:0}: Error finding container b9c62942c88c5fb36d0d53895ddbd3765b3883e5f0006dcf56f66ac535ac58d6: Status 404 returned error can't find the container with id b9c62942c88c5fb36d0d53895ddbd3765b3883e5f0006dcf56f66ac535ac58d6
Jul 06 21:22:22.371988 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:22.371954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-c64q2" event={"ID":"437999c3-18ae-4435-9207-323061f4b93c","Type":"ContainerStarted","Data":"b9c62942c88c5fb36d0d53895ddbd3765b3883e5f0006dcf56f66ac535ac58d6"}
Jul 06 21:22:22.478675 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:22.478639    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:22.478675 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:22.478684    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:22.479131 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:22.478795    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 21:22:22.479131 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:22.478804    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:22.479131 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:22.478886    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls podName:dfb1b6bf-f4c8-4e61-9099-e6173a60fe77 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:26.47886723 +0000 UTC m=+54.952064832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-624xr" (UID: "dfb1b6bf-f4c8-4e61-9099-e6173a60fe77") : secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:22.479131 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:22.478935    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm podName:dfb1b6bf-f4c8-4e61-9099-e6173a60fe77 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:26.478914744 +0000 UTC m=+54.952112357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-624xr" (UID: "dfb1b6bf-f4c8-4e61-9099-e6173a60fe77") : configmap "kube-rbac-proxy" not found
Jul 06 21:22:22.485736 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:22.485713    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n8lt5_4bc14ea5-8b5e-450a-805d-2ac426d61f0f/serve-healthcheck-canary/0.log"
Jul 06 21:22:23.690308 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:23.690278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:23.690650 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:23.690393    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 21:22:23.690650 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:23.690405    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d6487777b-6pzzk: secret "image-registry-tls" not found
Jul 06 21:22:23.690650 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:23.690463    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls podName:8c7271d5-468c-48d3-949a-417c8836ff70 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:39.690445929 +0000 UTC m=+68.163643539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls") pod "image-registry-5d6487777b-6pzzk" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70") : secret "image-registry-tls" not found
Jul 06 21:22:23.791215 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:23.791184    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:23.791408 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:23.791365    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 21:22:23.791471 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:23.791433    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls podName:078ef4f4-78e7-481c-8203-bbdaf87ebfc2 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:39.791415644 +0000 UTC m=+68.264613253 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls") pod "dns-default-jfzrw" (UID: "078ef4f4-78e7-481c-8203-bbdaf87ebfc2") : secret "dns-default-metrics-tls" not found
Jul 06 21:22:25.381199 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:25.381171    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-c64q2" event={"ID":"437999c3-18ae-4435-9207-323061f4b93c","Type":"ContainerStarted","Data":"860e93198ed536cb7e6ea9004db17cc68bf1c065c5a0f5780f5e19848dbd95b4"}
Jul 06 21:22:26.512754 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:26.512713    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:26.513236 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:26.513059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:26.513324 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:26.513302    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:26.513563 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:26.513543    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:26.513629 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:26.513608    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls podName:dfb1b6bf-f4c8-4e61-9099-e6173a60fe77 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:34.513590844 +0000 UTC m=+62.986788447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-624xr" (UID: "dfb1b6bf-f4c8-4e61-9099-e6173a60fe77") : secret "insights-runtime-extractor-tls" not found
Jul 06 21:22:33.329848 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:33.329821    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d2nlk"
Jul 06 21:22:33.369637 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:33.369582    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-c64q2" podStartSLOduration=9.738542648 podStartE2EDuration="12.369563706s" totalImagesPullingTime="2.631021058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:25.413239168 +0000 UTC m=+53.886436819" watchObservedRunningTime="2026-07-06 21:22:33.369563706 +0000 UTC m=+61.842761327"
Jul 06 21:22:34.575504 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:34.575461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:34.577872 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:34.577846    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dfb1b6bf-f4c8-4e61-9099-e6173a60fe77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-624xr\" (UID: \"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77\") " pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:34.641510 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:34.641476    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-69gp7\""
Jul 06 21:22:34.649854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:34.649832    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-624xr"
Jul 06 21:22:34.774512 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:34.774482    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-624xr"]
Jul 06 21:22:34.779054 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:34.779031    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb1b6bf_f4c8_4e61_9099_e6173a60fe77.slice/crio-f2f4e6042fa31ac0de0beb07a82ca286e1e79272b565a8dd0131bdbc1b4d16a7 WatchSource:0}: Error finding container f2f4e6042fa31ac0de0beb07a82ca286e1e79272b565a8dd0131bdbc1b4d16a7: Status 404 returned error can't find the container with id f2f4e6042fa31ac0de0beb07a82ca286e1e79272b565a8dd0131bdbc1b4d16a7
Jul 06 21:22:35.410887 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:35.410845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-624xr" event={"ID":"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77","Type":"ContainerStarted","Data":"f2f4e6042fa31ac0de0beb07a82ca286e1e79272b565a8dd0131bdbc1b4d16a7"}
Jul 06 21:22:37.701705 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.701668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:22:37.704702 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.704677    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 21:22:37.715039 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.715017    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71a13f26-90e5-41fe-abc1-49d5cfd57701-original-pull-secret\") pod \"global-pull-secret-syncer-9c4l2\" (UID: \"71a13f26-90e5-41fe-abc1-49d5cfd57701\") " pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:22:37.802930 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.802880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:22:37.806030 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.806006    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 21:22:37.815911 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.815876    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d9b6160-3c08-45a1-a0b3-dc682e2ac510-metrics-certs\") pod \"network-metrics-daemon-5vcrb\" (UID: \"0d9b6160-3c08-45a1-a0b3-dc682e2ac510\") " pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:22:37.869223 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.869188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c4l2"
Jul 06 21:22:37.885262 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.885238    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m4jxb\""
Jul 06 21:22:37.892625 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.892606    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5vcrb"
Jul 06 21:22:37.904130 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.904099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjnj\" (UniqueName: \"kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj\") pod \"network-check-target-42kbp\" (UID: \"0231785a-2385-4fcf-9791-594f396fed37\") " pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:22:37.909095 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.909076    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 21:22:37.917165 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.917138    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 21:22:37.928088 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:37.928066    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpjnj\" (UniqueName: \"kubernetes.io/projected/0231785a-2385-4fcf-9791-594f396fed37-kube-api-access-cpjnj\") pod \"network-check-target-42kbp\" (UID: \"0231785a-2385-4fcf-9791-594f396fed37\") " pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:22:38.192657 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:38.192626    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lhqbc\""
Jul 06 21:22:38.200644 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:38.200609    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:22:38.597655 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:38.597631    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5vcrb"]
Jul 06 21:22:38.600960 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:38.600932    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9b6160_3c08_45a1_a0b3_dc682e2ac510.slice/crio-2cf27c82626e015b56ed5bd35d7163c29637ad2edeed611e7e472ecba904c427 WatchSource:0}: Error finding container 2cf27c82626e015b56ed5bd35d7163c29637ad2edeed611e7e472ecba904c427: Status 404 returned error can't find the container with id 2cf27c82626e015b56ed5bd35d7163c29637ad2edeed611e7e472ecba904c427
Jul 06 21:22:38.823090 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:38.822989    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9c4l2"]
Jul 06 21:22:38.825062 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:38.825019    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-42kbp"]
Jul 06 21:22:38.827054 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:38.827029    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a13f26_90e5_41fe_abc1_49d5cfd57701.slice/crio-24ac20ee7b6b5b14e9ccc6b76b6ecf5c45bb337fe1df39c7259522a89abe392f WatchSource:0}: Error finding container 24ac20ee7b6b5b14e9ccc6b76b6ecf5c45bb337fe1df39c7259522a89abe392f: Status 404 returned error can't find the container with id 24ac20ee7b6b5b14e9ccc6b76b6ecf5c45bb337fe1df39c7259522a89abe392f
Jul 06 21:22:38.827708 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:38.827690    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0231785a_2385_4fcf_9791_594f396fed37.slice/crio-da008d18e24077046969966b7e91a1590bb5960a16a72a26c56a50042a4b18d9 WatchSource:0}: Error finding container da008d18e24077046969966b7e91a1590bb5960a16a72a26c56a50042a4b18d9: Status 404 returned error can't find the container with id da008d18e24077046969966b7e91a1590bb5960a16a72a26c56a50042a4b18d9
Jul 06 21:22:39.422970 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:39.422925    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-42kbp" event={"ID":"0231785a-2385-4fcf-9791-594f396fed37","Type":"ContainerStarted","Data":"da008d18e24077046969966b7e91a1590bb5960a16a72a26c56a50042a4b18d9"}
Jul 06 21:22:39.424515 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:39.424484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9c4l2" event={"ID":"71a13f26-90e5-41fe-abc1-49d5cfd57701","Type":"ContainerStarted","Data":"24ac20ee7b6b5b14e9ccc6b76b6ecf5c45bb337fe1df39c7259522a89abe392f"}
Jul 06 21:22:39.425993 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:39.425966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vcrb" event={"ID":"0d9b6160-3c08-45a1-a0b3-dc682e2ac510","Type":"ContainerStarted","Data":"2cf27c82626e015b56ed5bd35d7163c29637ad2edeed611e7e472ecba904c427"}
Jul 06 21:22:39.427807 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:39.427768    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-624xr" event={"ID":"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77","Type":"ContainerStarted","Data":"da62eea560fe236b0784adad9ba7f0c3bda14fbc8c273a43e124656d33be9552"}
Jul 06 21:22:39.717072 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:39.716994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:39.726586 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:39.726548    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls\") pod \"image-registry-5d6487777b-6pzzk\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") " pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:39.817772 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:39.817731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:39.821764 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:39.821708    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/078ef4f4-78e7-481c-8203-bbdaf87ebfc2-metrics-tls\") pod \"dns-default-jfzrw\" (UID: \"078ef4f4-78e7-481c-8203-bbdaf87ebfc2\") " pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:40.010338 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:40.010306    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kq6tm\""
Jul 06 21:22:40.017537 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:40.017509    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:40.043912 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:40.043861    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9fg2d\""
Jul 06 21:22:40.051523 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:40.051498    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:40.254873 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:40.254846    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d6487777b-6pzzk"]
Jul 06 21:22:40.258754 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:40.258724    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7271d5_468c_48d3_949a_417c8836ff70.slice/crio-64ae7e91aa701506dd460af7f84d8b1c6f092133487f9ab759582f35793cb0ce WatchSource:0}: Error finding container 64ae7e91aa701506dd460af7f84d8b1c6f092133487f9ab759582f35793cb0ce: Status 404 returned error can't find the container with id 64ae7e91aa701506dd460af7f84d8b1c6f092133487f9ab759582f35793cb0ce
Jul 06 21:22:40.273658 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:40.273636    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jfzrw"]
Jul 06 21:22:40.433589 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:40.433546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk" event={"ID":"8c7271d5-468c-48d3-949a-417c8836ff70","Type":"ContainerStarted","Data":"64ae7e91aa701506dd460af7f84d8b1c6f092133487f9ab759582f35793cb0ce"}
Jul 06 21:22:40.435789 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:40.435433    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078ef4f4_78e7_481c_8203_bbdaf87ebfc2.slice/crio-0919fa981ce83d017d12b5bcf0690914e9965459851d0c37c068ec4098603717 WatchSource:0}: Error finding container 0919fa981ce83d017d12b5bcf0690914e9965459851d0c37c068ec4098603717: Status 404 returned error can't find the container with id 0919fa981ce83d017d12b5bcf0690914e9965459851d0c37c068ec4098603717
Jul 06 21:22:40.436970 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:40.436843    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-624xr" event={"ID":"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77","Type":"ContainerStarted","Data":"44f40f6f103e000cf70a2ba6b75add237ebc55e255bb7fc8bcf0981e3f809c02"}
Jul 06 21:22:41.445722 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:41.445651    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vcrb" event={"ID":"0d9b6160-3c08-45a1-a0b3-dc682e2ac510","Type":"ContainerStarted","Data":"68e0fb1945d8367f4feb389e530449b4c6cdc4b09ec51e261a4d4d2743e93cd6"}
Jul 06 21:22:41.445722 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:41.445719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5vcrb" event={"ID":"0d9b6160-3c08-45a1-a0b3-dc682e2ac510","Type":"ContainerStarted","Data":"0c4b5bbb866aef2a94cfe24ab03845919674452d8442099a6dc9121c3d937cb2"}
Jul 06 21:22:41.448449 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:41.448366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jfzrw" event={"ID":"078ef4f4-78e7-481c-8203-bbdaf87ebfc2","Type":"ContainerStarted","Data":"0919fa981ce83d017d12b5bcf0690914e9965459851d0c37c068ec4098603717"}
Jul 06 21:22:41.451356 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:41.450942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk" event={"ID":"8c7271d5-468c-48d3-949a-417c8836ff70","Type":"ContainerStarted","Data":"77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4"}
Jul 06 21:22:41.451356 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:41.451119    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:22:41.466855 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:41.465972    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5vcrb" podStartSLOduration=66.607327078 podStartE2EDuration="1m8.465954694s" totalImagesPullingTime="1.858627616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:41.465539436 +0000 UTC m=+69.938737051" watchObservedRunningTime="2026-07-06 21:22:41.465954694 +0000 UTC m=+69.939152316"
Jul 06 21:22:45.220262 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.220213    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk" podStartSLOduration=44.220198007 podStartE2EDuration="44.220198007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:41.4921875 +0000 UTC m=+69.965385140" watchObservedRunningTime="2026-07-06 21:22:45.220198007 +0000 UTC m=+73.693395627"
Jul 06 21:22:45.220869 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.220847    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d6487777b-6pzzk"]
Jul 06 21:22:45.276636 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.276606    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"]
Jul 06 21:22:45.279042 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.279020    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:45.281576 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.281553    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 21:22:45.281770 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.281755    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 21:22:45.282174 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.282148    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 21:22:45.282421 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.282151    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 06 21:22:45.294607 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.294498    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"]
Jul 06 21:22:45.322048 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.322016    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx"]
Jul 06 21:22:45.324013 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.323980    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-z596j"]
Jul 06 21:22:45.324153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.324136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx"
Jul 06 21:22:45.325798 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.325743    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68f69cf476-lcrph"]
Jul 06 21:22:45.325885 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.325862    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-z596j"
Jul 06 21:22:45.327601 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.327472    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.328515 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.328491    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2jgk5\""
Jul 06 21:22:45.329211 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.329190    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 21:22:45.329366 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.329352    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 21:22:45.330438 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.330418    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-n8csk\""
Jul 06 21:22:45.330691 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.330672    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 21:22:45.331545 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.331525    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 21:22:45.339194 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.339173    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx"]
Jul 06 21:22:45.347114 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.347091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-z596j"]
Jul 06 21:22:45.348590 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.348571    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68f69cf476-lcrph"]
Jul 06 21:22:45.362962 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.362942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv6q9\" (UniqueName: \"kubernetes.io/projected/cb1694cf-f7de-4310-b471-e8bf2c29bad1-kube-api-access-mv6q9\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.363854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0922d956-cfda-4f0c-88fc-f38039c073fa-klusterlet-config\") pod \"klusterlet-addon-workmgr-6557b6c9fd-w4nn7\" (UID: \"0922d956-cfda-4f0c-88fc-f38039c073fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:45.363854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0922d956-cfda-4f0c-88fc-f38039c073fa-tmp\") pod \"klusterlet-addon-workmgr-6557b6c9fd-w4nn7\" (UID: \"0922d956-cfda-4f0c-88fc-f38039c073fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:45.363854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363539    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb1694cf-f7de-4310-b471-e8bf2c29bad1-registry-certificates\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.363854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-lc4dx\" (UID: \"d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx"
Jul 06 21:22:45.363854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363617    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb1694cf-f7de-4310-b471-e8bf2c29bad1-registry-tls\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.363854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb1694cf-f7de-4310-b471-e8bf2c29bad1-ca-trust-extracted\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.363854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lc4dx\" (UID: \"d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx"
Jul 06 21:22:45.363854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363716    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb1694cf-f7de-4310-b471-e8bf2c29bad1-trusted-ca\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.363854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvfd8\" (UniqueName: \"kubernetes.io/projected/2986c8b9-b265-40a9-8c0c-62d3711daa05-kube-api-access-fvfd8\") pod \"downloads-685bfb5f64-z596j\" (UID: \"2986c8b9-b265-40a9-8c0c-62d3711daa05\") " pod="openshift-console/downloads-685bfb5f64-z596j"
Jul 06 21:22:45.363854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44vs5\" (UniqueName: \"kubernetes.io/projected/0922d956-cfda-4f0c-88fc-f38039c073fa-kube-api-access-44vs5\") pod \"klusterlet-addon-workmgr-6557b6c9fd-w4nn7\" (UID: \"0922d956-cfda-4f0c-88fc-f38039c073fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:45.363854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb1694cf-f7de-4310-b471-e8bf2c29bad1-image-registry-private-configuration\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.364418 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb1694cf-f7de-4310-b471-e8bf2c29bad1-installation-pull-secrets\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.364418 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.363943    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb1694cf-f7de-4310-b471-e8bf2c29bad1-bound-sa-token\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.465065 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0922d956-cfda-4f0c-88fc-f38039c073fa-tmp\") pod \"klusterlet-addon-workmgr-6557b6c9fd-w4nn7\" (UID: \"0922d956-cfda-4f0c-88fc-f38039c073fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:45.465155 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb1694cf-f7de-4310-b471-e8bf2c29bad1-registry-certificates\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.465155 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-lc4dx\" (UID: \"d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx"
Jul 06 21:22:45.465155 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb1694cf-f7de-4310-b471-e8bf2c29bad1-registry-tls\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.465298 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb1694cf-f7de-4310-b471-e8bf2c29bad1-ca-trust-extracted\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.465298 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465185    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lc4dx\" (UID: \"d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx"
Jul 06 21:22:45.465298 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465213    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb1694cf-f7de-4310-b471-e8bf2c29bad1-trusted-ca\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.465298 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvfd8\" (UniqueName: \"kubernetes.io/projected/2986c8b9-b265-40a9-8c0c-62d3711daa05-kube-api-access-fvfd8\") pod \"downloads-685bfb5f64-z596j\" (UID: \"2986c8b9-b265-40a9-8c0c-62d3711daa05\") " pod="openshift-console/downloads-685bfb5f64-z596j"
Jul 06 21:22:45.465298 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44vs5\" (UniqueName: \"kubernetes.io/projected/0922d956-cfda-4f0c-88fc-f38039c073fa-kube-api-access-44vs5\") pod \"klusterlet-addon-workmgr-6557b6c9fd-w4nn7\" (UID: \"0922d956-cfda-4f0c-88fc-f38039c073fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:45.465550 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb1694cf-f7de-4310-b471-e8bf2c29bad1-image-registry-private-configuration\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.465550 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb1694cf-f7de-4310-b471-e8bf2c29bad1-installation-pull-secrets\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.465550 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb1694cf-f7de-4310-b471-e8bf2c29bad1-bound-sa-token\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.465550 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv6q9\" (UniqueName: \"kubernetes.io/projected/cb1694cf-f7de-4310-b471-e8bf2c29bad1-kube-api-access-mv6q9\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.465550 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0922d956-cfda-4f0c-88fc-f38039c073fa-klusterlet-config\") pod \"klusterlet-addon-workmgr-6557b6c9fd-w4nn7\" (UID: \"0922d956-cfda-4f0c-88fc-f38039c073fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:45.465785 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.465559    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0922d956-cfda-4f0c-88fc-f38039c073fa-tmp\") pod \"klusterlet-addon-workmgr-6557b6c9fd-w4nn7\" (UID: \"0922d956-cfda-4f0c-88fc-f38039c073fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:45.466498 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.466472    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cb1694cf-f7de-4310-b471-e8bf2c29bad1-registry-certificates\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.468411 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.468355    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cb1694cf-f7de-4310-b471-e8bf2c29bad1-ca-trust-extracted\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.468411 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.468391    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cb1694cf-f7de-4310-b471-e8bf2c29bad1-trusted-ca\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.468571 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.468428    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-lc4dx\" (UID: \"d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx"
Jul 06 21:22:45.471664 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.471561    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cb1694cf-f7de-4310-b471-e8bf2c29bad1-installation-pull-secrets\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.472372 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.472329    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-lc4dx\" (UID: \"d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx"
Jul 06 21:22:45.474468 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.474067    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cb1694cf-f7de-4310-b471-e8bf2c29bad1-image-registry-private-configuration\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.474468 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.474428    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0922d956-cfda-4f0c-88fc-f38039c073fa-klusterlet-config\") pod \"klusterlet-addon-workmgr-6557b6c9fd-w4nn7\" (UID: \"0922d956-cfda-4f0c-88fc-f38039c073fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:45.476303 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.476193    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cb1694cf-f7de-4310-b471-e8bf2c29bad1-registry-tls\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.480571 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.480549    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb1694cf-f7de-4310-b471-e8bf2c29bad1-bound-sa-token\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.484541 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.484519    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvfd8\" (UniqueName: \"kubernetes.io/projected/2986c8b9-b265-40a9-8c0c-62d3711daa05-kube-api-access-fvfd8\") pod \"downloads-685bfb5f64-z596j\" (UID: \"2986c8b9-b265-40a9-8c0c-62d3711daa05\") " pod="openshift-console/downloads-685bfb5f64-z596j"
Jul 06 21:22:45.489168 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.489148    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv6q9\" (UniqueName: \"kubernetes.io/projected/cb1694cf-f7de-4310-b471-e8bf2c29bad1-kube-api-access-mv6q9\") pod \"image-registry-68f69cf476-lcrph\" (UID: \"cb1694cf-f7de-4310-b471-e8bf2c29bad1\") " pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.492334 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.492315    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44vs5\" (UniqueName: \"kubernetes.io/projected/0922d956-cfda-4f0c-88fc-f38039c073fa-kube-api-access-44vs5\") pod \"klusterlet-addon-workmgr-6557b6c9fd-w4nn7\" (UID: \"0922d956-cfda-4f0c-88fc-f38039c073fa\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:45.590000 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.589976    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:45.636602 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.636562    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx"
Jul 06 21:22:45.645057 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.644840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-z596j"
Jul 06 21:22:45.651404 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.651189    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:45.750292 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.750172    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"]
Jul 06 21:22:45.757807 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:45.757779    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0922d956_cfda_4f0c_88fc_f38039c073fa.slice/crio-ed975222717ed05bb435322634a9315f9ebcfc0fcdd5868164cfa8198dc5c0df WatchSource:0}: Error finding container ed975222717ed05bb435322634a9315f9ebcfc0fcdd5868164cfa8198dc5c0df: Status 404 returned error can't find the container with id ed975222717ed05bb435322634a9315f9ebcfc0fcdd5868164cfa8198dc5c0df
Jul 06 21:22:45.805768 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.805735    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx"]
Jul 06 21:22:45.809244 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:45.809219    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9dab0c6_0a68_4e67_8b47_4698ae7ae3ec.slice/crio-b477897a1377c753c786c1febe2c1c250eab4cc25e27ef7eade7c416e0fe1186 WatchSource:0}: Error finding container b477897a1377c753c786c1febe2c1c250eab4cc25e27ef7eade7c416e0fe1186: Status 404 returned error can't find the container with id b477897a1377c753c786c1febe2c1c250eab4cc25e27ef7eade7c416e0fe1186
Jul 06 21:22:45.832739 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.832713    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-z596j"]
Jul 06 21:22:45.836156 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:45.836134    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2986c8b9_b265_40a9_8c0c_62d3711daa05.slice/crio-66abd6c77b7cd746737f90dbd58d9340e51fdc55ecd44fa548fc62adeef7228f WatchSource:0}: Error finding container 66abd6c77b7cd746737f90dbd58d9340e51fdc55ecd44fa548fc62adeef7228f: Status 404 returned error can't find the container with id 66abd6c77b7cd746737f90dbd58d9340e51fdc55ecd44fa548fc62adeef7228f
Jul 06 21:22:45.853305 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:45.853279    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68f69cf476-lcrph"]
Jul 06 21:22:45.857019 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:45.856998    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1694cf_f7de_4310_b471_e8bf2c29bad1.slice/crio-d45b5c6b7e2eaefd68f6d3da080f6e0e8c04f75c120150488d559f51db8b1514 WatchSource:0}: Error finding container d45b5c6b7e2eaefd68f6d3da080f6e0e8c04f75c120150488d559f51db8b1514: Status 404 returned error can't find the container with id d45b5c6b7e2eaefd68f6d3da080f6e0e8c04f75c120150488d559f51db8b1514
Jul 06 21:22:46.049467 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.049371    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh"]
Jul 06 21:22:46.059789 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.059762    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh"
Jul 06 21:22:46.067597 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.067571    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh"]
Jul 06 21:22:46.067853 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.067832    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 21:22:46.068070 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.067840    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tspzt\""
Jul 06 21:22:46.171011 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.170977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/adee7de3-b969-4b11-ac4d-298f7f149dd0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-m9qlh\" (UID: \"adee7de3-b969-4b11-ac4d-298f7f149dd0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh"
Jul 06 21:22:46.272334 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.272306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/adee7de3-b969-4b11-ac4d-298f7f149dd0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-m9qlh\" (UID: \"adee7de3-b969-4b11-ac4d-298f7f149dd0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh"
Jul 06 21:22:46.274729 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.274711    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/adee7de3-b969-4b11-ac4d-298f7f149dd0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-m9qlh\" (UID: \"adee7de3-b969-4b11-ac4d-298f7f149dd0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh"
Jul 06 21:22:46.372195 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.372134    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh"
Jul 06 21:22:46.484490 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.484430    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx" event={"ID":"d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec","Type":"ContainerStarted","Data":"b477897a1377c753c786c1febe2c1c250eab4cc25e27ef7eade7c416e0fe1186"}
Jul 06 21:22:46.486378 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.486345    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-42kbp" event={"ID":"0231785a-2385-4fcf-9791-594f396fed37","Type":"ContainerStarted","Data":"9c0a26abc9a091340df7fed8c217e3a9100ec8268d59d1e632fbb61b3790962a"}
Jul 06 21:22:46.487053 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.487032    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:22:46.489051 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.489024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9c4l2" event={"ID":"71a13f26-90e5-41fe-abc1-49d5cfd57701","Type":"ContainerStarted","Data":"72c71ce0d78fde9b43eab12c3c530dc0be9fd792d56ec03c5cdf3e24d619ac1c"}
Jul 06 21:22:46.491282 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.491242    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-z596j" event={"ID":"2986c8b9-b265-40a9-8c0c-62d3711daa05","Type":"ContainerStarted","Data":"66abd6c77b7cd746737f90dbd58d9340e51fdc55ecd44fa548fc62adeef7228f"}
Jul 06 21:22:46.496313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.496259    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-624xr" event={"ID":"dfb1b6bf-f4c8-4e61-9099-e6173a60fe77","Type":"ContainerStarted","Data":"1d3a6d4e9cfe5c4217682e04ae027d02f882f95b91ca22597fa93cc8d0161a36"}
Jul 06 21:22:46.498588 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.498566    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jfzrw" event={"ID":"078ef4f4-78e7-481c-8203-bbdaf87ebfc2","Type":"ContainerStarted","Data":"cc08eafcafe47e0fb783fc119c762fae601db3c79130d417a28225f98cb1627f"}
Jul 06 21:22:46.498677 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.498608    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jfzrw" event={"ID":"078ef4f4-78e7-481c-8203-bbdaf87ebfc2","Type":"ContainerStarted","Data":"95013579f7bf70769bd29781ef14aa6720b3671af9d31b6f464db39df7c12864"}
Jul 06 21:22:46.498797 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.498784    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:46.502440 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.501814    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68f69cf476-lcrph" event={"ID":"cb1694cf-f7de-4310-b471-e8bf2c29bad1","Type":"ContainerStarted","Data":"30344ba710b508d3543c6cd8d2b7f5aab04796c07bb41f773aa5e2e2c16169d9"}
Jul 06 21:22:46.502440 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.501916    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68f69cf476-lcrph" event={"ID":"cb1694cf-f7de-4310-b471-e8bf2c29bad1","Type":"ContainerStarted","Data":"d45b5c6b7e2eaefd68f6d3da080f6e0e8c04f75c120150488d559f51db8b1514"}
Jul 06 21:22:46.505136 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.502614    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:22:46.505136 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.503991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7" event={"ID":"0922d956-cfda-4f0c-88fc-f38039c073fa","Type":"ContainerStarted","Data":"ed975222717ed05bb435322634a9315f9ebcfc0fcdd5868164cfa8198dc5c0df"}
Jul 06 21:22:46.507249 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.507200    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-42kbp" podStartSLOduration=66.964160565 podStartE2EDuration="1m13.507184411s" totalImagesPullingTime="6.543023846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:46.506211306 +0000 UTC m=+74.979408927" watchObservedRunningTime="2026-07-06 21:22:46.507184411 +0000 UTC m=+74.980382032"
Jul 06 21:22:46.534448 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.534423    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh"]
Jul 06 21:22:46.537552 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:46.537528    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadee7de3_b969_4b11_ac4d_298f7f149dd0.slice/crio-2179ce56d3cfe4eee41019437db0e30515462030177cb0a165f27ad97c57ab0b WatchSource:0}: Error finding container 2179ce56d3cfe4eee41019437db0e30515462030177cb0a165f27ad97c57ab0b: Status 404 returned error can't find the container with id 2179ce56d3cfe4eee41019437db0e30515462030177cb0a165f27ad97c57ab0b
Jul 06 21:22:46.537663 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.537572    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jfzrw" podStartSLOduration=34.606505747 podStartE2EDuration="39.537559068s" totalImagesPullingTime="4.931053321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:46.53625361 +0000 UTC m=+75.009451231" watchObservedRunningTime="2026-07-06 21:22:46.537559068 +0000 UTC m=+75.010756687"
Jul 06 21:22:46.559726 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.559685    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-624xr" podStartSLOduration=18.100938979 podStartE2EDuration="28.559668844s" totalImagesPullingTime="10.458729865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:22:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:46.559256622 +0000 UTC m=+75.032454243" watchObservedRunningTime="2026-07-06 21:22:46.559668844 +0000 UTC m=+75.032866464"
Jul 06 21:22:46.595600 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.595091    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68f69cf476-lcrph" podStartSLOduration=1.59507033 podStartE2EDuration="1.59507033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:46.593860431 +0000 UTC m=+75.067058068" watchObservedRunningTime="2026-07-06 21:22:46.59507033 +0000 UTC m=+75.068267950"
Jul 06 21:22:46.618873 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:46.618817    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9c4l2" podStartSLOduration=67.042647836 podStartE2EDuration="1m13.618802572s" totalImagesPullingTime="6.576154736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 21:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:46.617856471 +0000 UTC m=+75.091054092" watchObservedRunningTime="2026-07-06 21:22:46.618802572 +0000 UTC m=+75.092000173"
Jul 06 21:22:47.512241 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:47.511890    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx" event={"ID":"d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec","Type":"ContainerStarted","Data":"d52c7e280148075cf202400da62d33c70bf89a4097ba6587ff3cf42ae9028ecb"}
Jul 06 21:22:47.514194 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:47.513938    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh" event={"ID":"adee7de3-b969-4b11-ac4d-298f7f149dd0","Type":"ContainerStarted","Data":"2179ce56d3cfe4eee41019437db0e30515462030177cb0a165f27ad97c57ab0b"}
Jul 06 21:22:47.530540 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:47.529539    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-lc4dx" podStartSLOduration=1.085303235 podStartE2EDuration="2.529519349s" totalImagesPullingTime="1.444216114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:47.528310334 +0000 UTC m=+76.001507956" watchObservedRunningTime="2026-07-06 21:22:47.529519349 +0000 UTC m=+76.002716970"
Jul 06 21:22:49.289786 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.289748    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f6dc9c8df-gsjh6"]
Jul 06 21:22:49.292070 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.292046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.295199 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.295172    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 21:22:49.295328 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.295307    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 21:22:49.296677 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.296532    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-89lh7\""
Jul 06 21:22:49.296677 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.296553    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 21:22:49.296792 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.296748    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 21:22:49.296935 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.296922    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 21:22:49.304314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.304294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6dc9c8df-gsjh6"]
Jul 06 21:22:49.403364 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.403335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fqg7\" (UniqueName: \"kubernetes.io/projected/17dbb4a8-a0be-4c5a-a468-3814313e0b96-kube-api-access-7fqg7\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.403364 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.403376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-oauth-serving-cert\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.403600 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.403410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-config\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.403600 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.403465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-serving-cert\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.403600 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.403512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-oauth-config\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.403600 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.403556    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-service-ca\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.504841 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.504807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-service-ca\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.505027 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.504882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fqg7\" (UniqueName: \"kubernetes.io/projected/17dbb4a8-a0be-4c5a-a468-3814313e0b96-kube-api-access-7fqg7\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.505027 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.504936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-oauth-serving-cert\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.505027 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.504966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-config\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.505202 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.505158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-serving-cert\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.505274 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.505213    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-oauth-config\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.505648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.505618    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-oauth-serving-cert\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.505768 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.505649    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-config\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.505768 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.505654    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-service-ca\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.507952 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.507931    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-serving-cert\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.507952 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.507946    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-oauth-config\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.515484 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.515465    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fqg7\" (UniqueName: \"kubernetes.io/projected/17dbb4a8-a0be-4c5a-a468-3814313e0b96-kube-api-access-7fqg7\") pod \"console-5f6dc9c8df-gsjh6\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") " pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:49.605401 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:49.605316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:50.276944 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:50.276873    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6dc9c8df-gsjh6"]
Jul 06 21:22:50.279330 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:50.279305    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17dbb4a8_a0be_4c5a_a468_3814313e0b96.slice/crio-b0aecc0fab378059a1be5d4784d5e96f953b196a506e9937495eab4be62745a2 WatchSource:0}: Error finding container b0aecc0fab378059a1be5d4784d5e96f953b196a506e9937495eab4be62745a2: Status 404 returned error can't find the container with id b0aecc0fab378059a1be5d4784d5e96f953b196a506e9937495eab4be62745a2
Jul 06 21:22:50.526989 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:50.526956    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7" event={"ID":"0922d956-cfda-4f0c-88fc-f38039c073fa","Type":"ContainerStarted","Data":"a84e999c382a6ce59e8b9b6fb0ac3ad99f1d51bff9832418b0bb509586dadb51"}
Jul 06 21:22:50.527386 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:50.527148    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:50.528285 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:50.528260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6dc9c8df-gsjh6" event={"ID":"17dbb4a8-a0be-4c5a-a468-3814313e0b96","Type":"ContainerStarted","Data":"b0aecc0fab378059a1be5d4784d5e96f953b196a506e9937495eab4be62745a2"}
Jul 06 21:22:50.529023 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:50.528997    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7"
Jul 06 21:22:50.529779 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:50.529757    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh" event={"ID":"adee7de3-b969-4b11-ac4d-298f7f149dd0","Type":"ContainerStarted","Data":"d7893678bf0fa0f441ef0ddab29f5901be92d1e0d0b57bd41a54af3bf8bf9764"}
Jul 06 21:22:50.529948 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:50.529935    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh"
Jul 06 21:22:50.534282 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:50.534267    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh"
Jul 06 21:22:50.546142 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:50.546099    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6557b6c9fd-w4nn7" podStartSLOduration=1.1701738210000001 podStartE2EDuration="5.546087326s" totalImagesPullingTime="4.375913505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:50.544758341 +0000 UTC m=+79.017955961" watchObservedRunningTime="2026-07-06 21:22:50.546087326 +0000 UTC m=+79.019284942"
Jul 06 21:22:50.578866 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:50.578828    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-m9qlh" podStartSLOduration=0.999116376 podStartE2EDuration="4.578814864s" totalImagesPullingTime="3.579698488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:50.57791881 +0000 UTC m=+79.051116421" watchObservedRunningTime="2026-07-06 21:22:50.578814864 +0000 UTC m=+79.052012483"
Jul 06 21:22:51.449721 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.449687    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77466d5fbb-k9jnw"]
Jul 06 21:22:51.452322 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.452302    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.461076 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.461053    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 21:22:51.464343 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.464319    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77466d5fbb-k9jnw"]
Jul 06 21:22:51.522671 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.522631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-service-ca\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.522671 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.522682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-oauth-serving-cert\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.522855 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.522707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4whr7\" (UniqueName: \"kubernetes.io/projected/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-kube-api-access-4whr7\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.522855 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.522730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-oauth-config\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.522855 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.522753    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-serving-cert\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.522855 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.522819    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-trusted-ca-bundle\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.523025 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.522862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-config\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.624260 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.624228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-service-ca\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.624260 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.624268    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-oauth-serving-cert\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.624773 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.624301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4whr7\" (UniqueName: \"kubernetes.io/projected/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-kube-api-access-4whr7\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.624773 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.624327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-oauth-config\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.624773 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.624371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-serving-cert\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.625123 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.625087    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-service-ca\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.625213 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.625119    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-trusted-ca-bundle\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.625213 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.625109    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-oauth-serving-cert\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.625477 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.625454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-config\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.626054 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.626022    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-config\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.626054 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.626045    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-trusted-ca-bundle\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.627213 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.627170    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-oauth-config\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.627312 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.627290    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-serving-cert\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.637489 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.637470    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4whr7\" (UniqueName: \"kubernetes.io/projected/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-kube-api-access-4whr7\") pod \"console-77466d5fbb-k9jnw\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") " pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.762946 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.762887    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:22:51.908624 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:51.908439    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77466d5fbb-k9jnw"]
Jul 06 21:22:51.911960 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:51.911934    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62162f3f_7cfc_4822_b75e_91d0cbc34e6a.slice/crio-8a45b6752a1c3a24c8bc4e275991adb05436d79e98250418227c179ba0a4d0d5 WatchSource:0}: Error finding container 8a45b6752a1c3a24c8bc4e275991adb05436d79e98250418227c179ba0a4d0d5: Status 404 returned error can't find the container with id 8a45b6752a1c3a24c8bc4e275991adb05436d79e98250418227c179ba0a4d0d5
Jul 06 21:22:52.540254 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:52.540106    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77466d5fbb-k9jnw" event={"ID":"62162f3f-7cfc-4822-b75e-91d0cbc34e6a","Type":"ContainerStarted","Data":"8a45b6752a1c3a24c8bc4e275991adb05436d79e98250418227c179ba0a4d0d5"}
Jul 06 21:22:54.551360 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:54.551315    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6dc9c8df-gsjh6" event={"ID":"17dbb4a8-a0be-4c5a-a468-3814313e0b96","Type":"ContainerStarted","Data":"592236d1795ba6fe640b860f24a3f9a13e4c1ee540b3fded29cf76a94a78069a"}
Jul 06 21:22:54.553269 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:54.553239    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77466d5fbb-k9jnw" event={"ID":"62162f3f-7cfc-4822-b75e-91d0cbc34e6a","Type":"ContainerStarted","Data":"139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e"}
Jul 06 21:22:54.571338 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:54.571297    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f6dc9c8df-gsjh6" podStartSLOduration=2.062320534 podStartE2EDuration="5.57128438s" totalImagesPullingTime="3.508963846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:54.570637796 +0000 UTC m=+83.043835608" watchObservedRunningTime="2026-07-06 21:22:54.57128438 +0000 UTC m=+83.044482001"
Jul 06 21:22:54.592225 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:54.592180    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77466d5fbb-k9jnw" podStartSLOduration=1.711275135 podStartE2EDuration="3.59213985s" totalImagesPullingTime="1.880864715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:54.591102018 +0000 UTC m=+83.064299638" watchObservedRunningTime="2026-07-06 21:22:54.59213985 +0000 UTC m=+83.065337469"
Jul 06 21:22:55.227532 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:55.227492    2564 patch_prober.go:28] interesting pod/image-registry-5d6487777b-6pzzk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 06 21:22:55.227704 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:55.227557    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk" podUID="8c7271d5-468c-48d3-949a-417c8836ff70" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 21:22:56.517684 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.517654    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jfzrw"
Jul 06 21:22:56.549284 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.549251    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"]
Jul 06 21:22:56.552351 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.552303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.554949 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.554772    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 21:22:56.555263 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.555120    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pbqqb\""
Jul 06 21:22:56.555387 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.555367    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 21:22:56.555463 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.555391    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 21:22:56.555652 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.555637    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 21:22:56.555734 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.555676    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 21:22:56.591236 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.590978    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"]
Jul 06 21:22:56.653848 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.653819    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ph7gd"]
Jul 06 21:22:56.656569 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.656549    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.670481 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.670270    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 21:22:56.670481 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.670286    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zzc4v\""
Jul 06 21:22:56.670481 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.670465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzj9t\" (UniqueName: \"kubernetes.io/projected/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-kube-api-access-hzj9t\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.670723 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.670523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.670723 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.670620    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 21:22:56.670723 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.670634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.670846 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.670750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.677835 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.677816    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-tls\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-sys\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771261    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfjzh\" (UniqueName: \"kubernetes.io/projected/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-kube-api-access-vfjzh\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzj9t\" (UniqueName: \"kubernetes.io/projected/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-kube-api-access-hzj9t\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771388    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-accelerators-collector-config\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771427    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771480    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-textfile\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771544    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-metrics-client-ca\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-wtmp\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.771639    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-root\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:56.771714    2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 06 21:22:56.772153 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:22:56.771776    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-openshift-state-metrics-tls podName:7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5 nodeName:}" failed. No retries permitted until 2026-07-06 21:22:57.271755471 +0000 UTC m=+85.744953075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-gpdjj" (UID: "7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5") : secret "openshift-state-metrics-tls" not found
Jul 06 21:22:56.773049 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.772798    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.783509 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.783482    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.793610 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.793580    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzj9t\" (UniqueName: \"kubernetes.io/projected/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-kube-api-access-hzj9t\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:56.872073 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-root\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872218 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-tls\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872218 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-sys\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872218 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872114    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-root\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872218 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfjzh\" (UniqueName: \"kubernetes.io/projected/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-kube-api-access-vfjzh\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872218 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-accelerators-collector-config\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872218 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872431 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872244    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-textfile\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872431 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-metrics-client-ca\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872431 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-wtmp\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872521 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872436    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-wtmp\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872578 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872560    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-sys\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.872845 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.872822    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-textfile\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.873105 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.873058    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-accelerators-collector-config\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.873105 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.873102    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-metrics-client-ca\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.875234 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.875212    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-tls\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.875326 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.875212    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.883886 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.883866    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfjzh\" (UniqueName: \"kubernetes.io/projected/dfbbe407-cb5e-4f13-9f38-a0b4a58b2508-kube-api-access-vfjzh\") pod \"node-exporter-ph7gd\" (UID: \"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508\") " pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.968776 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:56.968748    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ph7gd"
Jul 06 21:22:56.982652 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:56.982622    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfbbe407_cb5e_4f13_9f38_a0b4a58b2508.slice/crio-ae159eddd7e9d0f2161314d8f5296f7950eb931642b72b4f93476578dd3308ae WatchSource:0}: Error finding container ae159eddd7e9d0f2161314d8f5296f7950eb931642b72b4f93476578dd3308ae: Status 404 returned error can't find the container with id ae159eddd7e9d0f2161314d8f5296f7950eb931642b72b4f93476578dd3308ae
Jul 06 21:22:57.275409 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:57.275378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:57.277812 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:57.277785    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-gpdjj\" (UID: \"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:57.465641 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:57.465353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"
Jul 06 21:22:57.568882 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:57.568799    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ph7gd" event={"ID":"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508","Type":"ContainerStarted","Data":"ae159eddd7e9d0f2161314d8f5296f7950eb931642b72b4f93476578dd3308ae"}
Jul 06 21:22:57.635159 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:57.634874    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj"]
Jul 06 21:22:57.637727 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:22:57.637685    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4e1a4d_3008_4654_8c69_7ed60f3e4fc5.slice/crio-7f30f94bea2a2d83a7a9ed30ca576509d31bed41a41eadbd51a41daef97ce7fa WatchSource:0}: Error finding container 7f30f94bea2a2d83a7a9ed30ca576509d31bed41a41eadbd51a41daef97ce7fa: Status 404 returned error can't find the container with id 7f30f94bea2a2d83a7a9ed30ca576509d31bed41a41eadbd51a41daef97ce7fa
Jul 06 21:22:58.576220 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:58.576185    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj" event={"ID":"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5","Type":"ContainerStarted","Data":"0562f2e2314140bf7ce189ed5a637a1ca13bfe0bf3528cfc4cf3c7d1de7b0e56"}
Jul 06 21:22:58.576717 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:58.576252    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj" event={"ID":"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5","Type":"ContainerStarted","Data":"4c9d0adaab08bdd98c2a191b9c3744bc7eb27e7dbb893d065a64236777a0fe96"}
Jul 06 21:22:58.576717 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:58.576299    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj" event={"ID":"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5","Type":"ContainerStarted","Data":"7f30f94bea2a2d83a7a9ed30ca576509d31bed41a41eadbd51a41daef97ce7fa"}
Jul 06 21:22:58.578739 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:58.578701    2564 generic.go:356] "Generic (PLEG): container finished" podID="dfbbe407-cb5e-4f13-9f38-a0b4a58b2508" containerID="171190fa207167e9e1939f8bc6e5dd0ee85dbc0ecb6e98233afbb931f7a640cd" exitCode=0
Jul 06 21:22:58.578846 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:58.578761    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ph7gd" event={"ID":"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508","Type":"ContainerDied","Data":"171190fa207167e9e1939f8bc6e5dd0ee85dbc0ecb6e98233afbb931f7a640cd"}
Jul 06 21:22:59.585499 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.585459    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ph7gd" event={"ID":"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508","Type":"ContainerStarted","Data":"823f9cc90a3db85d033482625ac12d5b8d67970a170ce6b0dd87fbb64cccec6c"}
Jul 06 21:22:59.585965 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.585527    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ph7gd" event={"ID":"dfbbe407-cb5e-4f13-9f38-a0b4a58b2508","Type":"ContainerStarted","Data":"b1b60eb9a21bb21550aeeb0572079ac26ee654c8a21f683fd05bcb0d1e54ff99"}
Jul 06 21:22:59.588156 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.588126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj" event={"ID":"7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5","Type":"ContainerStarted","Data":"2e3e05b6338c2d40dc11f446887fb40fd47e35a75d1cd4892fb03486812d9335"}
Jul 06 21:22:59.594273 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.592562    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-56f857fb4-zqj7r"]
Jul 06 21:22:59.596594 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.596571    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.601652 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.601629    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 21:22:59.601753 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.601687    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 21:22:59.601753 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.601719    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 21:22:59.602246 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.601888    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 21:22:59.602246 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.601953    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lzpdl\""
Jul 06 21:22:59.602246 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.602009    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ae65c0tv4m8bl\""
Jul 06 21:22:59.602246 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.602122    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 21:22:59.606719 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.606689    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:59.607044 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.607029    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:59.614222 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.614173    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:22:59.627721 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.627695    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56f857fb4-zqj7r"]
Jul 06 21:22:59.628056 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.628020    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ph7gd" podStartSLOduration=2.5219266129999998 podStartE2EDuration="3.628008815s" totalImagesPullingTime="1.026511941s" totalInitContainerRuntime="79.570261ms" isStatefulPod=true podCreationTimestamp="2026-07-06 21:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:59.624743205 +0000 UTC m=+88.097940837" watchObservedRunningTime="2026-07-06 21:22:59.628008815 +0000 UTC m=+88.101206413"
Jul 06 21:22:59.695375 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.695343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.695546 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.695420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plx4r\" (UniqueName: \"kubernetes.io/projected/d59d0586-c0ff-4824-bb84-16b683e755b4-kube-api-access-plx4r\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.695546 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.695452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-grpc-tls\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.695546 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.695479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d59d0586-c0ff-4824-bb84-16b683e755b4-metrics-client-ca\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.695546 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.695507    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.695761 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.695665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.696228 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.696197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-tls\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.696342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.696273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.707723 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.707674    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-gpdjj" podStartSLOduration=2.466198984 podStartE2EDuration="3.707662359s" totalImagesPullingTime="1.241463375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:22:59.682107013 +0000 UTC m=+88.155304632" watchObservedRunningTime="2026-07-06 21:22:59.707662359 +0000 UTC m=+88.180859979"
Jul 06 21:22:59.796980 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.796928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.797148 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.797001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plx4r\" (UniqueName: \"kubernetes.io/projected/d59d0586-c0ff-4824-bb84-16b683e755b4-kube-api-access-plx4r\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.797148 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.797033    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-grpc-tls\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.797148 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.797058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d59d0586-c0ff-4824-bb84-16b683e755b4-metrics-client-ca\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.797148 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.797084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.797148 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.797140    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.797406 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.797170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-tls\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.797406 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.797199    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.798414 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.798385    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d59d0586-c0ff-4824-bb84-16b683e755b4-metrics-client-ca\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.800259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.800232    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.800733 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.800679    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.801735 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.801711    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.801883 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.801862    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-grpc-tls\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.802691 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.802670    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.803003 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.802981    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d59d0586-c0ff-4824-bb84-16b683e755b4-secret-thanos-querier-tls\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.808430 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.808390    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plx4r\" (UniqueName: \"kubernetes.io/projected/d59d0586-c0ff-4824-bb84-16b683e755b4-kube-api-access-plx4r\") pod \"thanos-querier-56f857fb4-zqj7r\" (UID: \"d59d0586-c0ff-4824-bb84-16b683e755b4\") " pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:22:59.907829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:22:59.907749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:23:00.074757 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:00.074724    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-56f857fb4-zqj7r"]
Jul 06 21:23:00.077827 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:23:00.077800    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd59d0586_c0ff_4824_bb84_16b683e755b4.slice/crio-1ea99c4aba93956e8abc082a0b13d2052d4d0e1d4d20fcc7eb5a2e707346504b WatchSource:0}: Error finding container 1ea99c4aba93956e8abc082a0b13d2052d4d0e1d4d20fcc7eb5a2e707346504b: Status 404 returned error can't find the container with id 1ea99c4aba93956e8abc082a0b13d2052d4d0e1d4d20fcc7eb5a2e707346504b
Jul 06 21:23:00.593188 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:00.593147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r" event={"ID":"d59d0586-c0ff-4824-bb84-16b683e755b4","Type":"ContainerStarted","Data":"1ea99c4aba93956e8abc082a0b13d2052d4d0e1d4d20fcc7eb5a2e707346504b"}
Jul 06 21:23:00.597132 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:00.597108    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:23:01.119889 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.119847    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5fbbc479db-kwt25"]
Jul 06 21:23:01.123518 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.123495    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.127568 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.127544    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 21:23:01.127698 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.127593    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fknogmds58v7o\""
Jul 06 21:23:01.127698 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.127689    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 21:23:01.128370 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.128347    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 21:23:01.128560 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.128545    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 21:23:01.128707 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.128694    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ffkfk\""
Jul 06 21:23:01.138039 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.137992    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5fbbc479db-kwt25"]
Jul 06 21:23:01.210442 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.210416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ab23f5eb-930e-4f74-8a80-79c89ba3519e-audit-log\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.210591 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.210455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab23f5eb-930e-4f74-8a80-79c89ba3519e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.210591 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.210540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ab23f5eb-930e-4f74-8a80-79c89ba3519e-metrics-server-audit-profiles\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.210697 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.210604    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab23f5eb-930e-4f74-8a80-79c89ba3519e-client-ca-bundle\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.210697 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.210666    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ab23f5eb-930e-4f74-8a80-79c89ba3519e-secret-metrics-server-tls\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.210782 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.210721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-746f8\" (UniqueName: \"kubernetes.io/projected/ab23f5eb-930e-4f74-8a80-79c89ba3519e-kube-api-access-746f8\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.210782 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.210753    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ab23f5eb-930e-4f74-8a80-79c89ba3519e-secret-metrics-server-client-certs\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.312323 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.311533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-746f8\" (UniqueName: \"kubernetes.io/projected/ab23f5eb-930e-4f74-8a80-79c89ba3519e-kube-api-access-746f8\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.312323 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.311594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ab23f5eb-930e-4f74-8a80-79c89ba3519e-secret-metrics-server-client-certs\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.312323 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.311641    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ab23f5eb-930e-4f74-8a80-79c89ba3519e-audit-log\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.312323 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.311679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab23f5eb-930e-4f74-8a80-79c89ba3519e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.312323 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.311715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ab23f5eb-930e-4f74-8a80-79c89ba3519e-metrics-server-audit-profiles\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.312323 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.311745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab23f5eb-930e-4f74-8a80-79c89ba3519e-client-ca-bundle\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.312323 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.311829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ab23f5eb-930e-4f74-8a80-79c89ba3519e-secret-metrics-server-tls\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.312758 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.312463    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ab23f5eb-930e-4f74-8a80-79c89ba3519e-audit-log\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.313825 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.313773    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ab23f5eb-930e-4f74-8a80-79c89ba3519e-metrics-server-audit-profiles\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.314035 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.313998    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab23f5eb-930e-4f74-8a80-79c89ba3519e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.315573 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.315516    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ab23f5eb-930e-4f74-8a80-79c89ba3519e-secret-metrics-server-tls\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.316662 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.316624    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ab23f5eb-930e-4f74-8a80-79c89ba3519e-secret-metrics-server-client-certs\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.317804 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.317779    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ab23f5eb-930e-4f74-8a80-79c89ba3519e-client-ca-bundle\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.323221 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.322546    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-746f8\" (UniqueName: \"kubernetes.io/projected/ab23f5eb-930e-4f74-8a80-79c89ba3519e-kube-api-access-746f8\") pod \"metrics-server-5fbbc479db-kwt25\" (UID: \"ab23f5eb-930e-4f74-8a80-79c89ba3519e\") " pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.434854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.434777    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:01.603638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.601497    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5fbbc479db-kwt25"]
Jul 06 21:23:01.608558 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:23:01.608532    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab23f5eb_930e_4f74_8a80_79c89ba3519e.slice/crio-b77440152ddcbeb5f5500154b3767d3f2eb10de31f8650e0e2333d163fbc51db WatchSource:0}: Error finding container b77440152ddcbeb5f5500154b3767d3f2eb10de31f8650e0e2333d163fbc51db: Status 404 returned error can't find the container with id b77440152ddcbeb5f5500154b3767d3f2eb10de31f8650e0e2333d163fbc51db
Jul 06 21:23:01.763654 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.763619    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:23:01.764306 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.764286    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:23:01.769624 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.769596    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:23:01.870058 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.870026    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"]
Jul 06 21:23:01.874468 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.874453    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:01.878338 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.878321    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gxgvl\""
Jul 06 21:23:01.878419 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.878390    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 06 21:23:01.878480 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.878439    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 06 21:23:01.878480 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.878442    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 06 21:23:01.878941 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.878921    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 06 21:23:01.879071 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.879057    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 06 21:23:01.885692 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.885674    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 06 21:23:01.896486 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.896459    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"]
Jul 06 21:23:01.918181 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.918122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e696d22d-9eed-4771-911b-064144d6ee05-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:01.918313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.918198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkwvm\" (UniqueName: \"kubernetes.io/projected/e696d22d-9eed-4771-911b-064144d6ee05-kube-api-access-zkwvm\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:01.918313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.918237    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:01.918313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.918280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-telemeter-client-tls\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:01.918313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.918303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e696d22d-9eed-4771-911b-064144d6ee05-metrics-client-ca\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:01.918487 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.918336    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e696d22d-9eed-4771-911b-064144d6ee05-serving-certs-ca-bundle\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:01.918487 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.918440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-secret-telemeter-client\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:01.918487 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:01.918473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-federate-client-tls\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.019522 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.019443    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkwvm\" (UniqueName: \"kubernetes.io/projected/e696d22d-9eed-4771-911b-064144d6ee05-kube-api-access-zkwvm\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.019522 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.019479    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.019522 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.019507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-telemeter-client-tls\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.019752 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.019570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e696d22d-9eed-4771-911b-064144d6ee05-metrics-client-ca\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.019752 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.019619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e696d22d-9eed-4771-911b-064144d6ee05-serving-certs-ca-bundle\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.019752 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.019662    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-secret-telemeter-client\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.019752 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.019688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-federate-client-tls\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.019952 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.019796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e696d22d-9eed-4771-911b-064144d6ee05-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.020534 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.020498    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e696d22d-9eed-4771-911b-064144d6ee05-metrics-client-ca\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.020785 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.020759    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e696d22d-9eed-4771-911b-064144d6ee05-serving-certs-ca-bundle\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.021035 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.020949    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e696d22d-9eed-4771-911b-064144d6ee05-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.022345 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.022324    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-telemeter-client-tls\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.022456 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.022438    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.023165 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.023144    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-secret-telemeter-client\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.023516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.023491    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e696d22d-9eed-4771-911b-064144d6ee05-federate-client-tls\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.029606 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.029587    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkwvm\" (UniqueName: \"kubernetes.io/projected/e696d22d-9eed-4771-911b-064144d6ee05-kube-api-access-zkwvm\") pod \"telemeter-client-7dbb4f6d4c-8v2x5\" (UID: \"e696d22d-9eed-4771-911b-064144d6ee05\") " pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.185335 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.185296    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"
Jul 06 21:23:02.611389 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.611350    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25" event={"ID":"ab23f5eb-930e-4f74-8a80-79c89ba3519e","Type":"ContainerStarted","Data":"b77440152ddcbeb5f5500154b3767d3f2eb10de31f8650e0e2333d163fbc51db"}
Jul 06 21:23:02.616919 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.616878    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:23:02.673065 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:02.673029    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6dc9c8df-gsjh6"]
Jul 06 21:23:05.226301 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:05.226275    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:23:07.453592 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.453554    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cb7d8f9bb-r2kcj"]
Jul 06 21:23:07.651932 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.651878    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb7d8f9bb-r2kcj"]
Jul 06 21:23:07.652132 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.651984    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68f69cf476-lcrph"
Jul 06 21:23:07.652387 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.652367    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.772871 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.772836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-console-config\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.773091 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.772928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-service-ca\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.773091 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.773005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-oauth-serving-cert\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.773222 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.773188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-serving-cert\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.773306 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.773273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-oauth-config\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.773395 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.773375    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-trusted-ca-bundle\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.773458 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.773442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smn2h\" (UniqueName: \"kubernetes.io/projected/9e18553c-c360-4d44-9792-1c84ebf98d18-kube-api-access-smn2h\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.874057 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.874019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-oauth-config\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.874213 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.874077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-trusted-ca-bundle\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.874213 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.874114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smn2h\" (UniqueName: \"kubernetes.io/projected/9e18553c-c360-4d44-9792-1c84ebf98d18-kube-api-access-smn2h\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.874213 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.874148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-console-config\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.874213 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.874188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-service-ca\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.874385 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.874345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-oauth-serving-cert\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.874421 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.874392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-serving-cert\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.875234 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.875190    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-console-config\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.875858 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.875838    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-service-ca\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.876027 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.876000    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-oauth-serving-cert\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.876291 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.876262    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-trusted-ca-bundle\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.877039 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.876996    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-oauth-config\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.877302 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.877272    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-serving-cert\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.884116 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.884091    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smn2h\" (UniqueName: \"kubernetes.io/projected/9e18553c-c360-4d44-9792-1c84ebf98d18-kube-api-access-smn2h\") pod \"console-6cb7d8f9bb-r2kcj\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") " pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:07.964007 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:07.963967    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:10.080798 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.080637    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb7d8f9bb-r2kcj"]
Jul 06 21:23:10.083460 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:23:10.083415    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e18553c_c360_4d44_9792_1c84ebf98d18.slice/crio-906ea60a42e7bf031b394716b1f2d6ac5bbd235f6ab341a8da6a0a0ea1d8ea88 WatchSource:0}: Error finding container 906ea60a42e7bf031b394716b1f2d6ac5bbd235f6ab341a8da6a0a0ea1d8ea88: Status 404 returned error can't find the container with id 906ea60a42e7bf031b394716b1f2d6ac5bbd235f6ab341a8da6a0a0ea1d8ea88
Jul 06 21:23:10.115599 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.115576    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5"]
Jul 06 21:23:10.116992 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:23:10.116965    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode696d22d_9eed_4771_911b_064144d6ee05.slice/crio-3d346e4590db9c466f03d0c23097f2fc957accf9ddd48d71177722e27fea6308 WatchSource:0}: Error finding container 3d346e4590db9c466f03d0c23097f2fc957accf9ddd48d71177722e27fea6308: Status 404 returned error can't find the container with id 3d346e4590db9c466f03d0c23097f2fc957accf9ddd48d71177722e27fea6308
Jul 06 21:23:10.244886 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.244843    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk" podUID="8c7271d5-468c-48d3-949a-417c8836ff70" containerName="registry" containerID="cri-o://77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4" gracePeriod=30
Jul 06 21:23:10.573182 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.573131    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:23:10.649340 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.647750    2564 generic.go:356] "Generic (PLEG): container finished" podID="8c7271d5-468c-48d3-949a-417c8836ff70" containerID="77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4" exitCode=0
Jul 06 21:23:10.649340 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.647807    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk"
Jul 06 21:23:10.649340 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.647845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk" event={"ID":"8c7271d5-468c-48d3-949a-417c8836ff70","Type":"ContainerDied","Data":"77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4"}
Jul 06 21:23:10.649340 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.647925    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d6487777b-6pzzk" event={"ID":"8c7271d5-468c-48d3-949a-417c8836ff70","Type":"ContainerDied","Data":"64ae7e91aa701506dd460af7f84d8b1c6f092133487f9ab759582f35793cb0ce"}
Jul 06 21:23:10.649340 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.647957    2564 scope.go:117] "RemoveContainer" containerID="77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4"
Jul 06 21:23:10.651442 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.651412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r" event={"ID":"d59d0586-c0ff-4824-bb84-16b683e755b4","Type":"ContainerStarted","Data":"42054994f617b650955e800a2447ac8768ea08069929156adaf10eb6cd002db6"}
Jul 06 21:23:10.651566 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.651488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r" event={"ID":"d59d0586-c0ff-4824-bb84-16b683e755b4","Type":"ContainerStarted","Data":"e0b67f47864c84abb1aa31a9c6a8622e3a7f85330b924e6a3b7b3ab93c3be0b9"}
Jul 06 21:23:10.651566 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.651531    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r" event={"ID":"d59d0586-c0ff-4824-bb84-16b683e755b4","Type":"ContainerStarted","Data":"1bd621b8e59c33c3b345f62446c050476883ce30a9603fb08b7c0d8b6c18316b"}
Jul 06 21:23:10.653684 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.653655    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-z596j" event={"ID":"2986c8b9-b265-40a9-8c0c-62d3711daa05","Type":"ContainerStarted","Data":"ff7097c8d90070e656d1539fe6e4465acac42787d9f8cceb4d0e2dfd26cdfe28"}
Jul 06 21:23:10.654484 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.654464    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-z596j"
Jul 06 21:23:10.657240 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.657163    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb7d8f9bb-r2kcj" event={"ID":"9e18553c-c360-4d44-9792-1c84ebf98d18","Type":"ContainerStarted","Data":"2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d"}
Jul 06 21:23:10.657240 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.657198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb7d8f9bb-r2kcj" event={"ID":"9e18553c-c360-4d44-9792-1c84ebf98d18","Type":"ContainerStarted","Data":"906ea60a42e7bf031b394716b1f2d6ac5bbd235f6ab341a8da6a0a0ea1d8ea88"}
Jul 06 21:23:10.659088 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.659065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5" event={"ID":"e696d22d-9eed-4771-911b-064144d6ee05","Type":"ContainerStarted","Data":"3d346e4590db9c466f03d0c23097f2fc957accf9ddd48d71177722e27fea6308"}
Jul 06 21:23:10.661726 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.661708    2564 scope.go:117] "RemoveContainer" containerID="77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4"
Jul 06 21:23:10.662100 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:23:10.662079    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4\": container with ID starting with 77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4 not found: ID does not exist" containerID="77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4"
Jul 06 21:23:10.662165 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.662105    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4"} err="failed to get container status \"77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4\": rpc error: code = NotFound desc = could not find container \"77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4\": container with ID starting with 77311d212618892291bc8471d87dbe21f46e5d5a5560efa3d5318cfd619867d4 not found: ID does not exist"
Jul 06 21:23:10.672212 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.672166    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-z596j"
Jul 06 21:23:10.684491 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.684441    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-z596j" podStartSLOduration=1.521160574 podStartE2EDuration="25.684427515s" totalImagesPullingTime="24.163266941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:23:10.683654916 +0000 UTC m=+99.156852537" watchObservedRunningTime="2026-07-06 21:23:10.684427515 +0000 UTC m=+99.157625113"
Jul 06 21:23:10.705042 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.704209    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-installation-pull-secrets\") pod \"8c7271d5-468c-48d3-949a-417c8836ff70\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") "
Jul 06 21:23:10.705042 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.704252    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-bound-sa-token\") pod \"8c7271d5-468c-48d3-949a-417c8836ff70\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") "
Jul 06 21:23:10.705042 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.704287    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls\") pod \"8c7271d5-468c-48d3-949a-417c8836ff70\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") "
Jul 06 21:23:10.705042 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.704312    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf6zl\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-kube-api-access-gf6zl\") pod \"8c7271d5-468c-48d3-949a-417c8836ff70\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") "
Jul 06 21:23:10.705042 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.704368    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-image-registry-private-configuration\") pod \"8c7271d5-468c-48d3-949a-417c8836ff70\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") "
Jul 06 21:23:10.705042 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.704445    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-trusted-ca\") pod \"8c7271d5-468c-48d3-949a-417c8836ff70\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") "
Jul 06 21:23:10.705042 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.704507    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c7271d5-468c-48d3-949a-417c8836ff70-ca-trust-extracted\") pod \"8c7271d5-468c-48d3-949a-417c8836ff70\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") "
Jul 06 21:23:10.705042 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.704545    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-registry-certificates\") pod \"8c7271d5-468c-48d3-949a-417c8836ff70\" (UID: \"8c7271d5-468c-48d3-949a-417c8836ff70\") "
Jul 06 21:23:10.705543 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.705134    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8c7271d5-468c-48d3-949a-417c8836ff70" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:10.706264 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.706000    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8c7271d5-468c-48d3-949a-417c8836ff70" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:10.711038 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.711011    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8c7271d5-468c-48d3-949a-417c8836ff70" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:23:10.711159 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.711107    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8c7271d5-468c-48d3-949a-417c8836ff70" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:23:10.711310 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.711283    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-kube-api-access-gf6zl" (OuterVolumeSpecName: "kube-api-access-gf6zl") pod "8c7271d5-468c-48d3-949a-417c8836ff70" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70"). InnerVolumeSpecName "kube-api-access-gf6zl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:23:10.711470 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.711418    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8c7271d5-468c-48d3-949a-417c8836ff70" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:23:10.713191 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.713167    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8c7271d5-468c-48d3-949a-417c8836ff70" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:23:10.718705 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.718674    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7271d5-468c-48d3-949a-417c8836ff70-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8c7271d5-468c-48d3-949a-417c8836ff70" (UID: "8c7271d5-468c-48d3-949a-417c8836ff70"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:23:10.760468 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.760399    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cb7d8f9bb-r2kcj" podStartSLOduration=3.760380531 podStartE2EDuration="3.760380531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:23:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:23:10.759581095 +0000 UTC m=+99.232778716" watchObservedRunningTime="2026-07-06 21:23:10.760380531 +0000 UTC m=+99.233578132"
Jul 06 21:23:10.806272 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.806191    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-installation-pull-secrets\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:10.806272 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.806225    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-bound-sa-token\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:10.806272 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.806240    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-registry-tls\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:10.806272 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.806254    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf6zl\" (UniqueName: \"kubernetes.io/projected/8c7271d5-468c-48d3-949a-417c8836ff70-kube-api-access-gf6zl\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:10.806272 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.806270    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c7271d5-468c-48d3-949a-417c8836ff70-image-registry-private-configuration\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:10.806605 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.806285    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-trusted-ca\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:10.806605 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.806298    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c7271d5-468c-48d3-949a-417c8836ff70-ca-trust-extracted\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:10.806605 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.806312    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c7271d5-468c-48d3-949a-417c8836ff70-registry-certificates\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:10.977922 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.977848    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d6487777b-6pzzk"]
Jul 06 21:23:10.980368 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:10.980223    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d6487777b-6pzzk"]
Jul 06 21:23:12.072321 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:12.072286    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c7271d5-468c-48d3-949a-417c8836ff70" path="/var/lib/kubelet/pods/8c7271d5-468c-48d3-949a-417c8836ff70/volumes"
Jul 06 21:23:13.681720 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:13.681687    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5" event={"ID":"e696d22d-9eed-4771-911b-064144d6ee05","Type":"ContainerStarted","Data":"d71e4a3ecbf594740e5d1381b474eb61c9f0a03e5cdbafa200d62f5b7c23b573"}
Jul 06 21:23:13.683643 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:13.683613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25" event={"ID":"ab23f5eb-930e-4f74-8a80-79c89ba3519e","Type":"ContainerStarted","Data":"15f8a3b6eb8cd23f066cc1cca174205745cbd1bf971fdbb8350cbe567059b2c3"}
Jul 06 21:23:13.686573 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:13.686547    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r" event={"ID":"d59d0586-c0ff-4824-bb84-16b683e755b4","Type":"ContainerStarted","Data":"902e90fc02c98290aab74186d154b8253ed1701fcff183e04657f05cd887aabb"}
Jul 06 21:23:13.705253 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:13.705202    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25" podStartSLOduration=0.946236375 podStartE2EDuration="12.705183633s" totalImagesPullingTime="11.758947258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:23:13.704759182 +0000 UTC m=+102.177956804" watchObservedRunningTime="2026-07-06 21:23:13.705183633 +0000 UTC m=+102.178381255"
Jul 06 21:23:14.695490 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:14.695448    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r" event={"ID":"d59d0586-c0ff-4824-bb84-16b683e755b4","Type":"ContainerStarted","Data":"5c47c899cec00471bae21c6996666bdd89ba8e943162e5400237aba3de4c2e74"}
Jul 06 21:23:14.696062 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:14.695548    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r" event={"ID":"d59d0586-c0ff-4824-bb84-16b683e755b4","Type":"ContainerStarted","Data":"07a9b57f1f6b03b4e9abce9d2740a960c9ace1bfc7d381bd48c4c5748dc8b760"}
Jul 06 21:23:15.702102 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:15.702066    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5" event={"ID":"e696d22d-9eed-4771-911b-064144d6ee05","Type":"ContainerStarted","Data":"c070e529b06b61516dde721a32155d305df653bcf312cca20cca301388594f71"}
Jul 06 21:23:15.702603 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:15.702582    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:23:15.711003 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:15.710984    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r"
Jul 06 21:23:15.741551 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:15.741497    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-56f857fb4-zqj7r" podStartSLOduration=3.854295784 podStartE2EDuration="16.741476384s" totalImagesPullingTime="12.8871806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:22:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:23:14.726563894 +0000 UTC m=+103.199761514" watchObservedRunningTime="2026-07-06 21:23:15.741476384 +0000 UTC m=+104.214674005"
Jul 06 21:23:16.708877 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:16.708832    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5" event={"ID":"e696d22d-9eed-4771-911b-064144d6ee05","Type":"ContainerStarted","Data":"2e477773819041fec90bb089009d95691ce677fe997915f9915678d7f69dc8e4"}
Jul 06 21:23:16.740634 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:16.740586    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7dbb4f6d4c-8v2x5" podStartSLOduration=10.514483556 podStartE2EDuration="15.740565832s" totalImagesPullingTime="5.226082276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:23:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:23:16.738467817 +0000 UTC m=+105.211665470" watchObservedRunningTime="2026-07-06 21:23:16.740565832 +0000 UTC m=+105.213763459"
Jul 06 21:23:17.464218 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.464183    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb7d8f9bb-r2kcj"]
Jul 06 21:23:17.505168 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.505137    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f6f96f6fd-zvmwk"]
Jul 06 21:23:17.505526 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.505507    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7271d5-468c-48d3-949a-417c8836ff70" containerName="registry"
Jul 06 21:23:17.505526 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.505529    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7271d5-468c-48d3-949a-417c8836ff70" containerName="registry"
Jul 06 21:23:17.505681 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.505628    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7271d5-468c-48d3-949a-417c8836ff70" containerName="registry"
Jul 06 21:23:17.527872 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.527838    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f6f96f6fd-zvmwk"]
Jul 06 21:23:17.528056 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.527974    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.677536 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.677497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-oauth-config\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.677536 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.677537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-serving-cert\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.677789 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.677558    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-trusted-ca-bundle\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.677789 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.677711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-service-ca\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.677789 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.677758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-oauth-serving-cert\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.677789 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.677786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbv8h\" (UniqueName: \"kubernetes.io/projected/5c335224-53b0-4de2-ae1a-04edc4a56637-kube-api-access-qbv8h\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.677980 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.677838    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-console-config\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.778562 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.778520    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-oauth-config\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.779054 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.778578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-serving-cert\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.779054 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.778611    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-trusted-ca-bundle\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.779054 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.778673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-service-ca\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.779054 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.778702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-oauth-serving-cert\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.779054 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.778732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbv8h\" (UniqueName: \"kubernetes.io/projected/5c335224-53b0-4de2-ae1a-04edc4a56637-kube-api-access-qbv8h\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.779054 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.778781    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-console-config\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.779747 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.779718    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-console-config\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.779872 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.779775    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-service-ca\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.780262 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.780237    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-trusted-ca-bundle\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.780814 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.780788    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-oauth-serving-cert\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.781568 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.781548    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-oauth-config\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.781751 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.781731    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-serving-cert\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.789083 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.789039    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbv8h\" (UniqueName: \"kubernetes.io/projected/5c335224-53b0-4de2-ae1a-04edc4a56637-kube-api-access-qbv8h\") pod \"console-6f6f96f6fd-zvmwk\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") " pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.839989 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.839954    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:17.964522 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:17.964394    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:18.049306 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:18.049273    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f6f96f6fd-zvmwk"]
Jul 06 21:23:18.052424 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:23:18.052379    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c335224_53b0_4de2_ae1a_04edc4a56637.slice/crio-3d7475c9e0217ce2eb2699c94cb3bf5da82aca187413f357a73b0939b13be55d WatchSource:0}: Error finding container 3d7475c9e0217ce2eb2699c94cb3bf5da82aca187413f357a73b0939b13be55d: Status 404 returned error can't find the container with id 3d7475c9e0217ce2eb2699c94cb3bf5da82aca187413f357a73b0939b13be55d
Jul 06 21:23:18.521267 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:18.521232    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-42kbp"
Jul 06 21:23:18.726022 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:18.725985    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6f96f6fd-zvmwk" event={"ID":"5c335224-53b0-4de2-ae1a-04edc4a56637","Type":"ContainerStarted","Data":"d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12"}
Jul 06 21:23:18.726255 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:18.726232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6f96f6fd-zvmwk" event={"ID":"5c335224-53b0-4de2-ae1a-04edc4a56637","Type":"ContainerStarted","Data":"3d7475c9e0217ce2eb2699c94cb3bf5da82aca187413f357a73b0939b13be55d"}
Jul 06 21:23:18.749129 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:18.749083    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f6f96f6fd-zvmwk" podStartSLOduration=1.749064922 podStartE2EDuration="1.749064922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:23:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:23:18.748730209 +0000 UTC m=+107.221927829" watchObservedRunningTime="2026-07-06 21:23:18.749064922 +0000 UTC m=+107.222262547"
Jul 06 21:23:21.434973 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:21.434933    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:21.435422 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:21.434999    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:27.840845 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:27.840808    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:27.841371 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:27.840870    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:27.845660 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:27.845627    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:28.639093 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.639056    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f6dc9c8df-gsjh6" podUID="17dbb4a8-a0be-4c5a-a468-3814313e0b96" containerName="console" containerID="cri-o://592236d1795ba6fe640b860f24a3f9a13e4c1ee540b3fded29cf76a94a78069a" gracePeriod=15
Jul 06 21:23:28.767616 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.767584    2564 generic.go:356] "Generic (PLEG): container finished" podID="17dbb4a8-a0be-4c5a-a468-3814313e0b96" containerID="592236d1795ba6fe640b860f24a3f9a13e4c1ee540b3fded29cf76a94a78069a" exitCode=0
Jul 06 21:23:28.767763 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.767654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6dc9c8df-gsjh6" event={"ID":"17dbb4a8-a0be-4c5a-a468-3814313e0b96","Type":"ContainerDied","Data":"592236d1795ba6fe640b860f24a3f9a13e4c1ee540b3fded29cf76a94a78069a"}
Jul 06 21:23:28.771975 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.771951    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:23:28.836429 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.836390    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77466d5fbb-k9jnw"]
Jul 06 21:23:28.926522 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.926496    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:23:28.978632 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.978601    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-oauth-config\") pod \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") "
Jul 06 21:23:28.978632 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.978636    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-config\") pod \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") "
Jul 06 21:23:28.978856 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.978655    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-serving-cert\") pod \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") "
Jul 06 21:23:28.978856 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.978695    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fqg7\" (UniqueName: \"kubernetes.io/projected/17dbb4a8-a0be-4c5a-a468-3814313e0b96-kube-api-access-7fqg7\") pod \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") "
Jul 06 21:23:28.978856 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.978724    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-service-ca\") pod \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") "
Jul 06 21:23:28.978856 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.978771    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-oauth-serving-cert\") pod \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\" (UID: \"17dbb4a8-a0be-4c5a-a468-3814313e0b96\") "
Jul 06 21:23:28.979095 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.979078    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-config" (OuterVolumeSpecName: "console-config") pod "17dbb4a8-a0be-4c5a-a468-3814313e0b96" (UID: "17dbb4a8-a0be-4c5a-a468-3814313e0b96"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:28.979510 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.979455    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-service-ca" (OuterVolumeSpecName: "service-ca") pod "17dbb4a8-a0be-4c5a-a468-3814313e0b96" (UID: "17dbb4a8-a0be-4c5a-a468-3814313e0b96"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:28.979638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.979559    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "17dbb4a8-a0be-4c5a-a468-3814313e0b96" (UID: "17dbb4a8-a0be-4c5a-a468-3814313e0b96"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:28.981137 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.981108    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17dbb4a8-a0be-4c5a-a468-3814313e0b96-kube-api-access-7fqg7" (OuterVolumeSpecName: "kube-api-access-7fqg7") pod "17dbb4a8-a0be-4c5a-a468-3814313e0b96" (UID: "17dbb4a8-a0be-4c5a-a468-3814313e0b96"). InnerVolumeSpecName "kube-api-access-7fqg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:23:28.981137 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.981129    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "17dbb4a8-a0be-4c5a-a468-3814313e0b96" (UID: "17dbb4a8-a0be-4c5a-a468-3814313e0b96"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:23:28.981302 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:28.981196    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "17dbb4a8-a0be-4c5a-a468-3814313e0b96" (UID: "17dbb4a8-a0be-4c5a-a468-3814313e0b96"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:23:29.079500 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:29.079454    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-oauth-config\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:29.079500 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:29.079482    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-config\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:29.079713 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:29.079573    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17dbb4a8-a0be-4c5a-a468-3814313e0b96-console-serving-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:29.079713 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:29.079590    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fqg7\" (UniqueName: \"kubernetes.io/projected/17dbb4a8-a0be-4c5a-a468-3814313e0b96-kube-api-access-7fqg7\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:29.079713 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:29.079600    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-service-ca\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:29.079713 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:29.079608    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17dbb4a8-a0be-4c5a-a468-3814313e0b96-oauth-serving-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:29.773168 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:29.773131    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6dc9c8df-gsjh6" event={"ID":"17dbb4a8-a0be-4c5a-a468-3814313e0b96","Type":"ContainerDied","Data":"b0aecc0fab378059a1be5d4784d5e96f953b196a506e9937495eab4be62745a2"}
Jul 06 21:23:29.773168 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:29.773167    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6dc9c8df-gsjh6"
Jul 06 21:23:29.773419 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:29.773230    2564 scope.go:117] "RemoveContainer" containerID="592236d1795ba6fe640b860f24a3f9a13e4c1ee540b3fded29cf76a94a78069a"
Jul 06 21:23:29.794664 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:29.794639    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6dc9c8df-gsjh6"]
Jul 06 21:23:29.799829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:29.799806    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f6dc9c8df-gsjh6"]
Jul 06 21:23:30.061458 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:30.061384    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17dbb4a8-a0be-4c5a-a468-3814313e0b96" path="/var/lib/kubelet/pods/17dbb4a8-a0be-4c5a-a468-3814313e0b96/volumes"
Jul 06 21:23:41.440822 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:41.440795    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:41.444622 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:41.444600    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5fbbc479db-kwt25"
Jul 06 21:23:42.488656 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.488598    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6cb7d8f9bb-r2kcj" podUID="9e18553c-c360-4d44-9792-1c84ebf98d18" containerName="console" containerID="cri-o://2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d" gracePeriod=15
Jul 06 21:23:42.728619 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.728598    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:42.767457 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.767389    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-service-ca\") pod \"9e18553c-c360-4d44-9792-1c84ebf98d18\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") "
Jul 06 21:23:42.767457 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.767446    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-trusted-ca-bundle\") pod \"9e18553c-c360-4d44-9792-1c84ebf98d18\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") "
Jul 06 21:23:42.767645 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.767495    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-serving-cert\") pod \"9e18553c-c360-4d44-9792-1c84ebf98d18\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") "
Jul 06 21:23:42.767645 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.767529    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-oauth-serving-cert\") pod \"9e18553c-c360-4d44-9792-1c84ebf98d18\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") "
Jul 06 21:23:42.767645 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.767560    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-oauth-config\") pod \"9e18553c-c360-4d44-9792-1c84ebf98d18\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") "
Jul 06 21:23:42.767645 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.767625    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-console-config\") pod \"9e18553c-c360-4d44-9792-1c84ebf98d18\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") "
Jul 06 21:23:42.767828 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.767661    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smn2h\" (UniqueName: \"kubernetes.io/projected/9e18553c-c360-4d44-9792-1c84ebf98d18-kube-api-access-smn2h\") pod \"9e18553c-c360-4d44-9792-1c84ebf98d18\" (UID: \"9e18553c-c360-4d44-9792-1c84ebf98d18\") "
Jul 06 21:23:42.767927 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.767884    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-service-ca" (OuterVolumeSpecName: "service-ca") pod "9e18553c-c360-4d44-9792-1c84ebf98d18" (UID: "9e18553c-c360-4d44-9792-1c84ebf98d18"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:42.767999 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.767943    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9e18553c-c360-4d44-9792-1c84ebf98d18" (UID: "9e18553c-c360-4d44-9792-1c84ebf98d18"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:42.767999 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.767820    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9e18553c-c360-4d44-9792-1c84ebf98d18" (UID: "9e18553c-c360-4d44-9792-1c84ebf98d18"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:42.768109 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.767997    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-console-config" (OuterVolumeSpecName: "console-config") pod "9e18553c-c360-4d44-9792-1c84ebf98d18" (UID: "9e18553c-c360-4d44-9792-1c84ebf98d18"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:42.769805 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.769782    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9e18553c-c360-4d44-9792-1c84ebf98d18" (UID: "9e18553c-c360-4d44-9792-1c84ebf98d18"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:23:42.769887 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.769873    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e18553c-c360-4d44-9792-1c84ebf98d18-kube-api-access-smn2h" (OuterVolumeSpecName: "kube-api-access-smn2h") pod "9e18553c-c360-4d44-9792-1c84ebf98d18" (UID: "9e18553c-c360-4d44-9792-1c84ebf98d18"). InnerVolumeSpecName "kube-api-access-smn2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:23:42.770011 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.769994    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9e18553c-c360-4d44-9792-1c84ebf98d18" (UID: "9e18553c-c360-4d44-9792-1c84ebf98d18"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:23:42.824481 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.824450    2564 generic.go:356] "Generic (PLEG): container finished" podID="9e18553c-c360-4d44-9792-1c84ebf98d18" containerID="2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d" exitCode=0
Jul 06 21:23:42.824625 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.824498    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb7d8f9bb-r2kcj"
Jul 06 21:23:42.824625 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.824545    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb7d8f9bb-r2kcj" event={"ID":"9e18553c-c360-4d44-9792-1c84ebf98d18","Type":"ContainerDied","Data":"2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d"}
Jul 06 21:23:42.824694 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.824638    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb7d8f9bb-r2kcj" event={"ID":"9e18553c-c360-4d44-9792-1c84ebf98d18","Type":"ContainerDied","Data":"906ea60a42e7bf031b394716b1f2d6ac5bbd235f6ab341a8da6a0a0ea1d8ea88"}
Jul 06 21:23:42.824694 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.824667    2564 scope.go:117] "RemoveContainer" containerID="2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d"
Jul 06 21:23:42.833730 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.833715    2564 scope.go:117] "RemoveContainer" containerID="2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d"
Jul 06 21:23:42.834039 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:23:42.834021    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d\": container with ID starting with 2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d not found: ID does not exist" containerID="2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d"
Jul 06 21:23:42.834093 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.834049    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d"} err="failed to get container status \"2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d\": rpc error: code = NotFound desc = could not find container \"2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d\": container with ID starting with 2bb24713e4dd2b997dfafda27de335d9dce422c54a38bd965c2e67dc8889ef6d not found: ID does not exist"
Jul 06 21:23:42.849538 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.849510    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb7d8f9bb-r2kcj"]
Jul 06 21:23:42.852394 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.852372    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cb7d8f9bb-r2kcj"]
Jul 06 21:23:42.868798 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.868779    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-service-ca\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:42.868798 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.868797    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-trusted-ca-bundle\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:42.868886 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.868806    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-serving-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:42.868886 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.868816    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-oauth-serving-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:42.868886 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.868825    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e18553c-c360-4d44-9792-1c84ebf98d18-console-oauth-config\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:42.868886 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.868833    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e18553c-c360-4d44-9792-1c84ebf98d18-console-config\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:42.868886 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:42.868840    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smn2h\" (UniqueName: \"kubernetes.io/projected/9e18553c-c360-4d44-9792-1c84ebf98d18-kube-api-access-smn2h\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:44.062307 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:44.062276    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e18553c-c360-4d44-9792-1c84ebf98d18" path="/var/lib/kubelet/pods/9e18553c-c360-4d44-9792-1c84ebf98d18/volumes"
Jul 06 21:23:53.861616 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:53.861552    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77466d5fbb-k9jnw" podUID="62162f3f-7cfc-4822-b75e-91d0cbc34e6a" containerName="console" containerID="cri-o://139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e" gracePeriod=15
Jul 06 21:23:54.145644 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.145622    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:23:54.263413 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.263374    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-service-ca\") pod \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") "
Jul 06 21:23:54.263583 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.263475    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-oauth-config\") pod \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") "
Jul 06 21:23:54.263583 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.263525    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-oauth-serving-cert\") pod \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") "
Jul 06 21:23:54.263583 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.263546    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-serving-cert\") pod \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") "
Jul 06 21:23:54.263583 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.263569    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4whr7\" (UniqueName: \"kubernetes.io/projected/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-kube-api-access-4whr7\") pod \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") "
Jul 06 21:23:54.263788 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.263648    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-service-ca" (OuterVolumeSpecName: "service-ca") pod "62162f3f-7cfc-4822-b75e-91d0cbc34e6a" (UID: "62162f3f-7cfc-4822-b75e-91d0cbc34e6a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:54.263788 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.263694    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-trusted-ca-bundle\") pod \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") "
Jul 06 21:23:54.263788 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.263717    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-config\") pod \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\" (UID: \"62162f3f-7cfc-4822-b75e-91d0cbc34e6a\") "
Jul 06 21:23:54.264051 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.263994    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "62162f3f-7cfc-4822-b75e-91d0cbc34e6a" (UID: "62162f3f-7cfc-4822-b75e-91d0cbc34e6a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:54.264051 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.264007    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-service-ca\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:54.264178 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.264124    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "62162f3f-7cfc-4822-b75e-91d0cbc34e6a" (UID: "62162f3f-7cfc-4822-b75e-91d0cbc34e6a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:54.264178 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.264139    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-config" (OuterVolumeSpecName: "console-config") pod "62162f3f-7cfc-4822-b75e-91d0cbc34e6a" (UID: "62162f3f-7cfc-4822-b75e-91d0cbc34e6a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:23:54.265789 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.265768    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-kube-api-access-4whr7" (OuterVolumeSpecName: "kube-api-access-4whr7") pod "62162f3f-7cfc-4822-b75e-91d0cbc34e6a" (UID: "62162f3f-7cfc-4822-b75e-91d0cbc34e6a"). InnerVolumeSpecName "kube-api-access-4whr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:23:54.266213 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.266192    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "62162f3f-7cfc-4822-b75e-91d0cbc34e6a" (UID: "62162f3f-7cfc-4822-b75e-91d0cbc34e6a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:23:54.266282 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.266212    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "62162f3f-7cfc-4822-b75e-91d0cbc34e6a" (UID: "62162f3f-7cfc-4822-b75e-91d0cbc34e6a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:23:54.364417 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.364346    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-oauth-config\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:54.364417 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.364371    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-oauth-serving-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:54.364417 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.364380    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-serving-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:54.364417 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.364388    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4whr7\" (UniqueName: \"kubernetes.io/projected/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-kube-api-access-4whr7\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:54.364417 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.364398    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-trusted-ca-bundle\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:54.364417 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.364407    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/62162f3f-7cfc-4822-b75e-91d0cbc34e6a-console-config\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:23:54.873024 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.872990    2564 generic.go:356] "Generic (PLEG): container finished" podID="62162f3f-7cfc-4822-b75e-91d0cbc34e6a" containerID="139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e" exitCode=0
Jul 06 21:23:54.873424 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.873034    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77466d5fbb-k9jnw"
Jul 06 21:23:54.873424 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.873087    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77466d5fbb-k9jnw" event={"ID":"62162f3f-7cfc-4822-b75e-91d0cbc34e6a","Type":"ContainerDied","Data":"139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e"}
Jul 06 21:23:54.873424 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.873137    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77466d5fbb-k9jnw" event={"ID":"62162f3f-7cfc-4822-b75e-91d0cbc34e6a","Type":"ContainerDied","Data":"8a45b6752a1c3a24c8bc4e275991adb05436d79e98250418227c179ba0a4d0d5"}
Jul 06 21:23:54.873424 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.873158    2564 scope.go:117] "RemoveContainer" containerID="139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e"
Jul 06 21:23:54.881807 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.881792    2564 scope.go:117] "RemoveContainer" containerID="139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e"
Jul 06 21:23:54.882070 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:23:54.882052    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e\": container with ID starting with 139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e not found: ID does not exist" containerID="139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e"
Jul 06 21:23:54.882145 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.882078    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e"} err="failed to get container status \"139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e\": rpc error: code = NotFound desc = could not find container \"139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e\": container with ID starting with 139c9597a4adc122b224c132090b24725326c63c228fd18cbbb58c124affbc3e not found: ID does not exist"
Jul 06 21:23:54.920804 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.920783    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77466d5fbb-k9jnw"]
Jul 06 21:23:54.926501 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:54.926479    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77466d5fbb-k9jnw"]
Jul 06 21:23:56.061266 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:23:56.061228    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62162f3f-7cfc-4822-b75e-91d0cbc34e6a" path="/var/lib/kubelet/pods/62162f3f-7cfc-4822-b75e-91d0cbc34e6a/volumes"
Jul 06 21:24:26.020148 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.020077    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c56f5778d-7tk7x"]
Jul 06 21:24:26.020543 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.020412    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e18553c-c360-4d44-9792-1c84ebf98d18" containerName="console"
Jul 06 21:24:26.020543 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.020426    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e18553c-c360-4d44-9792-1c84ebf98d18" containerName="console"
Jul 06 21:24:26.020543 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.020442    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62162f3f-7cfc-4822-b75e-91d0cbc34e6a" containerName="console"
Jul 06 21:24:26.020543 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.020447    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="62162f3f-7cfc-4822-b75e-91d0cbc34e6a" containerName="console"
Jul 06 21:24:26.020543 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.020453    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17dbb4a8-a0be-4c5a-a468-3814313e0b96" containerName="console"
Jul 06 21:24:26.020543 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.020458    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17dbb4a8-a0be-4c5a-a468-3814313e0b96" containerName="console"
Jul 06 21:24:26.020543 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.020513    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e18553c-c360-4d44-9792-1c84ebf98d18" containerName="console"
Jul 06 21:24:26.020543 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.020522    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="17dbb4a8-a0be-4c5a-a468-3814313e0b96" containerName="console"
Jul 06 21:24:26.020543 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.020530    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="62162f3f-7cfc-4822-b75e-91d0cbc34e6a" containerName="console"
Jul 06 21:24:26.022208 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.022192    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.039672 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.039650    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c56f5778d-7tk7x"]
Jul 06 21:24:26.135817 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.135779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-serving-cert\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.135817 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.135817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-oauth-serving-cert\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.136066 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.135841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnfmm\" (UniqueName: \"kubernetes.io/projected/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-kube-api-access-bnfmm\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.136066 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.135978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-config\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.136066 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.136014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-service-ca\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.136066 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.136029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-trusted-ca-bundle\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.136197 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.136092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-oauth-config\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.237454 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.237419    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-config\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.237638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.237460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-service-ca\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.237638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.237482    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-trusted-ca-bundle\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.237638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.237514    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-oauth-config\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.237638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.237538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-serving-cert\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.237638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.237558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-oauth-serving-cert\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.237638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.237597    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnfmm\" (UniqueName: \"kubernetes.io/projected/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-kube-api-access-bnfmm\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.238343 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.238266    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-service-ca\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.238343 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.238279    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-config\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.238562 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.238399    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-trusted-ca-bundle\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.238562 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.238336    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-oauth-serving-cert\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.240115 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.240092    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-serving-cert\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.240115 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.240108    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-oauth-config\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.248493 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.248460    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnfmm\" (UniqueName: \"kubernetes.io/projected/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-kube-api-access-bnfmm\") pod \"console-c56f5778d-7tk7x\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") " pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.331059 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.330956    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:26.472441 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.472417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c56f5778d-7tk7x"]
Jul 06 21:24:26.474636 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:24:26.474611    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cb4418_ddd1_4d0c_a83f_faa1a062a39a.slice/crio-958fbe676672e6b04b8f3a3f4ba30e6c6d46aa2a3d8266f02f1eb1d6fc03251a WatchSource:0}: Error finding container 958fbe676672e6b04b8f3a3f4ba30e6c6d46aa2a3d8266f02f1eb1d6fc03251a: Status 404 returned error can't find the container with id 958fbe676672e6b04b8f3a3f4ba30e6c6d46aa2a3d8266f02f1eb1d6fc03251a
Jul 06 21:24:26.996913 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.996865    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c56f5778d-7tk7x" event={"ID":"95cb4418-ddd1-4d0c-a83f-faa1a062a39a","Type":"ContainerStarted","Data":"b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912"}
Jul 06 21:24:26.997079 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:26.996934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c56f5778d-7tk7x" event={"ID":"95cb4418-ddd1-4d0c-a83f-faa1a062a39a","Type":"ContainerStarted","Data":"958fbe676672e6b04b8f3a3f4ba30e6c6d46aa2a3d8266f02f1eb1d6fc03251a"}
Jul 06 21:24:27.019861 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:27.019813    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c56f5778d-7tk7x" podStartSLOduration=2.019799123 podStartE2EDuration="2.019799123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:24:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:24:27.019760526 +0000 UTC m=+175.492958146" watchObservedRunningTime="2026-07-06 21:24:27.019799123 +0000 UTC m=+175.492996745"
Jul 06 21:24:36.331270 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:36.331233    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:36.331745 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:36.331297    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:36.335995 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:36.335974    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:37.037691 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:37.037664    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:24:37.097362 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:24:37.097332    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f6f96f6fd-zvmwk"]
Jul 06 21:25:02.117783 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.117720    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f6f96f6fd-zvmwk" podUID="5c335224-53b0-4de2-ae1a-04edc4a56637" containerName="console" containerID="cri-o://d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12" gracePeriod=15
Jul 06 21:25:02.378514 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.378460    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:25:02.440887 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.440851    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbv8h\" (UniqueName: \"kubernetes.io/projected/5c335224-53b0-4de2-ae1a-04edc4a56637-kube-api-access-qbv8h\") pod \"5c335224-53b0-4de2-ae1a-04edc4a56637\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") "
Jul 06 21:25:02.441072 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.440923    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-oauth-serving-cert\") pod \"5c335224-53b0-4de2-ae1a-04edc4a56637\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") "
Jul 06 21:25:02.441072 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.440974    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-service-ca\") pod \"5c335224-53b0-4de2-ae1a-04edc4a56637\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") "
Jul 06 21:25:02.441072 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.440998    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-console-config\") pod \"5c335224-53b0-4de2-ae1a-04edc4a56637\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") "
Jul 06 21:25:02.441072 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.441040    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-oauth-config\") pod \"5c335224-53b0-4de2-ae1a-04edc4a56637\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") "
Jul 06 21:25:02.441238 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.441071    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-trusted-ca-bundle\") pod \"5c335224-53b0-4de2-ae1a-04edc4a56637\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") "
Jul 06 21:25:02.441238 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.441102    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-serving-cert\") pod \"5c335224-53b0-4de2-ae1a-04edc4a56637\" (UID: \"5c335224-53b0-4de2-ae1a-04edc4a56637\") "
Jul 06 21:25:02.441402 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.441371    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c335224-53b0-4de2-ae1a-04edc4a56637" (UID: "5c335224-53b0-4de2-ae1a-04edc4a56637"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:25:02.441517 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.441370    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-console-config" (OuterVolumeSpecName: "console-config") pod "5c335224-53b0-4de2-ae1a-04edc4a56637" (UID: "5c335224-53b0-4de2-ae1a-04edc4a56637"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:25:02.441517 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.441452    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c335224-53b0-4de2-ae1a-04edc4a56637" (UID: "5c335224-53b0-4de2-ae1a-04edc4a56637"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:25:02.441790 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.441519    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5c335224-53b0-4de2-ae1a-04edc4a56637" (UID: "5c335224-53b0-4de2-ae1a-04edc4a56637"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:25:02.443189 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.443164    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c335224-53b0-4de2-ae1a-04edc4a56637-kube-api-access-qbv8h" (OuterVolumeSpecName: "kube-api-access-qbv8h") pod "5c335224-53b0-4de2-ae1a-04edc4a56637" (UID: "5c335224-53b0-4de2-ae1a-04edc4a56637"). InnerVolumeSpecName "kube-api-access-qbv8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:25:02.443381 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.443357    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c335224-53b0-4de2-ae1a-04edc4a56637" (UID: "5c335224-53b0-4de2-ae1a-04edc4a56637"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:25:02.443545 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.443523    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c335224-53b0-4de2-ae1a-04edc4a56637" (UID: "5c335224-53b0-4de2-ae1a-04edc4a56637"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:25:02.542318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.542282    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-oauth-serving-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:25:02.542318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.542313    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-service-ca\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:25:02.542318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.542323    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-console-config\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:25:02.542318 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.542331    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-oauth-config\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:25:02.542583 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.542341    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c335224-53b0-4de2-ae1a-04edc4a56637-trusted-ca-bundle\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:25:02.542583 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.542349    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c335224-53b0-4de2-ae1a-04edc4a56637-console-serving-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:25:02.542583 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:02.542358    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbv8h\" (UniqueName: \"kubernetes.io/projected/5c335224-53b0-4de2-ae1a-04edc4a56637-kube-api-access-qbv8h\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:25:03.129637 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:03.129599    2564 generic.go:356] "Generic (PLEG): container finished" podID="5c335224-53b0-4de2-ae1a-04edc4a56637" containerID="d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12" exitCode=0
Jul 06 21:25:03.129637 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:03.129640    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f6f96f6fd-zvmwk"
Jul 06 21:25:03.130097 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:03.129641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6f96f6fd-zvmwk" event={"ID":"5c335224-53b0-4de2-ae1a-04edc4a56637","Type":"ContainerDied","Data":"d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12"}
Jul 06 21:25:03.130097 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:03.129762    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f6f96f6fd-zvmwk" event={"ID":"5c335224-53b0-4de2-ae1a-04edc4a56637","Type":"ContainerDied","Data":"3d7475c9e0217ce2eb2699c94cb3bf5da82aca187413f357a73b0939b13be55d"}
Jul 06 21:25:03.130097 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:03.129790    2564 scope.go:117] "RemoveContainer" containerID="d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12"
Jul 06 21:25:03.138504 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:03.138488    2564 scope.go:117] "RemoveContainer" containerID="d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12"
Jul 06 21:25:03.138746 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:25:03.138726    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12\": container with ID starting with d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12 not found: ID does not exist" containerID="d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12"
Jul 06 21:25:03.138801 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:03.138754    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12"} err="failed to get container status \"d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12\": rpc error: code = NotFound desc = could not find container \"d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12\": container with ID starting with d4fa7d318559898755b695e7e5dd745af9d3f18a6765a9e764de4015cf80ec12 not found: ID does not exist"
Jul 06 21:25:03.152675 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:03.152651    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f6f96f6fd-zvmwk"]
Jul 06 21:25:03.156517 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:03.156498    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f6f96f6fd-zvmwk"]
Jul 06 21:25:04.061484 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:04.061454    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c335224-53b0-4de2-ae1a-04edc4a56637" path="/var/lib/kubelet/pods/5c335224-53b0-4de2-ae1a-04edc4a56637/volumes"
Jul 06 21:25:30.876754 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:30.876721    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7"]
Jul 06 21:25:30.877152 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:30.877052    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c335224-53b0-4de2-ae1a-04edc4a56637" containerName="console"
Jul 06 21:25:30.877152 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:30.877064    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c335224-53b0-4de2-ae1a-04edc4a56637" containerName="console"
Jul 06 21:25:30.877152 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:30.877115    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c335224-53b0-4de2-ae1a-04edc4a56637" containerName="console"
Jul 06 21:25:30.878732 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:30.878716    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7"
Jul 06 21:25:30.881634 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:30.881611    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 06 21:25:30.881634 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:30.881624    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wh5qr\""
Jul 06 21:25:30.881799 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:30.881627    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 06 21:25:30.894725 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:30.894702    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7"]
Jul 06 21:25:30.962758 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:30.962720    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kv8h\" (UniqueName: \"kubernetes.io/projected/165835f0-1ce1-4014-a759-035fdf97bf5e-kube-api-access-2kv8h\") pod \"cert-manager-operator-controller-manager-55c444bf86-cfnz7\" (UID: \"165835f0-1ce1-4014-a759-035fdf97bf5e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7"
Jul 06 21:25:30.962933 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:30.962790    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/165835f0-1ce1-4014-a759-035fdf97bf5e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cfnz7\" (UID: \"165835f0-1ce1-4014-a759-035fdf97bf5e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7"
Jul 06 21:25:31.063651 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:31.063610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/165835f0-1ce1-4014-a759-035fdf97bf5e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cfnz7\" (UID: \"165835f0-1ce1-4014-a759-035fdf97bf5e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7"
Jul 06 21:25:31.063822 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:31.063691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kv8h\" (UniqueName: \"kubernetes.io/projected/165835f0-1ce1-4014-a759-035fdf97bf5e-kube-api-access-2kv8h\") pod \"cert-manager-operator-controller-manager-55c444bf86-cfnz7\" (UID: \"165835f0-1ce1-4014-a759-035fdf97bf5e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7"
Jul 06 21:25:31.064028 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:31.064005    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/165835f0-1ce1-4014-a759-035fdf97bf5e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cfnz7\" (UID: \"165835f0-1ce1-4014-a759-035fdf97bf5e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7"
Jul 06 21:25:31.073863 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:31.073842    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kv8h\" (UniqueName: \"kubernetes.io/projected/165835f0-1ce1-4014-a759-035fdf97bf5e-kube-api-access-2kv8h\") pod \"cert-manager-operator-controller-manager-55c444bf86-cfnz7\" (UID: \"165835f0-1ce1-4014-a759-035fdf97bf5e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7"
Jul 06 21:25:31.188082 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:31.187976    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7"
Jul 06 21:25:31.326041 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:31.325998    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7"]
Jul 06 21:25:31.328398 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:25:31.328363    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165835f0_1ce1_4014_a759_035fdf97bf5e.slice/crio-cf41613a1341f384f111d805f6214ac55472edfd8f40996200e2a1ee226ff28f WatchSource:0}: Error finding container cf41613a1341f384f111d805f6214ac55472edfd8f40996200e2a1ee226ff28f: Status 404 returned error can't find the container with id cf41613a1341f384f111d805f6214ac55472edfd8f40996200e2a1ee226ff28f
Jul 06 21:25:32.242768 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:32.242693    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7" event={"ID":"165835f0-1ce1-4014-a759-035fdf97bf5e","Type":"ContainerStarted","Data":"cf41613a1341f384f111d805f6214ac55472edfd8f40996200e2a1ee226ff28f"}
Jul 06 21:25:34.254629 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:34.254593    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7" event={"ID":"165835f0-1ce1-4014-a759-035fdf97bf5e","Type":"ContainerStarted","Data":"7abb83efff0c6be7d6e63f1bb46aae5700cf3716fed33b37f8ed524d56d5e30c"}
Jul 06 21:25:34.279728 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:34.279670    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cfnz7" podStartSLOduration=1.80346062 podStartE2EDuration="4.279655433s" totalImagesPullingTime="2.476194813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:25:34.277919473 +0000 UTC m=+242.751117095" watchObservedRunningTime="2026-07-06 21:25:34.279655433 +0000 UTC m=+242.752853053"
Jul 06 21:25:37.488162 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.488130    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q"]
Jul 06 21:25:37.490383 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.490360    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q"
Jul 06 21:25:37.492962 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.492938    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 21:25:37.493089 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.492942    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 21:25:37.503839 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.503812    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q"]
Jul 06 21:25:37.516932 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.515478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxzkf\" (UniqueName: \"kubernetes.io/projected/7b91ec94-8ed8-4b0b-ad75-17908d85ccc7-kube-api-access-hxzkf\") pod \"cert-manager-cainjector-559cdd8c87-nqt2q\" (UID: \"7b91ec94-8ed8-4b0b-ad75-17908d85ccc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q"
Jul 06 21:25:37.516932 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.515559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b91ec94-8ed8-4b0b-ad75-17908d85ccc7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nqt2q\" (UID: \"7b91ec94-8ed8-4b0b-ad75-17908d85ccc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q"
Jul 06 21:25:37.616424 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.616392    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxzkf\" (UniqueName: \"kubernetes.io/projected/7b91ec94-8ed8-4b0b-ad75-17908d85ccc7-kube-api-access-hxzkf\") pod \"cert-manager-cainjector-559cdd8c87-nqt2q\" (UID: \"7b91ec94-8ed8-4b0b-ad75-17908d85ccc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q"
Jul 06 21:25:37.616601 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.616440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b91ec94-8ed8-4b0b-ad75-17908d85ccc7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nqt2q\" (UID: \"7b91ec94-8ed8-4b0b-ad75-17908d85ccc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q"
Jul 06 21:25:37.624725 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.624703    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b91ec94-8ed8-4b0b-ad75-17908d85ccc7-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nqt2q\" (UID: \"7b91ec94-8ed8-4b0b-ad75-17908d85ccc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q"
Jul 06 21:25:37.625075 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.625051    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxzkf\" (UniqueName: \"kubernetes.io/projected/7b91ec94-8ed8-4b0b-ad75-17908d85ccc7-kube-api-access-hxzkf\") pod \"cert-manager-cainjector-559cdd8c87-nqt2q\" (UID: \"7b91ec94-8ed8-4b0b-ad75-17908d85ccc7\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q"
Jul 06 21:25:37.813032 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.812952    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q"
Jul 06 21:25:37.940768 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:37.940736    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q"]
Jul 06 21:25:37.943524 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:25:37.943502    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b91ec94_8ed8_4b0b_ad75_17908d85ccc7.slice/crio-677be6083e383cd4e60c75a7728e826ffa28b47b731cdf51cc770e156f07fadd WatchSource:0}: Error finding container 677be6083e383cd4e60c75a7728e826ffa28b47b731cdf51cc770e156f07fadd: Status 404 returned error can't find the container with id 677be6083e383cd4e60c75a7728e826ffa28b47b731cdf51cc770e156f07fadd
Jul 06 21:25:38.271098 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:38.271065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q" event={"ID":"7b91ec94-8ed8-4b0b-ad75-17908d85ccc7","Type":"ContainerStarted","Data":"677be6083e383cd4e60c75a7728e826ffa28b47b731cdf51cc770e156f07fadd"}
Jul 06 21:25:40.281331 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:40.281298    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q" event={"ID":"7b91ec94-8ed8-4b0b-ad75-17908d85ccc7","Type":"ContainerStarted","Data":"fa516d1cf14201a7461b3232ecd57284196a6e9b0d15a1eb6f64727e51e605a3"}
Jul 06 21:25:40.304185 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:40.304139    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqt2q" podStartSLOduration=1.05997817 podStartE2EDuration="3.304124121s" totalImagesPullingTime="2.244145951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:25:40.303808166 +0000 UTC m=+248.777005787" watchObservedRunningTime="2026-07-06 21:25:40.304124121 +0000 UTC m=+248.777321741"
Jul 06 21:25:45.517299 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.517269    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ntt5p"]
Jul 06 21:25:45.519609 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.519593    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ntt5p"
Jul 06 21:25:45.522237 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.522215    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-54sks\""
Jul 06 21:25:45.531473 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.531453    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ntt5p"]
Jul 06 21:25:45.582010 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.581981    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/958cdeb0-13ce-40fb-85ac-1760a5cd3dfe-bound-sa-token\") pod \"cert-manager-55b4d954d5-ntt5p\" (UID: \"958cdeb0-13ce-40fb-85ac-1760a5cd3dfe\") " pod="cert-manager/cert-manager-55b4d954d5-ntt5p"
Jul 06 21:25:45.582010 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.582010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8qbq\" (UniqueName: \"kubernetes.io/projected/958cdeb0-13ce-40fb-85ac-1760a5cd3dfe-kube-api-access-f8qbq\") pod \"cert-manager-55b4d954d5-ntt5p\" (UID: \"958cdeb0-13ce-40fb-85ac-1760a5cd3dfe\") " pod="cert-manager/cert-manager-55b4d954d5-ntt5p"
Jul 06 21:25:45.683327 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.683291    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/958cdeb0-13ce-40fb-85ac-1760a5cd3dfe-bound-sa-token\") pod \"cert-manager-55b4d954d5-ntt5p\" (UID: \"958cdeb0-13ce-40fb-85ac-1760a5cd3dfe\") " pod="cert-manager/cert-manager-55b4d954d5-ntt5p"
Jul 06 21:25:45.683327 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.683329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8qbq\" (UniqueName: \"kubernetes.io/projected/958cdeb0-13ce-40fb-85ac-1760a5cd3dfe-kube-api-access-f8qbq\") pod \"cert-manager-55b4d954d5-ntt5p\" (UID: \"958cdeb0-13ce-40fb-85ac-1760a5cd3dfe\") " pod="cert-manager/cert-manager-55b4d954d5-ntt5p"
Jul 06 21:25:45.698420 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.698385    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8qbq\" (UniqueName: \"kubernetes.io/projected/958cdeb0-13ce-40fb-85ac-1760a5cd3dfe-kube-api-access-f8qbq\") pod \"cert-manager-55b4d954d5-ntt5p\" (UID: \"958cdeb0-13ce-40fb-85ac-1760a5cd3dfe\") " pod="cert-manager/cert-manager-55b4d954d5-ntt5p"
Jul 06 21:25:45.699287 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.699269    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/958cdeb0-13ce-40fb-85ac-1760a5cd3dfe-bound-sa-token\") pod \"cert-manager-55b4d954d5-ntt5p\" (UID: \"958cdeb0-13ce-40fb-85ac-1760a5cd3dfe\") " pod="cert-manager/cert-manager-55b4d954d5-ntt5p"
Jul 06 21:25:45.828133 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.828047    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ntt5p"
Jul 06 21:25:45.957299 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:45.957272    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ntt5p"]
Jul 06 21:25:45.960106 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:25:45.960082    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod958cdeb0_13ce_40fb_85ac_1760a5cd3dfe.slice/crio-f0b345ff9d6ee93b6cc10261f9ecf9de4e6859d5d50ea8664edaf1bdbec94420 WatchSource:0}: Error finding container f0b345ff9d6ee93b6cc10261f9ecf9de4e6859d5d50ea8664edaf1bdbec94420: Status 404 returned error can't find the container with id f0b345ff9d6ee93b6cc10261f9ecf9de4e6859d5d50ea8664edaf1bdbec94420
Jul 06 21:25:46.306508 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:46.306476    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ntt5p" event={"ID":"958cdeb0-13ce-40fb-85ac-1760a5cd3dfe","Type":"ContainerStarted","Data":"ee737dbc5e5b1d2e8439519075a433b9cce16a0d0e7a399e5d8a707649259486"}
Jul 06 21:25:46.306508 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:46.306512    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ntt5p" event={"ID":"958cdeb0-13ce-40fb-85ac-1760a5cd3dfe","Type":"ContainerStarted","Data":"f0b345ff9d6ee93b6cc10261f9ecf9de4e6859d5d50ea8664edaf1bdbec94420"}
Jul 06 21:25:46.326223 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:25:46.326167    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ntt5p" podStartSLOduration=1.326147038 podStartE2EDuration="1.326147038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:25:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:25:46.32545761 +0000 UTC m=+254.798655242" watchObservedRunningTime="2026-07-06 21:25:46.326147038 +0000 UTC m=+254.799344659"
Jul 06 21:26:09.985584 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:09.985503    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"]
Jul 06 21:26:09.990241 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:09.990225    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:09.993819 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:09.993800    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 21:26:09.993985 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:09.993803    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 21:26:09.993985 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:09.993850    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 21:26:09.994228 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:09.994213    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qmkl2\""
Jul 06 21:26:09.994409 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:09.994394    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 21:26:10.033993 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.033967    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"]
Jul 06 21:26:10.087032 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.087001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-webhook-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.087032 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.087034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zst8z\" (UniqueName: \"kubernetes.io/projected/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-kube-api-access-zst8z\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.087233 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.087092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.087233 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.087118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-manifests\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.087233 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.087174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-tmp\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.187802 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.187768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.187802 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.187806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-manifests\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.188046 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.187833    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-tmp\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.188046 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.187874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-webhook-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.188046 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.187891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zst8z\" (UniqueName: \"kubernetes.io/projected/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-kube-api-access-zst8z\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.188262 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.188236    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-manifests\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.190297 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.190278    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-tmp\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.190393 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.190380    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-webhook-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.190497 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.190479    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.205694 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.205665    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zst8z\" (UniqueName: \"kubernetes.io/projected/ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19-kube-api-access-zst8z\") pod \"opendatahub-operator-controller-manager-757974bfb6-hcnwv\" (UID: \"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19\") " pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.300699 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.300620    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:10.444952 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:10.444929    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"]
Jul 06 21:26:10.447908 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:26:10.447868    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1ac5cd_6bc1_4b8f_85c0_52994c82ed19.slice/crio-747930ad6b672194bb92a91ae7ec00f574a2169aed5ebccc8ba9308df2a1121f WatchSource:0}: Error finding container 747930ad6b672194bb92a91ae7ec00f574a2169aed5ebccc8ba9308df2a1121f: Status 404 returned error can't find the container with id 747930ad6b672194bb92a91ae7ec00f574a2169aed5ebccc8ba9308df2a1121f
Jul 06 21:26:11.407164 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:11.407130    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv" event={"ID":"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19","Type":"ContainerStarted","Data":"747930ad6b672194bb92a91ae7ec00f574a2169aed5ebccc8ba9308df2a1121f"}
Jul 06 21:26:14.428087 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:14.428050    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv" event={"ID":"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19","Type":"ContainerStarted","Data":"220c0b28eeb3b262b8a8a062152b325413329ca7fab0637d70ffaea90830123f"}
Jul 06 21:26:15.433967 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:15.433930    2564 generic.go:356] "Generic (PLEG): container finished" podID="ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19" containerID="220c0b28eeb3b262b8a8a062152b325413329ca7fab0637d70ffaea90830123f" exitCode=0
Jul 06 21:26:15.434392 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:15.433971    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv" event={"ID":"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19","Type":"ContainerDied","Data":"220c0b28eeb3b262b8a8a062152b325413329ca7fab0637d70ffaea90830123f"}
Jul 06 21:26:16.439972 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:16.439938    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv" event={"ID":"ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19","Type":"ContainerStarted","Data":"16a876760ac87db9c7f68e7f82b593d8f1c5384a481cf3d84bb3ed2bbfe78454"}
Jul 06 21:26:16.440330 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:16.440135    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:16.462545 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:16.462505    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv" podStartSLOduration=2.62834769 podStartE2EDuration="7.462490272s" totalImagesPullingTime="3.741046607s" totalInitContainerRuntime="1.093095975s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:26:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:26:16.461723948 +0000 UTC m=+284.934921568" watchObservedRunningTime="2026-07-06 21:26:16.462490272 +0000 UTC m=+284.935687891"
Jul 06 21:26:27.445715 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:27.445688    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-757974bfb6-hcnwv"
Jul 06 21:26:30.962294 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.962259    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2drdg"]
Jul 06 21:26:30.965421 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.965405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2drdg"
Jul 06 21:26:30.968367 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.968348    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 21:26:30.968535 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.968518    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gjnfp\""
Jul 06 21:26:30.973717 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.973698    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"]
Jul 06 21:26:30.976670 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.976657    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"
Jul 06 21:26:30.980403 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.980383    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 21:26:30.981039 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.980956    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-54jkl\""
Jul 06 21:26:30.981139 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.981055    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 21:26:30.981256 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.981225    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 21:26:30.981816 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.981795    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2drdg"]
Jul 06 21:26:30.985360 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:30.985342    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 21:26:31.001116 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.001095    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"]
Jul 06 21:26:31.068371 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.068344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4f68832-5144-4146-bdc0-7783c67b74e5-cert\") pod \"odh-model-controller-7998c67dc4-2drdg\" (UID: \"a4f68832-5144-4146-bdc0-7783c67b74e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2drdg"
Jul 06 21:26:31.068574 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.068433    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5zh8\" (UniqueName: \"kubernetes.io/projected/a4f68832-5144-4146-bdc0-7783c67b74e5-kube-api-access-g5zh8\") pod \"odh-model-controller-7998c67dc4-2drdg\" (UID: \"a4f68832-5144-4146-bdc0-7783c67b74e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2drdg"
Jul 06 21:26:31.068574 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.068473    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5df0e545-a7fd-4efe-93f1-456606cb740d-tmp\") pod \"kube-auth-proxy-5b4d5f5648-l6748\" (UID: \"5df0e545-a7fd-4efe-93f1-456606cb740d\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"
Jul 06 21:26:31.068574 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.068504    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v9sm\" (UniqueName: \"kubernetes.io/projected/5df0e545-a7fd-4efe-93f1-456606cb740d-kube-api-access-2v9sm\") pod \"kube-auth-proxy-5b4d5f5648-l6748\" (UID: \"5df0e545-a7fd-4efe-93f1-456606cb740d\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"
Jul 06 21:26:31.068574 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.068540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df0e545-a7fd-4efe-93f1-456606cb740d-tls-certs\") pod \"kube-auth-proxy-5b4d5f5648-l6748\" (UID: \"5df0e545-a7fd-4efe-93f1-456606cb740d\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"
Jul 06 21:26:31.169371 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.169342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5zh8\" (UniqueName: \"kubernetes.io/projected/a4f68832-5144-4146-bdc0-7783c67b74e5-kube-api-access-g5zh8\") pod \"odh-model-controller-7998c67dc4-2drdg\" (UID: \"a4f68832-5144-4146-bdc0-7783c67b74e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2drdg"
Jul 06 21:26:31.169574 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.169381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5df0e545-a7fd-4efe-93f1-456606cb740d-tmp\") pod \"kube-auth-proxy-5b4d5f5648-l6748\" (UID: \"5df0e545-a7fd-4efe-93f1-456606cb740d\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"
Jul 06 21:26:31.169574 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.169410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v9sm\" (UniqueName: \"kubernetes.io/projected/5df0e545-a7fd-4efe-93f1-456606cb740d-kube-api-access-2v9sm\") pod \"kube-auth-proxy-5b4d5f5648-l6748\" (UID: \"5df0e545-a7fd-4efe-93f1-456606cb740d\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"
Jul 06 21:26:31.169574 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.169440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df0e545-a7fd-4efe-93f1-456606cb740d-tls-certs\") pod \"kube-auth-proxy-5b4d5f5648-l6748\" (UID: \"5df0e545-a7fd-4efe-93f1-456606cb740d\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"
Jul 06 21:26:31.169574 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.169462    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4f68832-5144-4146-bdc0-7783c67b74e5-cert\") pod \"odh-model-controller-7998c67dc4-2drdg\" (UID: \"a4f68832-5144-4146-bdc0-7783c67b74e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2drdg"
Jul 06 21:26:31.169574 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:26:31.169561    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 21:26:31.169825 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:26:31.169621    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4f68832-5144-4146-bdc0-7783c67b74e5-cert podName:a4f68832-5144-4146-bdc0-7783c67b74e5 nodeName:}" failed. No retries permitted until 2026-07-06 21:26:31.669603633 +0000 UTC m=+300.142801234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4f68832-5144-4146-bdc0-7783c67b74e5-cert") pod "odh-model-controller-7998c67dc4-2drdg" (UID: "a4f68832-5144-4146-bdc0-7783c67b74e5") : secret "odh-model-controller-webhook-cert" not found
Jul 06 21:26:31.171860 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.171836    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5df0e545-a7fd-4efe-93f1-456606cb740d-tmp\") pod \"kube-auth-proxy-5b4d5f5648-l6748\" (UID: \"5df0e545-a7fd-4efe-93f1-456606cb740d\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"
Jul 06 21:26:31.172120 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.172093    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5df0e545-a7fd-4efe-93f1-456606cb740d-tls-certs\") pod \"kube-auth-proxy-5b4d5f5648-l6748\" (UID: \"5df0e545-a7fd-4efe-93f1-456606cb740d\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"
Jul 06 21:26:31.177854 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.177829    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5zh8\" (UniqueName: \"kubernetes.io/projected/a4f68832-5144-4146-bdc0-7783c67b74e5-kube-api-access-g5zh8\") pod \"odh-model-controller-7998c67dc4-2drdg\" (UID: \"a4f68832-5144-4146-bdc0-7783c67b74e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2drdg"
Jul 06 21:26:31.177989 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.177968    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v9sm\" (UniqueName: \"kubernetes.io/projected/5df0e545-a7fd-4efe-93f1-456606cb740d-kube-api-access-2v9sm\") pod \"kube-auth-proxy-5b4d5f5648-l6748\" (UID: \"5df0e545-a7fd-4efe-93f1-456606cb740d\") " pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"
Jul 06 21:26:31.287206 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.287159    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"
Jul 06 21:26:31.421481 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.421458    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748"]
Jul 06 21:26:31.423648 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:26:31.423623    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df0e545_a7fd_4efe_93f1_456606cb740d.slice/crio-d592778dfab21e3c072d29af61f61d3d6a274bbb6c6e17890134bb4fc7166a6e WatchSource:0}: Error finding container d592778dfab21e3c072d29af61f61d3d6a274bbb6c6e17890134bb4fc7166a6e: Status 404 returned error can't find the container with id d592778dfab21e3c072d29af61f61d3d6a274bbb6c6e17890134bb4fc7166a6e
Jul 06 21:26:31.506558 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.506525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748" event={"ID":"5df0e545-a7fd-4efe-93f1-456606cb740d","Type":"ContainerStarted","Data":"d592778dfab21e3c072d29af61f61d3d6a274bbb6c6e17890134bb4fc7166a6e"}
Jul 06 21:26:31.675245 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.675156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4f68832-5144-4146-bdc0-7783c67b74e5-cert\") pod \"odh-model-controller-7998c67dc4-2drdg\" (UID: \"a4f68832-5144-4146-bdc0-7783c67b74e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2drdg"
Jul 06 21:26:31.677610 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.677593    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4f68832-5144-4146-bdc0-7783c67b74e5-cert\") pod \"odh-model-controller-7998c67dc4-2drdg\" (UID: \"a4f68832-5144-4146-bdc0-7783c67b74e5\") " pod="opendatahub/odh-model-controller-7998c67dc4-2drdg"
Jul 06 21:26:31.879519 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.879492    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gjnfp\""
Jul 06 21:26:31.885404 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.885364    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2drdg"
Jul 06 21:26:31.914930 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.914884    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:26:31.916052 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.916021    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:26:31.918701 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:31.918679    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 21:26:32.071823 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.053437    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2drdg"]
Jul 06 21:26:32.071823 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:26:32.055854    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f68832_5144_4146_bdc0_7783c67b74e5.slice/crio-eaaeb6c6262667c5a92f0f91a0ded993846a692885ef3ec56baa03cdf22f99e2 WatchSource:0}: Error finding container eaaeb6c6262667c5a92f0f91a0ded993846a692885ef3ec56baa03cdf22f99e2: Status 404 returned error can't find the container with id eaaeb6c6262667c5a92f0f91a0ded993846a692885ef3ec56baa03cdf22f99e2
Jul 06 21:26:32.321046 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.320990    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"]
Jul 06 21:26:32.324339 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.324318    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.327343 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.327189    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 21:26:32.327343 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.327209    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 21:26:32.327343 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.327222    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 21:26:32.327638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.327359    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 21:26:32.327638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.327400    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4b4dp\""
Jul 06 21:26:32.345371 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.345342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"]
Jul 06 21:26:32.380065 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.380040    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.380217 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.380074    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.380217 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.380093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-cacerts\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.380217 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.380116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e3b6089-1626-4152-8094-ba9853ad9d17-local-certs\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.380217 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.380172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.380367 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.380263    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-token\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.380367 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.380292    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv9d6\" (UniqueName: \"kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-kube-api-access-dv9d6\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.481232 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.481197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-token\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.481399 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.481234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv9d6\" (UniqueName: \"kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-kube-api-access-dv9d6\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.481399 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.481278    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.481399 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.481308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.481399 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.481331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-cacerts\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.481585 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.481438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e3b6089-1626-4152-8094-ba9853ad9d17-local-certs\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.481585 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.481490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.481964 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.481931    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.483916 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.483881    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.484060 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.484040    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.484182 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.484163    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e3b6089-1626-4152-8094-ba9853ad9d17-local-certs\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.484220 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.484172    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-cacerts\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.489676 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.489649    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-token\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.490049 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.490033    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv9d6\" (UniqueName: \"kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-kube-api-access-dv9d6\") pod \"istiod-openshift-gateway-7574459656-8dr6j\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.511671 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.511646    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2drdg" event={"ID":"a4f68832-5144-4146-bdc0-7783c67b74e5","Type":"ContainerStarted","Data":"eaaeb6c6262667c5a92f0f91a0ded993846a692885ef3ec56baa03cdf22f99e2"}
Jul 06 21:26:32.636034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.635949    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:32.803974 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:32.803890    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"]
Jul 06 21:26:32.807769 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:26:32.807741    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3b6089_1626_4152_8094_ba9853ad9d17.slice/crio-84d97643f8744b31ee85c869543a8b4d22fa3e2faa9ee7bfcf0c16c2e9987a14 WatchSource:0}: Error finding container 84d97643f8744b31ee85c869543a8b4d22fa3e2faa9ee7bfcf0c16c2e9987a14: Status 404 returned error can't find the container with id 84d97643f8744b31ee85c869543a8b4d22fa3e2faa9ee7bfcf0c16c2e9987a14
Jul 06 21:26:33.521453 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:33.521402    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j" event={"ID":"2e3b6089-1626-4152-8094-ba9853ad9d17","Type":"ContainerStarted","Data":"84d97643f8744b31ee85c869543a8b4d22fa3e2faa9ee7bfcf0c16c2e9987a14"}
Jul 06 21:26:36.878666 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:36.878644    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 21:26:36.881061 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:36.881035    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:26:36.881116 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:36.881090    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:26:37.545862 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:37.545817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748" event={"ID":"5df0e545-a7fd-4efe-93f1-456606cb740d","Type":"ContainerStarted","Data":"b7336e9b592f454622fb2e0c4b03abd0c79298e7f9880014e61c23b68e663b02"}
Jul 06 21:26:37.547479 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:37.547447    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j" event={"ID":"2e3b6089-1626-4152-8094-ba9853ad9d17","Type":"ContainerStarted","Data":"c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd"}
Jul 06 21:26:37.547801 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:37.547509    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:37.549327 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:37.549302    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2drdg" event={"ID":"a4f68832-5144-4146-bdc0-7783c67b74e5","Type":"ContainerStarted","Data":"3762c0bdb6e1feeea15c925360a3e3abfbbc26104141aa418ba3bd06a562e300"}
Jul 06 21:26:37.549460 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:37.549441    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2drdg"
Jul 06 21:26:37.550239 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:37.550171    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-8dr6j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 21:26:37.550239 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:37.550220    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j" podUID="2e3b6089-1626-4152-8094-ba9853ad9d17" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 21:26:37.578469 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:37.578418    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b4d5f5648-l6748" podStartSLOduration=2.128207706 podStartE2EDuration="7.578404074s" totalImagesPullingTime="5.450196368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:26:37.576742944 +0000 UTC m=+306.049940565" watchObservedRunningTime="2026-07-06 21:26:37.578404074 +0000 UTC m=+306.051601726"
Jul 06 21:26:37.598531 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:37.598485    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2drdg" podStartSLOduration=2.786846255 podStartE2EDuration="7.598470393s" totalImagesPullingTime="4.811624138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:26:37.597459626 +0000 UTC m=+306.070657246" watchObservedRunningTime="2026-07-06 21:26:37.598470393 +0000 UTC m=+306.071668013"
Jul 06 21:26:37.626206 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:37.626137    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j" podStartSLOduration=1.555749131 podStartE2EDuration="5.626115206s" totalImagesPullingTime="4.070366075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:26:37.622877046 +0000 UTC m=+306.096074669" watchObservedRunningTime="2026-07-06 21:26:37.626115206 +0000 UTC m=+306.099312827"
Jul 06 21:26:38.554697 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:38.554672    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:42.004413 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.004372    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"]
Jul 06 21:26:42.008379 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.008357    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"]
Jul 06 21:26:42.008560 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.008464    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"
Jul 06 21:26:42.011654 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.011632    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-n84zc\""
Jul 06 21:26:42.011777 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.011681    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"
Jul 06 21:26:42.012022 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.012001    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 21:26:42.014380 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.014362    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jf4lr\""
Jul 06 21:26:42.014635 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.014614    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 21:26:42.029010 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.027477    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"]
Jul 06 21:26:42.029449 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.029263    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"]
Jul 06 21:26:42.070710 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.070680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnfxv\" (UniqueName: \"kubernetes.io/projected/c5f08460-315d-4ad6-b50d-58ccb852e4c6-kube-api-access-lnfxv\") pod \"kserve-controller-manager-d6f4b65b8-qfxbw\" (UID: \"c5f08460-315d-4ad6-b50d-58ccb852e4c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"
Jul 06 21:26:42.070874 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.070725    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwhdn\" (UniqueName: \"kubernetes.io/projected/a331790a-702d-44b2-b49f-b3320b3b8789-kube-api-access-mwhdn\") pod \"llmisvc-controller-manager-777c6bd7d5-mmrnl\" (UID: \"a331790a-702d-44b2-b49f-b3320b3b8789\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"
Jul 06 21:26:42.070874 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.070746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a331790a-702d-44b2-b49f-b3320b3b8789-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mmrnl\" (UID: \"a331790a-702d-44b2-b49f-b3320b3b8789\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"
Jul 06 21:26:42.070874 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.070858    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5f08460-315d-4ad6-b50d-58ccb852e4c6-cert\") pod \"kserve-controller-manager-d6f4b65b8-qfxbw\" (UID: \"c5f08460-315d-4ad6-b50d-58ccb852e4c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"
Jul 06 21:26:42.171405 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.171367    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5f08460-315d-4ad6-b50d-58ccb852e4c6-cert\") pod \"kserve-controller-manager-d6f4b65b8-qfxbw\" (UID: \"c5f08460-315d-4ad6-b50d-58ccb852e4c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"
Jul 06 21:26:42.171564 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.171449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnfxv\" (UniqueName: \"kubernetes.io/projected/c5f08460-315d-4ad6-b50d-58ccb852e4c6-kube-api-access-lnfxv\") pod \"kserve-controller-manager-d6f4b65b8-qfxbw\" (UID: \"c5f08460-315d-4ad6-b50d-58ccb852e4c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"
Jul 06 21:26:42.171564 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.171493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwhdn\" (UniqueName: \"kubernetes.io/projected/a331790a-702d-44b2-b49f-b3320b3b8789-kube-api-access-mwhdn\") pod \"llmisvc-controller-manager-777c6bd7d5-mmrnl\" (UID: \"a331790a-702d-44b2-b49f-b3320b3b8789\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"
Jul 06 21:26:42.171564 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.171517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a331790a-702d-44b2-b49f-b3320b3b8789-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mmrnl\" (UID: \"a331790a-702d-44b2-b49f-b3320b3b8789\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"
Jul 06 21:26:42.171683 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:26:42.171637    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 06 21:26:42.171719 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:26:42.171694    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a331790a-702d-44b2-b49f-b3320b3b8789-cert podName:a331790a-702d-44b2-b49f-b3320b3b8789 nodeName:}" failed. No retries permitted until 2026-07-06 21:26:42.67167469 +0000 UTC m=+311.144872294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a331790a-702d-44b2-b49f-b3320b3b8789-cert") pod "llmisvc-controller-manager-777c6bd7d5-mmrnl" (UID: "a331790a-702d-44b2-b49f-b3320b3b8789") : secret "llmisvc-webhook-server-cert" not found
Jul 06 21:26:42.173997 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.173974    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5f08460-315d-4ad6-b50d-58ccb852e4c6-cert\") pod \"kserve-controller-manager-d6f4b65b8-qfxbw\" (UID: \"c5f08460-315d-4ad6-b50d-58ccb852e4c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"
Jul 06 21:26:42.188870 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.188849    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnfxv\" (UniqueName: \"kubernetes.io/projected/c5f08460-315d-4ad6-b50d-58ccb852e4c6-kube-api-access-lnfxv\") pod \"kserve-controller-manager-d6f4b65b8-qfxbw\" (UID: \"c5f08460-315d-4ad6-b50d-58ccb852e4c6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"
Jul 06 21:26:42.192762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.192742    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwhdn\" (UniqueName: \"kubernetes.io/projected/a331790a-702d-44b2-b49f-b3320b3b8789-kube-api-access-mwhdn\") pod \"llmisvc-controller-manager-777c6bd7d5-mmrnl\" (UID: \"a331790a-702d-44b2-b49f-b3320b3b8789\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"
Jul 06 21:26:42.322393 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.322300    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"
Jul 06 21:26:42.487613 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.487592    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"]
Jul 06 21:26:42.488933 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:26:42.488888    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f08460_315d_4ad6_b50d_58ccb852e4c6.slice/crio-489e83664454706bd96d6bcbcfe83ad3c0378a2b494435ee78087a1056957c19 WatchSource:0}: Error finding container 489e83664454706bd96d6bcbcfe83ad3c0378a2b494435ee78087a1056957c19: Status 404 returned error can't find the container with id 489e83664454706bd96d6bcbcfe83ad3c0378a2b494435ee78087a1056957c19
Jul 06 21:26:42.490113 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.490098    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 21:26:42.573201 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.573121    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw" event={"ID":"c5f08460-315d-4ad6-b50d-58ccb852e4c6","Type":"ContainerStarted","Data":"489e83664454706bd96d6bcbcfe83ad3c0378a2b494435ee78087a1056957c19"}
Jul 06 21:26:42.676365 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.676335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a331790a-702d-44b2-b49f-b3320b3b8789-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mmrnl\" (UID: \"a331790a-702d-44b2-b49f-b3320b3b8789\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"
Jul 06 21:26:42.678839 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.678818    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a331790a-702d-44b2-b49f-b3320b3b8789-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mmrnl\" (UID: \"a331790a-702d-44b2-b49f-b3320b3b8789\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"
Jul 06 21:26:42.929936 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:42.929840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"
Jul 06 21:26:43.075210 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:43.075176    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"]
Jul 06 21:26:43.081068 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:26:43.081032    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda331790a_702d_44b2_b49f_b3320b3b8789.slice/crio-ce934a45dd4ba86f6afc51b504695f483c44a5d0e73134024501d9a8e2befa0d WatchSource:0}: Error finding container ce934a45dd4ba86f6afc51b504695f483c44a5d0e73134024501d9a8e2befa0d: Status 404 returned error can't find the container with id ce934a45dd4ba86f6afc51b504695f483c44a5d0e73134024501d9a8e2befa0d
Jul 06 21:26:43.580525 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:43.580484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl" event={"ID":"a331790a-702d-44b2-b49f-b3320b3b8789","Type":"ContainerStarted","Data":"ce934a45dd4ba86f6afc51b504695f483c44a5d0e73134024501d9a8e2befa0d"}
Jul 06 21:26:44.643363 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:44.643326    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"]
Jul 06 21:26:44.643847 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:44.643569    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j" podUID="2e3b6089-1626-4152-8094-ba9853ad9d17" containerName="discovery" containerID="cri-o://c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd" gracePeriod=30
Jul 06 21:26:45.221371 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.221348    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:45.301918 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.301861    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-kubeconfig\") pod \"2e3b6089-1626-4152-8094-ba9853ad9d17\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") "
Jul 06 21:26:45.302163 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.301948    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-ca-configmap\") pod \"2e3b6089-1626-4152-8094-ba9853ad9d17\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") "
Jul 06 21:26:45.302163 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.302085    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e3b6089-1626-4152-8094-ba9853ad9d17-local-certs\") pod \"2e3b6089-1626-4152-8094-ba9853ad9d17\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") "
Jul 06 21:26:45.302163 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.302151    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-token\") pod \"2e3b6089-1626-4152-8094-ba9853ad9d17\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") "
Jul 06 21:26:45.302351 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.302197    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-dns-cert\") pod \"2e3b6089-1626-4152-8094-ba9853ad9d17\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") "
Jul 06 21:26:45.302351 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.302237    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-cacerts\") pod \"2e3b6089-1626-4152-8094-ba9853ad9d17\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") "
Jul 06 21:26:45.302351 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.302275    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv9d6\" (UniqueName: \"kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-kube-api-access-dv9d6\") pod \"2e3b6089-1626-4152-8094-ba9853ad9d17\" (UID: \"2e3b6089-1626-4152-8094-ba9853ad9d17\") "
Jul 06 21:26:45.302351 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.302330    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "2e3b6089-1626-4152-8094-ba9853ad9d17" (UID: "2e3b6089-1626-4152-8094-ba9853ad9d17"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:26:45.303039 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.302563    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-ca-configmap\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:26:45.305028 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.305002    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "2e3b6089-1626-4152-8094-ba9853ad9d17" (UID: "2e3b6089-1626-4152-8094-ba9853ad9d17"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:26:45.305028 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.305014    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e3b6089-1626-4152-8094-ba9853ad9d17" (UID: "2e3b6089-1626-4152-8094-ba9853ad9d17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:26:45.306262 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.306214    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-cacerts" (OuterVolumeSpecName: "cacerts") pod "2e3b6089-1626-4152-8094-ba9853ad9d17" (UID: "2e3b6089-1626-4152-8094-ba9853ad9d17"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:26:45.306381 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.306357    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e3b6089-1626-4152-8094-ba9853ad9d17-local-certs" (OuterVolumeSpecName: "local-certs") pod "2e3b6089-1626-4152-8094-ba9853ad9d17" (UID: "2e3b6089-1626-4152-8094-ba9853ad9d17"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:26:45.306466 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.306375    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "2e3b6089-1626-4152-8094-ba9853ad9d17" (UID: "2e3b6089-1626-4152-8094-ba9853ad9d17"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:26:45.306994 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.306970    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-kube-api-access-dv9d6" (OuterVolumeSpecName: "kube-api-access-dv9d6") pod "2e3b6089-1626-4152-8094-ba9853ad9d17" (UID: "2e3b6089-1626-4152-8094-ba9853ad9d17"). InnerVolumeSpecName "kube-api-access-dv9d6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:26:45.403246 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.403174    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-kubeconfig\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:26:45.403246 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.403197    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e3b6089-1626-4152-8094-ba9853ad9d17-local-certs\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:26:45.403246 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.403206    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-token\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:26:45.403246 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.403214    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-istio-csr-dns-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:26:45.403246 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.403221    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2e3b6089-1626-4152-8094-ba9853ad9d17-cacerts\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:26:45.403246 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.403230    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv9d6\" (UniqueName: \"kubernetes.io/projected/2e3b6089-1626-4152-8094-ba9853ad9d17-kube-api-access-dv9d6\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:26:45.593208 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.593175    2564 generic.go:356] "Generic (PLEG): container finished" podID="2e3b6089-1626-4152-8094-ba9853ad9d17" containerID="c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd" exitCode=0
Jul 06 21:26:45.593447 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.593273    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"
Jul 06 21:26:45.593447 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.593278    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j" event={"ID":"2e3b6089-1626-4152-8094-ba9853ad9d17","Type":"ContainerDied","Data":"c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd"}
Jul 06 21:26:45.593447 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.593399    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j" event={"ID":"2e3b6089-1626-4152-8094-ba9853ad9d17","Type":"ContainerDied","Data":"84d97643f8744b31ee85c869543a8b4d22fa3e2faa9ee7bfcf0c16c2e9987a14"}
Jul 06 21:26:45.593447 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.593428    2564 scope.go:117] "RemoveContainer" containerID="c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd"
Jul 06 21:26:45.595036 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.595010    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw" event={"ID":"c5f08460-315d-4ad6-b50d-58ccb852e4c6","Type":"ContainerStarted","Data":"c3b19fdddb28ea7ea841ecb731dbaca243362fdee80f31f2b16bf696dfdb7aaf"}
Jul 06 21:26:45.595353 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.595340    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"
Jul 06 21:26:45.632959 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.632879    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw" podStartSLOduration=2.002027527 podStartE2EDuration="4.632856551s" totalImagesPullingTime="2.630829024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:26:45.631216983 +0000 UTC m=+314.104414604" watchObservedRunningTime="2026-07-06 21:26:45.632856551 +0000 UTC m=+314.106054172"
Jul 06 21:26:45.658062 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.657984    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"]
Jul 06 21:26:45.661273 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:45.661246    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8dr6j"]
Jul 06 21:26:46.062752 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:46.062719    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e3b6089-1626-4152-8094-ba9853ad9d17" path="/var/lib/kubelet/pods/2e3b6089-1626-4152-8094-ba9853ad9d17/volumes"
Jul 06 21:26:46.102672 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:46.102501    2564 scope.go:117] "RemoveContainer" containerID="c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd"
Jul 06 21:26:46.102840 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:26:46.102817    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd\": container with ID starting with c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd not found: ID does not exist" containerID="c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd"
Jul 06 21:26:46.102892 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:46.102855    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd"} err="failed to get container status \"c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd\": rpc error: code = NotFound desc = could not find container \"c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd\": container with ID starting with c73847a63cc47e2bca6ed0749bdf392bee9c90f5c8d8caef1b2d83292d2aa4cd not found: ID does not exist"
Jul 06 21:26:46.602222 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:46.602190    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl" event={"ID":"a331790a-702d-44b2-b49f-b3320b3b8789","Type":"ContainerStarted","Data":"035eadf7219f18e7307240e1e4dc23ffc07609b23d555e6d5e4cf5ba7fb326c7"}
Jul 06 21:26:46.624922 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:46.624855    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl" podStartSLOduration=2.555930693 podStartE2EDuration="5.62483968s" totalImagesPullingTime="3.068908987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:26:46.623077885 +0000 UTC m=+315.096275505" watchObservedRunningTime="2026-07-06 21:26:46.62483968 +0000 UTC m=+315.098037300"
Jul 06 21:26:47.606439 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:47.606408    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"
Jul 06 21:26:48.556421 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:26:48.556388    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2drdg"
Jul 06 21:27:16.607406 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:16.607377    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfxbw"
Jul 06 21:27:18.613803 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:18.613777    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mmrnl"
Jul 06 21:27:31.884875 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:31.884800    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xtfb"]
Jul 06 21:27:31.885312 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:31.885176    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3b6089-1626-4152-8094-ba9853ad9d17" containerName="discovery"
Jul 06 21:27:31.885312 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:31.885188    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3b6089-1626-4152-8094-ba9853ad9d17" containerName="discovery"
Jul 06 21:27:31.885312 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:31.885263    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3b6089-1626-4152-8094-ba9853ad9d17" containerName="discovery"
Jul 06 21:27:31.888382 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:31.888358    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2xtfb"
Jul 06 21:27:31.891078 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:31.891058    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jm6l8\""
Jul 06 21:27:31.891435 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:31.891419    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 21:27:31.891688 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:31.891668    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 21:27:31.899301 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:31.899272    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xtfb"]
Jul 06 21:27:31.982290 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:31.982259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5sxk\" (UniqueName: \"kubernetes.io/projected/6136f59e-dcbe-429e-9e0d-13621133ffd8-kube-api-access-t5sxk\") pod \"kuadrant-operator-catalog-2xtfb\" (UID: \"6136f59e-dcbe-429e-9e0d-13621133ffd8\") " pod="kuadrant-system/kuadrant-operator-catalog-2xtfb"
Jul 06 21:27:32.083673 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.083640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5sxk\" (UniqueName: \"kubernetes.io/projected/6136f59e-dcbe-429e-9e0d-13621133ffd8-kube-api-access-t5sxk\") pod \"kuadrant-operator-catalog-2xtfb\" (UID: \"6136f59e-dcbe-429e-9e0d-13621133ffd8\") " pod="kuadrant-system/kuadrant-operator-catalog-2xtfb"
Jul 06 21:27:32.092458 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.092428    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5sxk\" (UniqueName: \"kubernetes.io/projected/6136f59e-dcbe-429e-9e0d-13621133ffd8-kube-api-access-t5sxk\") pod \"kuadrant-operator-catalog-2xtfb\" (UID: \"6136f59e-dcbe-429e-9e0d-13621133ffd8\") " pod="kuadrant-system/kuadrant-operator-catalog-2xtfb"
Jul 06 21:27:32.201345 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.201267    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2xtfb"
Jul 06 21:27:32.253814 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.253781    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xtfb"]
Jul 06 21:27:32.329492 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.329472    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xtfb"]
Jul 06 21:27:32.331377 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:27:32.331351    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6136f59e_dcbe_429e_9e0d_13621133ffd8.slice/crio-4a1ee4f644ba757e1ba58f260171e62ece36b6c542ba9c9482cb4e0a725befe4 WatchSource:0}: Error finding container 4a1ee4f644ba757e1ba58f260171e62ece36b6c542ba9c9482cb4e0a725befe4: Status 404 returned error can't find the container with id 4a1ee4f644ba757e1ba58f260171e62ece36b6c542ba9c9482cb4e0a725befe4
Jul 06 21:27:32.459982 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.459910    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sxn6"]
Jul 06 21:27:32.464429 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.464413    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8sxn6"
Jul 06 21:27:32.472039 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.472017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sxn6"]
Jul 06 21:27:32.485774 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.485753    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5ftk\" (UniqueName: \"kubernetes.io/projected/4328c690-be8e-4438-9276-0a7a0a438f71-kube-api-access-m5ftk\") pod \"kuadrant-operator-catalog-8sxn6\" (UID: \"4328c690-be8e-4438-9276-0a7a0a438f71\") " pod="kuadrant-system/kuadrant-operator-catalog-8sxn6"
Jul 06 21:27:32.586722 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.586689    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5ftk\" (UniqueName: \"kubernetes.io/projected/4328c690-be8e-4438-9276-0a7a0a438f71-kube-api-access-m5ftk\") pod \"kuadrant-operator-catalog-8sxn6\" (UID: \"4328c690-be8e-4438-9276-0a7a0a438f71\") " pod="kuadrant-system/kuadrant-operator-catalog-8sxn6"
Jul 06 21:27:32.595268 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.595247    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5ftk\" (UniqueName: \"kubernetes.io/projected/4328c690-be8e-4438-9276-0a7a0a438f71-kube-api-access-m5ftk\") pod \"kuadrant-operator-catalog-8sxn6\" (UID: \"4328c690-be8e-4438-9276-0a7a0a438f71\") " pod="kuadrant-system/kuadrant-operator-catalog-8sxn6"
Jul 06 21:27:32.775042 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.775010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8sxn6"
Jul 06 21:27:32.815140 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.815091    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2xtfb" event={"ID":"6136f59e-dcbe-429e-9e0d-13621133ffd8","Type":"ContainerStarted","Data":"4a1ee4f644ba757e1ba58f260171e62ece36b6c542ba9c9482cb4e0a725befe4"}
Jul 06 21:27:32.915344 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:32.915320    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8sxn6"]
Jul 06 21:27:32.917115 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:27:32.917091    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4328c690_be8e_4438_9276_0a7a0a438f71.slice/crio-5d631c0a9cd1cd71a0ffbbe24247490de9163d1a8a9bdba63b2b4d7c87c24f99 WatchSource:0}: Error finding container 5d631c0a9cd1cd71a0ffbbe24247490de9163d1a8a9bdba63b2b4d7c87c24f99: Status 404 returned error can't find the container with id 5d631c0a9cd1cd71a0ffbbe24247490de9163d1a8a9bdba63b2b4d7c87c24f99
Jul 06 21:27:33.822662 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:33.822620    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8sxn6" event={"ID":"4328c690-be8e-4438-9276-0a7a0a438f71","Type":"ContainerStarted","Data":"5d631c0a9cd1cd71a0ffbbe24247490de9163d1a8a9bdba63b2b4d7c87c24f99"}
Jul 06 21:27:34.829011 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:34.828920    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8sxn6" event={"ID":"4328c690-be8e-4438-9276-0a7a0a438f71","Type":"ContainerStarted","Data":"5c900727e3a1cdac18d0bc164bd1bb002c618298968309c0e2665d4d8c97a114"}
Jul 06 21:27:34.830386 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:34.830364    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2xtfb" event={"ID":"6136f59e-dcbe-429e-9e0d-13621133ffd8","Type":"ContainerStarted","Data":"a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf"}
Jul 06 21:27:34.830488 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:34.830437    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2xtfb" podUID="6136f59e-dcbe-429e-9e0d-13621133ffd8" containerName="registry-server" containerID="cri-o://a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf" gracePeriod=2
Jul 06 21:27:34.846243 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:34.846203    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8sxn6" podStartSLOduration=1.2771225560000001 podStartE2EDuration="2.846189707s" totalImagesPullingTime="1.569067151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:27:34.845382397 +0000 UTC m=+363.318580045" watchObservedRunningTime="2026-07-06 21:27:34.846189707 +0000 UTC m=+363.319387331"
Jul 06 21:27:34.860929 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:34.860853    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2xtfb" podStartSLOduration=1.7088723670000001 podStartE2EDuration="3.860840631s" totalImagesPullingTime="2.151968264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:27:34.859799637 +0000 UTC m=+363.332997258" watchObservedRunningTime="2026-07-06 21:27:34.860840631 +0000 UTC m=+363.334038251"
Jul 06 21:27:35.080104 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.080047    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2xtfb"
Jul 06 21:27:35.107829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.107804    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5sxk\" (UniqueName: \"kubernetes.io/projected/6136f59e-dcbe-429e-9e0d-13621133ffd8-kube-api-access-t5sxk\") pod \"6136f59e-dcbe-429e-9e0d-13621133ffd8\" (UID: \"6136f59e-dcbe-429e-9e0d-13621133ffd8\") "
Jul 06 21:27:35.110058 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.110031    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6136f59e-dcbe-429e-9e0d-13621133ffd8-kube-api-access-t5sxk" (OuterVolumeSpecName: "kube-api-access-t5sxk") pod "6136f59e-dcbe-429e-9e0d-13621133ffd8" (UID: "6136f59e-dcbe-429e-9e0d-13621133ffd8"). InnerVolumeSpecName "kube-api-access-t5sxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:27:35.208560 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.208530    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5sxk\" (UniqueName: \"kubernetes.io/projected/6136f59e-dcbe-429e-9e0d-13621133ffd8-kube-api-access-t5sxk\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:27:35.835824 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.835729    2564 generic.go:356] "Generic (PLEG): container finished" podID="6136f59e-dcbe-429e-9e0d-13621133ffd8" containerID="a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf" exitCode=0
Jul 06 21:27:35.835824 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.835780    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2xtfb"
Jul 06 21:27:35.836345 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.835817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2xtfb" event={"ID":"6136f59e-dcbe-429e-9e0d-13621133ffd8","Type":"ContainerDied","Data":"a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf"}
Jul 06 21:27:35.836345 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.835867    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2xtfb" event={"ID":"6136f59e-dcbe-429e-9e0d-13621133ffd8","Type":"ContainerDied","Data":"4a1ee4f644ba757e1ba58f260171e62ece36b6c542ba9c9482cb4e0a725befe4"}
Jul 06 21:27:35.836345 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.835888    2564 scope.go:117] "RemoveContainer" containerID="a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf"
Jul 06 21:27:35.845121 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.845105    2564 scope.go:117] "RemoveContainer" containerID="a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf"
Jul 06 21:27:35.845391 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:27:35.845374    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf\": container with ID starting with a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf not found: ID does not exist" containerID="a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf"
Jul 06 21:27:35.845450 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.845399    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf"} err="failed to get container status \"a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf\": rpc error: code = NotFound desc = could not find container \"a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf\": container with ID starting with a5bfdd46c52e811b81cdb08452c702ad03e8fddf978c246acdd0e90461044bbf not found: ID does not exist"
Jul 06 21:27:35.860605 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.860580    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xtfb"]
Jul 06 21:27:35.864334 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:35.864314    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2xtfb"]
Jul 06 21:27:36.062028 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:36.061990    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6136f59e-dcbe-429e-9e0d-13621133ffd8" path="/var/lib/kubelet/pods/6136f59e-dcbe-429e-9e0d-13621133ffd8/volumes"
Jul 06 21:27:42.775320 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:42.775279    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8sxn6"
Jul 06 21:27:42.775808 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:42.775344    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8sxn6"
Jul 06 21:27:42.797980 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:42.797956    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8sxn6"
Jul 06 21:27:42.888769 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:42.888741    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8sxn6"
Jul 06 21:27:55.398613 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.398579    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6"]
Jul 06 21:27:55.399043 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.399027    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6136f59e-dcbe-429e-9e0d-13621133ffd8" containerName="registry-server"
Jul 06 21:27:55.399093 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.399044    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6136f59e-dcbe-429e-9e0d-13621133ffd8" containerName="registry-server"
Jul 06 21:27:55.399131 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.399117    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6136f59e-dcbe-429e-9e0d-13621133ffd8" containerName="registry-server"
Jul 06 21:27:55.402063 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.402049    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6"
Jul 06 21:27:55.405348 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.405321    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 21:27:55.405494 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.405413    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4w9j2\""
Jul 06 21:27:55.424331 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.424309    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6"]
Jul 06 21:27:55.476221 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.476189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffp8f\" (UniqueName: \"kubernetes.io/projected/1a5a96aa-45dc-4ad1-a5b1-0f32daa25cdb-kube-api-access-ffp8f\") pod \"dns-operator-controller-manager-864dd78c4c-hmqs6\" (UID: \"1a5a96aa-45dc-4ad1-a5b1-0f32daa25cdb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6"
Jul 06 21:27:55.577332 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.577299    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffp8f\" (UniqueName: \"kubernetes.io/projected/1a5a96aa-45dc-4ad1-a5b1-0f32daa25cdb-kube-api-access-ffp8f\") pod \"dns-operator-controller-manager-864dd78c4c-hmqs6\" (UID: \"1a5a96aa-45dc-4ad1-a5b1-0f32daa25cdb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6"
Jul 06 21:27:55.589633 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.589602    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffp8f\" (UniqueName: \"kubernetes.io/projected/1a5a96aa-45dc-4ad1-a5b1-0f32daa25cdb-kube-api-access-ffp8f\") pod \"dns-operator-controller-manager-864dd78c4c-hmqs6\" (UID: \"1a5a96aa-45dc-4ad1-a5b1-0f32daa25cdb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6"
Jul 06 21:27:55.712529 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.712449    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6"
Jul 06 21:27:55.849291 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.849269    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6"]
Jul 06 21:27:55.851468 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:27:55.851435    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5a96aa_45dc_4ad1_a5b1_0f32daa25cdb.slice/crio-fecd966c170722fdf2578f5ad20c6aad316406d4776154fb8177b7e4ee9fcf4c WatchSource:0}: Error finding container fecd966c170722fdf2578f5ad20c6aad316406d4776154fb8177b7e4ee9fcf4c: Status 404 returned error can't find the container with id fecd966c170722fdf2578f5ad20c6aad316406d4776154fb8177b7e4ee9fcf4c
Jul 06 21:27:55.925985 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:55.925951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6" event={"ID":"1a5a96aa-45dc-4ad1-a5b1-0f32daa25cdb","Type":"ContainerStarted","Data":"fecd966c170722fdf2578f5ad20c6aad316406d4776154fb8177b7e4ee9fcf4c"}
Jul 06 21:27:57.939800 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:57.939709    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6" event={"ID":"1a5a96aa-45dc-4ad1-a5b1-0f32daa25cdb","Type":"ContainerStarted","Data":"be54dccd1f6d630fc59b41897d3351822b7e50fe58115ddaab1c3584786b7190"}
Jul 06 21:27:57.940261 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:57.939851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6"
Jul 06 21:27:57.988672 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:57.988621    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6" podStartSLOduration=1.164514078 podStartE2EDuration="2.988606728s" totalImagesPullingTime="1.82409265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:27:57.985779426 +0000 UTC m=+386.458977057" watchObservedRunningTime="2026-07-06 21:27:57.988606728 +0000 UTC m=+386.461804411"
Jul 06 21:27:58.898892 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:58.898864    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"]
Jul 06 21:27:58.902444 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:58.902430    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:27:58.905054 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:58.905028    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gp57v\""
Jul 06 21:27:58.922093 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:58.922065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"]
Jul 06 21:27:59.008922 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:59.008871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpmvd\" (UniqueName: \"kubernetes.io/projected/d5885c5e-7578-484e-81f8-58b3620cd3bd-kube-api-access-wpmvd\") pod \"limitador-operator-controller-manager-859d7b78bd-ld9rp\" (UID: \"d5885c5e-7578-484e-81f8-58b3620cd3bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:27:59.110089 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:59.110058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpmvd\" (UniqueName: \"kubernetes.io/projected/d5885c5e-7578-484e-81f8-58b3620cd3bd-kube-api-access-wpmvd\") pod \"limitador-operator-controller-manager-859d7b78bd-ld9rp\" (UID: \"d5885c5e-7578-484e-81f8-58b3620cd3bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:27:59.121574 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:59.121546    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpmvd\" (UniqueName: \"kubernetes.io/projected/d5885c5e-7578-484e-81f8-58b3620cd3bd-kube-api-access-wpmvd\") pod \"limitador-operator-controller-manager-859d7b78bd-ld9rp\" (UID: \"d5885c5e-7578-484e-81f8-58b3620cd3bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:27:59.212357 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:59.212264    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:27:59.382248 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:59.382224    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"]
Jul 06 21:27:59.384643 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:27:59.384613    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5885c5e_7578_484e_81f8_58b3620cd3bd.slice/crio-d26b7df9a0c8b4b0bd7dcce9c9c18d207b9292d4fbd25664610cb8bb5fbc90ab WatchSource:0}: Error finding container d26b7df9a0c8b4b0bd7dcce9c9c18d207b9292d4fbd25664610cb8bb5fbc90ab: Status 404 returned error can't find the container with id d26b7df9a0c8b4b0bd7dcce9c9c18d207b9292d4fbd25664610cb8bb5fbc90ab
Jul 06 21:27:59.950957 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:27:59.950924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp" event={"ID":"d5885c5e-7578-484e-81f8-58b3620cd3bd","Type":"ContainerStarted","Data":"d26b7df9a0c8b4b0bd7dcce9c9c18d207b9292d4fbd25664610cb8bb5fbc90ab"}
Jul 06 21:28:01.963474 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:01.963439    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp" event={"ID":"d5885c5e-7578-484e-81f8-58b3620cd3bd","Type":"ContainerStarted","Data":"9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c"}
Jul 06 21:28:01.963848 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:01.963618    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:28:01.980996 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:01.980935    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp" podStartSLOduration=2.039120675 podStartE2EDuration="3.980917505s" totalImagesPullingTime="1.94179683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:27:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:28:01.980686487 +0000 UTC m=+390.453884107" watchObservedRunningTime="2026-07-06 21:28:01.980917505 +0000 UTC m=+390.454115123"
Jul 06 21:28:03.887476 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:03.887441    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"]
Jul 06 21:28:03.891237 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:03.891219    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:03.894775 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:03.894758    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ndxgg\""
Jul 06 21:28:03.903670 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:03.903630    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"]
Jul 06 21:28:03.951314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:03.951284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94852498-8809-4e48-a052-769dfc2adf53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" (UID: \"94852498-8809-4e48-a052-769dfc2adf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:03.951479 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:03.951329    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbb98\" (UniqueName: \"kubernetes.io/projected/94852498-8809-4e48-a052-769dfc2adf53-kube-api-access-jbb98\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" (UID: \"94852498-8809-4e48-a052-769dfc2adf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:04.052138 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:04.052101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbb98\" (UniqueName: \"kubernetes.io/projected/94852498-8809-4e48-a052-769dfc2adf53-kube-api-access-jbb98\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" (UID: \"94852498-8809-4e48-a052-769dfc2adf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:04.052303 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:04.052219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94852498-8809-4e48-a052-769dfc2adf53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" (UID: \"94852498-8809-4e48-a052-769dfc2adf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:04.052575 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:04.052559    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94852498-8809-4e48-a052-769dfc2adf53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" (UID: \"94852498-8809-4e48-a052-769dfc2adf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:04.062680 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:04.062655    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbb98\" (UniqueName: \"kubernetes.io/projected/94852498-8809-4e48-a052-769dfc2adf53-kube-api-access-jbb98\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" (UID: \"94852498-8809-4e48-a052-769dfc2adf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:04.203102 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:04.203021    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:04.359106 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:04.359081    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"]
Jul 06 21:28:04.979322 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:04.979284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz" event={"ID":"94852498-8809-4e48-a052-769dfc2adf53","Type":"ContainerStarted","Data":"3b9c945565a6af06e2646436fb6c667e611741a5b52a6417f508e90a2824d13a"}
Jul 06 21:28:07.028303 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:07.028271    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8djv4"]
Jul 06 21:28:07.031642 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:07.031626    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8djv4"
Jul 06 21:28:07.035007 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:07.034985    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qwk2q\""
Jul 06 21:28:07.045513 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:07.045493    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8djv4"]
Jul 06 21:28:07.182367 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:07.182316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f2hk\" (UniqueName: \"kubernetes.io/projected/da58a622-d50a-4d4e-8d1c-134c273fb397-kube-api-access-7f2hk\") pod \"authorino-operator-75cc8d5cb7-8djv4\" (UID: \"da58a622-d50a-4d4e-8d1c-134c273fb397\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8djv4"
Jul 06 21:28:07.283884 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:07.283802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f2hk\" (UniqueName: \"kubernetes.io/projected/da58a622-d50a-4d4e-8d1c-134c273fb397-kube-api-access-7f2hk\") pod \"authorino-operator-75cc8d5cb7-8djv4\" (UID: \"da58a622-d50a-4d4e-8d1c-134c273fb397\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8djv4"
Jul 06 21:28:07.300272 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:07.300239    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f2hk\" (UniqueName: \"kubernetes.io/projected/da58a622-d50a-4d4e-8d1c-134c273fb397-kube-api-access-7f2hk\") pod \"authorino-operator-75cc8d5cb7-8djv4\" (UID: \"da58a622-d50a-4d4e-8d1c-134c273fb397\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8djv4"
Jul 06 21:28:07.343868 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:07.343837    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8djv4"
Jul 06 21:28:07.496061 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:07.496035    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8djv4"]
Jul 06 21:28:07.498584 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:28:07.498548    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda58a622_d50a_4d4e_8d1c_134c273fb397.slice/crio-04e115c40f73dfb7f71ffac2a0ca83da825179827243ed78d48ff49cfd0a70e6 WatchSource:0}: Error finding container 04e115c40f73dfb7f71ffac2a0ca83da825179827243ed78d48ff49cfd0a70e6: Status 404 returned error can't find the container with id 04e115c40f73dfb7f71ffac2a0ca83da825179827243ed78d48ff49cfd0a70e6
Jul 06 21:28:07.994551 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:07.994519    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8djv4" event={"ID":"da58a622-d50a-4d4e-8d1c-134c273fb397","Type":"ContainerStarted","Data":"04e115c40f73dfb7f71ffac2a0ca83da825179827243ed78d48ff49cfd0a70e6"}
Jul 06 21:28:08.947129 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:08.947093    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hmqs6"
Jul 06 21:28:12.019522 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:12.019483    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8djv4" event={"ID":"da58a622-d50a-4d4e-8d1c-134c273fb397","Type":"ContainerStarted","Data":"1af8e80068a69744194a6aae23469a1979d74a1e777cdfcb2d2e63e8a94f6ff5"}
Jul 06 21:28:12.020012 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:12.019633    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8djv4"
Jul 06 21:28:12.021144 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:12.021119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz" event={"ID":"94852498-8809-4e48-a052-769dfc2adf53","Type":"ContainerStarted","Data":"0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec"}
Jul 06 21:28:12.021449 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:12.021165    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:12.040139 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:12.040086    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8djv4" podStartSLOduration=1.471976623 podStartE2EDuration="5.040068292s" totalImagesPullingTime="3.568091669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:28:12.038471772 +0000 UTC m=+400.511669393" watchObservedRunningTime="2026-07-06 21:28:12.040068292 +0000 UTC m=+400.513265913"
Jul 06 21:28:12.064750 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:12.064701    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz" podStartSLOduration=2.334170198 podStartE2EDuration="9.064688139s" totalImagesPullingTime="6.730517941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:28:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:28:12.063417302 +0000 UTC m=+400.536614915" watchObservedRunningTime="2026-07-06 21:28:12.064688139 +0000 UTC m=+400.537885759"
Jul 06 21:28:12.970422 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:12.970392    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:28:13.870181 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:13.870145    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"]
Jul 06 21:28:13.875191 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:13.875163    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"
Jul 06 21:28:13.877762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:13.877743    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zkjzz\""
Jul 06 21:28:13.877953 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:13.877937    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 21:28:13.878246 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:13.878228    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 21:28:13.883474 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:13.883452    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"]
Jul 06 21:28:13.943568 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:13.943534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e9e4276-e1e3-4e7a-9bbe-54893475c73f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bqz4p\" (UID: \"2e9e4276-e1e3-4e7a-9bbe-54893475c73f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"
Jul 06 21:28:13.943719 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:13.943572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8gnf\" (UniqueName: \"kubernetes.io/projected/2e9e4276-e1e3-4e7a-9bbe-54893475c73f-kube-api-access-f8gnf\") pod \"kuadrant-console-plugin-66b5774985-bqz4p\" (UID: \"2e9e4276-e1e3-4e7a-9bbe-54893475c73f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"
Jul 06 21:28:13.943719 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:13.943609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e9e4276-e1e3-4e7a-9bbe-54893475c73f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bqz4p\" (UID: \"2e9e4276-e1e3-4e7a-9bbe-54893475c73f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"
Jul 06 21:28:14.044831 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:14.044806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e9e4276-e1e3-4e7a-9bbe-54893475c73f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bqz4p\" (UID: \"2e9e4276-e1e3-4e7a-9bbe-54893475c73f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"
Jul 06 21:28:14.045012 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:14.044882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e9e4276-e1e3-4e7a-9bbe-54893475c73f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bqz4p\" (UID: \"2e9e4276-e1e3-4e7a-9bbe-54893475c73f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"
Jul 06 21:28:14.045012 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:14.044931    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8gnf\" (UniqueName: \"kubernetes.io/projected/2e9e4276-e1e3-4e7a-9bbe-54893475c73f-kube-api-access-f8gnf\") pod \"kuadrant-console-plugin-66b5774985-bqz4p\" (UID: \"2e9e4276-e1e3-4e7a-9bbe-54893475c73f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"
Jul 06 21:28:14.045443 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:14.045423    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2e9e4276-e1e3-4e7a-9bbe-54893475c73f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-bqz4p\" (UID: \"2e9e4276-e1e3-4e7a-9bbe-54893475c73f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"
Jul 06 21:28:14.047314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:14.047293    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e9e4276-e1e3-4e7a-9bbe-54893475c73f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-bqz4p\" (UID: \"2e9e4276-e1e3-4e7a-9bbe-54893475c73f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"
Jul 06 21:28:14.053396 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:14.053379    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8gnf\" (UniqueName: \"kubernetes.io/projected/2e9e4276-e1e3-4e7a-9bbe-54893475c73f-kube-api-access-f8gnf\") pod \"kuadrant-console-plugin-66b5774985-bqz4p\" (UID: \"2e9e4276-e1e3-4e7a-9bbe-54893475c73f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"
Jul 06 21:28:14.185842 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:14.185768    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"
Jul 06 21:28:14.324266 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:14.324241    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p"]
Jul 06 21:28:14.325781 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:28:14.325758    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e9e4276_e1e3_4e7a_9bbe_54893475c73f.slice/crio-a41446c799763eee3ce5459edf9ea04b1145ef56d0f56576684257c3fb801739 WatchSource:0}: Error finding container a41446c799763eee3ce5459edf9ea04b1145ef56d0f56576684257c3fb801739: Status 404 returned error can't find the container with id a41446c799763eee3ce5459edf9ea04b1145ef56d0f56576684257c3fb801739
Jul 06 21:28:15.038219 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:15.038181    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p" event={"ID":"2e9e4276-e1e3-4e7a-9bbe-54893475c73f","Type":"ContainerStarted","Data":"a41446c799763eee3ce5459edf9ea04b1145ef56d0f56576684257c3fb801739"}
Jul 06 21:28:23.028958 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:23.028919    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8djv4"
Jul 06 21:28:23.029416 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:23.029015    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:25.347263 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.347229    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"]
Jul 06 21:28:25.347726 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.347480    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz" podUID="94852498-8809-4e48-a052-769dfc2adf53" containerName="manager" containerID="cri-o://0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec" gracePeriod=2
Jul 06 21:28:25.361148 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.361121    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"]
Jul 06 21:28:25.380814 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.380782    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"]
Jul 06 21:28:25.381241 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.381191    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" containerName="manager" containerID="cri-o://9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c" gracePeriod=2
Jul 06 21:28:25.392963 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.392311    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"]
Jul 06 21:28:25.397240 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:25.397210    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="94852498-8809-4e48-a052-769dfc2adf53" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:25.398964 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.398938    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"]
Jul 06 21:28:25.399501 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.399481    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" containerName="manager"
Jul 06 21:28:25.399648 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.399632    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" containerName="manager"
Jul 06 21:28:25.399757 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.399744    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94852498-8809-4e48-a052-769dfc2adf53" containerName="manager"
Jul 06 21:28:25.399857 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.399845    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94852498-8809-4e48-a052-769dfc2adf53" containerName="manager"
Jul 06 21:28:25.400090 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.400074    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" containerName="manager"
Jul 06 21:28:25.400196 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.400183    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="94852498-8809-4e48-a052-769dfc2adf53" containerName="manager"
Jul 06 21:28:25.404960 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.404937    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:25.407412 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:25.407378    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ld9rp\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:28:25.409571 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:25.409537    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="94852498-8809-4e48-a052-769dfc2adf53" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:25.435079 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.435047    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"]
Jul 06 21:28:25.463105 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.463078    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z"]
Jul 06 21:28:25.468927 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.468861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z"
Jul 06 21:28:25.477014 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:25.476971    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ld9rp\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:28:25.480560 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:25.480522    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="94852498-8809-4e48-a052-769dfc2adf53" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:25.489192 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.489167    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z"]
Jul 06 21:28:25.554805 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.554764    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cafb6e63-c628-42f2-ad5f-42918eaf01ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw7gt\" (UID: \"cafb6e63-c628-42f2-ad5f-42918eaf01ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:25.555005 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.554839    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dtpv\" (UniqueName: \"kubernetes.io/projected/cafb6e63-c628-42f2-ad5f-42918eaf01ee-kube-api-access-8dtpv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw7gt\" (UID: \"cafb6e63-c628-42f2-ad5f-42918eaf01ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:25.656105 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.656020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dtpv\" (UniqueName: \"kubernetes.io/projected/cafb6e63-c628-42f2-ad5f-42918eaf01ee-kube-api-access-8dtpv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw7gt\" (UID: \"cafb6e63-c628-42f2-ad5f-42918eaf01ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:25.656278 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.656155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cafb6e63-c628-42f2-ad5f-42918eaf01ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw7gt\" (UID: \"cafb6e63-c628-42f2-ad5f-42918eaf01ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:25.656278 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.656192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9s4p\" (UniqueName: \"kubernetes.io/projected/d00d4ec6-c72f-45d6-ac52-24c6def349a5-kube-api-access-h9s4p\") pod \"limitador-operator-controller-manager-859d7b78bd-j6r9z\" (UID: \"d00d4ec6-c72f-45d6-ac52-24c6def349a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z"
Jul 06 21:28:25.656637 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.656616    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cafb6e63-c628-42f2-ad5f-42918eaf01ee-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw7gt\" (UID: \"cafb6e63-c628-42f2-ad5f-42918eaf01ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:25.671184 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.671156    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dtpv\" (UniqueName: \"kubernetes.io/projected/cafb6e63-c628-42f2-ad5f-42918eaf01ee-kube-api-access-8dtpv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kw7gt\" (UID: \"cafb6e63-c628-42f2-ad5f-42918eaf01ee\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:25.757179 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.757139    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9s4p\" (UniqueName: \"kubernetes.io/projected/d00d4ec6-c72f-45d6-ac52-24c6def349a5-kube-api-access-h9s4p\") pod \"limitador-operator-controller-manager-859d7b78bd-j6r9z\" (UID: \"d00d4ec6-c72f-45d6-ac52-24c6def349a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z"
Jul 06 21:28:25.772189 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.772107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:25.772608 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.772588    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9s4p\" (UniqueName: \"kubernetes.io/projected/d00d4ec6-c72f-45d6-ac52-24c6def349a5-kube-api-access-h9s4p\") pod \"limitador-operator-controller-manager-859d7b78bd-j6r9z\" (UID: \"d00d4ec6-c72f-45d6-ac52-24c6def349a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z"
Jul 06 21:28:25.785501 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:25.785469    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z"
Jul 06 21:28:26.441480 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:26.441445    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"]
Jul 06 21:28:26.455616 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:26.455592    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:28:26.461028 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:26.460999    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"]
Jul 06 21:28:26.464321 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:26.464136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffe9de0d-4d53-43d4-8df3-e03e43977235-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ww7pd\" (UID: \"ffe9de0d-4d53-43d4-8df3-e03e43977235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:28:26.464321 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:26.464244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76dzj\" (UniqueName: \"kubernetes.io/projected/ffe9de0d-4d53-43d4-8df3-e03e43977235-kube-api-access-76dzj\") pod \"kuadrant-operator-controller-manager-86878c769f-ww7pd\" (UID: \"ffe9de0d-4d53-43d4-8df3-e03e43977235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:28:26.565404 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:26.565363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76dzj\" (UniqueName: \"kubernetes.io/projected/ffe9de0d-4d53-43d4-8df3-e03e43977235-kube-api-access-76dzj\") pod \"kuadrant-operator-controller-manager-86878c769f-ww7pd\" (UID: \"ffe9de0d-4d53-43d4-8df3-e03e43977235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:28:26.565597 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:26.565490    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffe9de0d-4d53-43d4-8df3-e03e43977235-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ww7pd\" (UID: \"ffe9de0d-4d53-43d4-8df3-e03e43977235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:28:26.565892 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:26.565872    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffe9de0d-4d53-43d4-8df3-e03e43977235-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ww7pd\" (UID: \"ffe9de0d-4d53-43d4-8df3-e03e43977235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:28:26.578703 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:26.578674    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76dzj\" (UniqueName: \"kubernetes.io/projected/ffe9de0d-4d53-43d4-8df3-e03e43977235-kube-api-access-76dzj\") pod \"kuadrant-operator-controller-manager-86878c769f-ww7pd\" (UID: \"ffe9de0d-4d53-43d4-8df3-e03e43977235\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:28:26.770332 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:26.770299    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:28:31.705395 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.705363    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-665945f5b5-k2tck"]
Jul 06 21:28:31.735767 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.735740    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665945f5b5-k2tck"]
Jul 06 21:28:31.735938 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.735863    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.812008 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.811977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-console-config\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.812174 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.812047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww2bd\" (UniqueName: \"kubernetes.io/projected/cead3696-e447-4038-9328-fd9fd1c2e3a5-kube-api-access-ww2bd\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.812174 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.812089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cead3696-e447-4038-9328-fd9fd1c2e3a5-console-serving-cert\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.812174 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.812118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cead3696-e447-4038-9328-fd9fd1c2e3a5-console-oauth-config\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.812329 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.812193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-trusted-ca-bundle\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.812329 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.812252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-service-ca\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.812437 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.812350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-oauth-serving-cert\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.913778 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.913748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cead3696-e447-4038-9328-fd9fd1c2e3a5-console-serving-cert\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.913778 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.913785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cead3696-e447-4038-9328-fd9fd1c2e3a5-console-oauth-config\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.914034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.913808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-trusted-ca-bundle\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.914034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.913843    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-service-ca\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.914034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.913882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-oauth-serving-cert\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.914327 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.914304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-console-config\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.914423 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.914366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww2bd\" (UniqueName: \"kubernetes.io/projected/cead3696-e447-4038-9328-fd9fd1c2e3a5-kube-api-access-ww2bd\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.914706 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.914680    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-oauth-serving-cert\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.914800 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.914761    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-trusted-ca-bundle\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.915212 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.915151    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-console-config\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.915212 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.915208    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cead3696-e447-4038-9328-fd9fd1c2e3a5-service-ca\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.916808 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.916727    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cead3696-e447-4038-9328-fd9fd1c2e3a5-console-serving-cert\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.917265 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.917227    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cead3696-e447-4038-9328-fd9fd1c2e3a5-console-oauth-config\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:31.926514 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:31.926494    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww2bd\" (UniqueName: \"kubernetes.io/projected/cead3696-e447-4038-9328-fd9fd1c2e3a5-kube-api-access-ww2bd\") pod \"console-665945f5b5-k2tck\" (UID: \"cead3696-e447-4038-9328-fd9fd1c2e3a5\") " pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:32.051197 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:32.051155    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:38.102794 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.102462    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:38.107248 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:38.107205    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="94852498-8809-4e48-a052-769dfc2adf53" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:38.117034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.117011    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:28:38.120419 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:38.120377    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="94852498-8809-4e48-a052-769dfc2adf53" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:38.122583 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:38.122552    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ld9rp\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:28:38.130957 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.130932    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-665945f5b5-k2tck"]
Jul 06 21:28:38.133360 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:28:38.133329    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcead3696_e447_4038_9328_fd9fd1c2e3a5.slice/crio-f21738f6b30c0f25f1550a3479b8f89cb41897cabf721bac31c20b2f4177c5ee WatchSource:0}: Error finding container f21738f6b30c0f25f1550a3479b8f89cb41897cabf721bac31c20b2f4177c5ee: Status 404 returned error can't find the container with id f21738f6b30c0f25f1550a3479b8f89cb41897cabf721bac31c20b2f4177c5ee
Jul 06 21:28:38.177598 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.177574    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpmvd\" (UniqueName: \"kubernetes.io/projected/d5885c5e-7578-484e-81f8-58b3620cd3bd-kube-api-access-wpmvd\") pod \"d5885c5e-7578-484e-81f8-58b3620cd3bd\" (UID: \"d5885c5e-7578-484e-81f8-58b3620cd3bd\") "
Jul 06 21:28:38.177779 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.177609    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94852498-8809-4e48-a052-769dfc2adf53-extensions-socket-volume\") pod \"94852498-8809-4e48-a052-769dfc2adf53\" (UID: \"94852498-8809-4e48-a052-769dfc2adf53\") "
Jul 06 21:28:38.177779 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.177635    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbb98\" (UniqueName: \"kubernetes.io/projected/94852498-8809-4e48-a052-769dfc2adf53-kube-api-access-jbb98\") pod \"94852498-8809-4e48-a052-769dfc2adf53\" (UID: \"94852498-8809-4e48-a052-769dfc2adf53\") "
Jul 06 21:28:38.177779 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.177721    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665945f5b5-k2tck" event={"ID":"cead3696-e447-4038-9328-fd9fd1c2e3a5","Type":"ContainerStarted","Data":"f21738f6b30c0f25f1550a3479b8f89cb41897cabf721bac31c20b2f4177c5ee"}
Jul 06 21:28:38.178227 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.178181    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94852498-8809-4e48-a052-769dfc2adf53-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "94852498-8809-4e48-a052-769dfc2adf53" (UID: "94852498-8809-4e48-a052-769dfc2adf53"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:28:38.179607 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.178946    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/94852498-8809-4e48-a052-769dfc2adf53-extensions-socket-volume\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:28:38.181233 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.181204    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p" event={"ID":"2e9e4276-e1e3-4e7a-9bbe-54893475c73f","Type":"ContainerStarted","Data":"e4bee63e772bf73aa69554a1e37f3c033718e2f99ff6c6f5aae2138760621ca6"}
Jul 06 21:28:38.181342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.181293    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5885c5e-7578-484e-81f8-58b3620cd3bd-kube-api-access-wpmvd" (OuterVolumeSpecName: "kube-api-access-wpmvd") pod "d5885c5e-7578-484e-81f8-58b3620cd3bd" (UID: "d5885c5e-7578-484e-81f8-58b3620cd3bd"). InnerVolumeSpecName "kube-api-access-wpmvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:28:38.181405 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.181376    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94852498-8809-4e48-a052-769dfc2adf53-kube-api-access-jbb98" (OuterVolumeSpecName: "kube-api-access-jbb98") pod "94852498-8809-4e48-a052-769dfc2adf53" (UID: "94852498-8809-4e48-a052-769dfc2adf53"). InnerVolumeSpecName "kube-api-access-jbb98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:28:38.182880 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.182856    2564 generic.go:356] "Generic (PLEG): container finished" podID="94852498-8809-4e48-a052-769dfc2adf53" containerID="0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec" exitCode=0
Jul 06 21:28:38.183005 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.182939    2564 scope.go:117] "RemoveContainer" containerID="0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec"
Jul 06 21:28:38.183005 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.182979    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:38.184197 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:38.183670    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="94852498-8809-4e48-a052-769dfc2adf53" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:38.185226 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.185197    2564 generic.go:356] "Generic (PLEG): container finished" podID="d5885c5e-7578-484e-81f8-58b3620cd3bd" containerID="9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c" exitCode=0
Jul 06 21:28:38.185326 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.185293    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:28:38.187885 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:38.187849    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ld9rp\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:28:38.201685 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.201661    2564 scope.go:117] "RemoveContainer" containerID="0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec"
Jul 06 21:28:38.202029 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:38.202009    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec\": container with ID starting with 0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec not found: ID does not exist" containerID="0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec"
Jul 06 21:28:38.202113 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.202037    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec"} err="failed to get container status \"0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec\": rpc error: code = NotFound desc = could not find container \"0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec\": container with ID starting with 0d49e61c7a01f1f8a09407d812b8d61bb849ce6fb987132c42dcd2e6e68994ec not found: ID does not exist"
Jul 06 21:28:38.202113 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.202053    2564 scope.go:117] "RemoveContainer" containerID="9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c"
Jul 06 21:28:38.205666 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:38.205640    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="94852498-8809-4e48-a052-769dfc2adf53" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:38.207503 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.207441    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-bqz4p" podStartSLOduration=1.5348605929999999 podStartE2EDuration="25.207427925s" totalImagesPullingTime="23.672567332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:28:38.203524106 +0000 UTC m=+426.676721727" watchObservedRunningTime="2026-07-06 21:28:38.207427925 +0000 UTC m=+426.680625539"
Jul 06 21:28:38.207793 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:38.207767    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ld9rp\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:28:38.209740 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.209724    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"]
Jul 06 21:28:38.213284 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.213266    2564 scope.go:117] "RemoveContainer" containerID="9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c"
Jul 06 21:28:38.213585 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:38.213561    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c\": container with ID starting with 9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c not found: ID does not exist" containerID="9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c"
Jul 06 21:28:38.213661 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.213591    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c"} err="failed to get container status \"9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c\": rpc error: code = NotFound desc = could not find container \"9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c\": container with ID starting with 9960d16a54c435a71e33074cca294b403f6d815958c6cf9e8cb6ea052e81851c not found: ID does not exist"
Jul 06 21:28:38.214535 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:28:38.214512    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcafb6e63_c628_42f2_ad5f_42918eaf01ee.slice/crio-0bf8df97a63bfa1df01adb3103165d7c8b41be468ee019cacb782cd3057fa584 WatchSource:0}: Error finding container 0bf8df97a63bfa1df01adb3103165d7c8b41be468ee019cacb782cd3057fa584: Status 404 returned error can't find the container with id 0bf8df97a63bfa1df01adb3103165d7c8b41be468ee019cacb782cd3057fa584
Jul 06 21:28:38.280452 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.280397    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpmvd\" (UniqueName: \"kubernetes.io/projected/d5885c5e-7578-484e-81f8-58b3620cd3bd-kube-api-access-wpmvd\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:28:38.280452 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.280429    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbb98\" (UniqueName: \"kubernetes.io/projected/94852498-8809-4e48-a052-769dfc2adf53-kube-api-access-jbb98\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:28:38.378292 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.378241    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z"]
Jul 06 21:28:38.380739 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:28:38.380707    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd00d4ec6_c72f_45d6_ac52_24c6def349a5.slice/crio-1a69ea453912a180e2612aba77339539fab1b954ff0d8e98a929dc22eb443ad2 WatchSource:0}: Error finding container 1a69ea453912a180e2612aba77339539fab1b954ff0d8e98a929dc22eb443ad2: Status 404 returned error can't find the container with id 1a69ea453912a180e2612aba77339539fab1b954ff0d8e98a929dc22eb443ad2
Jul 06 21:28:38.383574 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:38.383504    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"]
Jul 06 21:28:38.385492 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:28:38.385471    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe9de0d_4d53_43d4_8df3_e03e43977235.slice/crio-91e027859eba0b316daff476f7bca379998709f21e851d871d3cc9249f285960 WatchSource:0}: Error finding container 91e027859eba0b316daff476f7bca379998709f21e851d871d3cc9249f285960: Status 404 returned error can't find the container with id 91e027859eba0b316daff476f7bca379998709f21e851d871d3cc9249f285960
Jul 06 21:28:39.193167 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.193083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt" event={"ID":"cafb6e63-c628-42f2-ad5f-42918eaf01ee","Type":"ContainerStarted","Data":"5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5"}
Jul 06 21:28:39.193167 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.193130    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt" event={"ID":"cafb6e63-c628-42f2-ad5f-42918eaf01ee","Type":"ContainerStarted","Data":"0bf8df97a63bfa1df01adb3103165d7c8b41be468ee019cacb782cd3057fa584"}
Jul 06 21:28:39.193603 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.193182    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:39.194752 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.194725    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z" event={"ID":"d00d4ec6-c72f-45d6-ac52-24c6def349a5","Type":"ContainerStarted","Data":"080b8459bc7655e1325be6a48c4e55f95cfe151ca0031793692ef8d70ee7fec3"}
Jul 06 21:28:39.194871 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.194778    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z" event={"ID":"d00d4ec6-c72f-45d6-ac52-24c6def349a5","Type":"ContainerStarted","Data":"1a69ea453912a180e2612aba77339539fab1b954ff0d8e98a929dc22eb443ad2"}
Jul 06 21:28:39.194871 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.194810    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z"
Jul 06 21:28:39.197043 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.197022    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd" event={"ID":"ffe9de0d-4d53-43d4-8df3-e03e43977235","Type":"ContainerStarted","Data":"cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db"}
Jul 06 21:28:39.197161 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.197055    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd" event={"ID":"ffe9de0d-4d53-43d4-8df3-e03e43977235","Type":"ContainerStarted","Data":"91e027859eba0b316daff476f7bca379998709f21e851d871d3cc9249f285960"}
Jul 06 21:28:39.197161 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.197076    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:28:39.198606 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.198590    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-665945f5b5-k2tck" event={"ID":"cead3696-e447-4038-9328-fd9fd1c2e3a5","Type":"ContainerStarted","Data":"a3230c125b7ada3ca3efe5700147d069e5d66b1fabbfd838499b4ef655d2b826"}
Jul 06 21:28:39.216817 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:39.216783    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="94852498-8809-4e48-a052-769dfc2adf53" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:39.217307 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.217269    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt" podStartSLOduration=14.21725782 podStartE2EDuration="14.21725782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:28:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:28:39.214757986 +0000 UTC m=+427.687955605" watchObservedRunningTime="2026-07-06 21:28:39.21725782 +0000 UTC m=+427.690455439"
Jul 06 21:28:39.218719 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:39.218697    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ld9rp\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:28:39.238740 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.238693    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd" podStartSLOduration=13.238679927 podStartE2EDuration="13.238679927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:28:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:28:39.236969391 +0000 UTC m=+427.710167010" watchObservedRunningTime="2026-07-06 21:28:39.238679927 +0000 UTC m=+427.711877524"
Jul 06 21:28:39.254662 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.254616    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z" podStartSLOduration=14.254604536 podStartE2EDuration="14.254604536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:28:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:28:39.254089282 +0000 UTC m=+427.727286901" watchObservedRunningTime="2026-07-06 21:28:39.254604536 +0000 UTC m=+427.727802156"
Jul 06 21:28:39.273639 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:39.273596    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zk2dz\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="94852498-8809-4e48-a052-769dfc2adf53" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zk2dz"
Jul 06 21:28:39.273834 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:39.273796    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-665945f5b5-k2tck" podStartSLOduration=8.273783004 podStartE2EDuration="8.273783004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:28:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:28:39.271302839 +0000 UTC m=+427.744500460" watchObservedRunningTime="2026-07-06 21:28:39.273783004 +0000 UTC m=+427.746980624"
Jul 06 21:28:39.275373 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:39.275350    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ld9rp\" is forbidden: User \"system:node:ip-10-0-128-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-90.ec2.internal' and this object" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ld9rp"
Jul 06 21:28:40.065731 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:40.065693    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94852498-8809-4e48-a052-769dfc2adf53" path="/var/lib/kubelet/pods/94852498-8809-4e48-a052-769dfc2adf53/volumes"
Jul 06 21:28:40.066048 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:40.066033    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5885c5e-7578-484e-81f8-58b3620cd3bd" path="/var/lib/kubelet/pods/d5885c5e-7578-484e-81f8-58b3620cd3bd/volumes"
Jul 06 21:28:42.051751 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:42.051716    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:42.052227 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:42.051783    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:42.063496 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:42.063473    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:42.217844 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:42.217820    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-665945f5b5-k2tck"
Jul 06 21:28:42.269979 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:42.269950    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c56f5778d-7tk7x"]
Jul 06 21:28:50.205734 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.205705    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j6r9z"
Jul 06 21:28:50.206279 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.205767    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:28:50.206279 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.205796    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:50.266701 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.266669    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"]
Jul 06 21:28:50.266922 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.266874    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt" podUID="cafb6e63-c628-42f2-ad5f-42918eaf01ee" containerName="manager" containerID="cri-o://5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5" gracePeriod=10
Jul 06 21:28:50.527459 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.527432    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:50.588711 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.588688    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cafb6e63-c628-42f2-ad5f-42918eaf01ee-extensions-socket-volume\") pod \"cafb6e63-c628-42f2-ad5f-42918eaf01ee\" (UID: \"cafb6e63-c628-42f2-ad5f-42918eaf01ee\") "
Jul 06 21:28:50.588878 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.588809    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dtpv\" (UniqueName: \"kubernetes.io/projected/cafb6e63-c628-42f2-ad5f-42918eaf01ee-kube-api-access-8dtpv\") pod \"cafb6e63-c628-42f2-ad5f-42918eaf01ee\" (UID: \"cafb6e63-c628-42f2-ad5f-42918eaf01ee\") "
Jul 06 21:28:50.589072 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.589052    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cafb6e63-c628-42f2-ad5f-42918eaf01ee-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cafb6e63-c628-42f2-ad5f-42918eaf01ee" (UID: "cafb6e63-c628-42f2-ad5f-42918eaf01ee"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:28:50.590980 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.590962    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cafb6e63-c628-42f2-ad5f-42918eaf01ee-kube-api-access-8dtpv" (OuterVolumeSpecName: "kube-api-access-8dtpv") pod "cafb6e63-c628-42f2-ad5f-42918eaf01ee" (UID: "cafb6e63-c628-42f2-ad5f-42918eaf01ee"). InnerVolumeSpecName "kube-api-access-8dtpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:28:50.690455 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.690425    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dtpv\" (UniqueName: \"kubernetes.io/projected/cafb6e63-c628-42f2-ad5f-42918eaf01ee-kube-api-access-8dtpv\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:28:50.690455 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:50.690451    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cafb6e63-c628-42f2-ad5f-42918eaf01ee-extensions-socket-volume\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:28:51.260925 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:51.260867    2564 generic.go:356] "Generic (PLEG): container finished" podID="cafb6e63-c628-42f2-ad5f-42918eaf01ee" containerID="5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5" exitCode=0
Jul 06 21:28:51.261361 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:51.260926    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt" event={"ID":"cafb6e63-c628-42f2-ad5f-42918eaf01ee","Type":"ContainerDied","Data":"5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5"}
Jul 06 21:28:51.261361 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:51.260982    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt" event={"ID":"cafb6e63-c628-42f2-ad5f-42918eaf01ee","Type":"ContainerDied","Data":"0bf8df97a63bfa1df01adb3103165d7c8b41be468ee019cacb782cd3057fa584"}
Jul 06 21:28:51.261361 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:51.261005    2564 scope.go:117] "RemoveContainer" containerID="5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5"
Jul 06 21:28:51.261361 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:51.260936    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"
Jul 06 21:28:51.270339 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:51.270174    2564 scope.go:117] "RemoveContainer" containerID="5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5"
Jul 06 21:28:51.270438 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:28:51.270422    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5\": container with ID starting with 5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5 not found: ID does not exist" containerID="5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5"
Jul 06 21:28:51.270477 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:51.270444    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5"} err="failed to get container status \"5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5\": rpc error: code = NotFound desc = could not find container \"5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5\": container with ID starting with 5185010edcd2e810c46a5b7d424c978cb8174b1f43638e1c6e9b7caa979bf3d5 not found: ID does not exist"
Jul 06 21:28:51.295631 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:51.295597    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"]
Jul 06 21:28:51.305314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:51.305288    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kw7gt"]
Jul 06 21:28:52.063000 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:28:52.062969    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cafb6e63-c628-42f2-ad5f-42918eaf01ee" path="/var/lib/kubelet/pods/cafb6e63-c628-42f2-ad5f-42918eaf01ee/volumes"
Jul 06 21:29:06.717448 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.717415    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"]
Jul 06 21:29:06.717954 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.717798    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cafb6e63-c628-42f2-ad5f-42918eaf01ee" containerName="manager"
Jul 06 21:29:06.717954 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.717810    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cafb6e63-c628-42f2-ad5f-42918eaf01ee" containerName="manager"
Jul 06 21:29:06.717954 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.717922    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cafb6e63-c628-42f2-ad5f-42918eaf01ee" containerName="manager"
Jul 06 21:29:06.721386 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.721366    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.724202 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.724184    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 21:29:06.724305 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.724184    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tjr58\""
Jul 06 21:29:06.736508 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.736486    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"]
Jul 06 21:29:06.836967 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.836933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecdddab9-5299-48fc-bf59-668e81e04b5b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.837151 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.837009    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.837151 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.837041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.837151 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.837083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.837151 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.837112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.837325 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.837174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.837325 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.837252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.837325 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.837278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cstrr\" (UniqueName: \"kubernetes.io/projected/ecdddab9-5299-48fc-bf59-668e81e04b5b-kube-api-access-cstrr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.837325 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.837296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938524 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938524 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938524 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938524 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938524 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cstrr\" (UniqueName: \"kubernetes.io/projected/ecdddab9-5299-48fc-bf59-668e81e04b5b-kube-api-access-cstrr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938524 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938512    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938823 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938771    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938877 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecdddab9-5299-48fc-bf59-668e81e04b5b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938949 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938890    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.938949 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.938934    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.939160 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.939137    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.939475 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.939454    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecdddab9-5299-48fc-bf59-668e81e04b5b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.940992 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.940969    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.941095 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.941080    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.947528 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.947502    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecdddab9-5299-48fc-bf59-668e81e04b5b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:06.947747 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:06.947726    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cstrr\" (UniqueName: \"kubernetes.io/projected/ecdddab9-5299-48fc-bf59-668e81e04b5b-kube-api-access-cstrr\") pod \"maas-default-gateway-openshift-default-5896d4dd49-6kl52\" (UID: \"ecdddab9-5299-48fc-bf59-668e81e04b5b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:07.032170 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.032142    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:07.181239 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.181200    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"]
Jul 06 21:29:07.191191 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:29:07.191162    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdddab9_5299_48fc_bf59_668e81e04b5b.slice/crio-e1ff39bba2246d48892f511e8ffd09708981a2f2b7d3499394d4ba86dd63aa67 WatchSource:0}: Error finding container e1ff39bba2246d48892f511e8ffd09708981a2f2b7d3499394d4ba86dd63aa67: Status 404 returned error can't find the container with id e1ff39bba2246d48892f511e8ffd09708981a2f2b7d3499394d4ba86dd63aa67
Jul 06 21:29:07.297599 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.297489    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c56f5778d-7tk7x" podUID="95cb4418-ddd1-4d0c-a83f-faa1a062a39a" containerName="console" containerID="cri-o://b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912" gracePeriod=15
Jul 06 21:29:07.346916 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.346869    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52" event={"ID":"ecdddab9-5299-48fc-bf59-668e81e04b5b","Type":"ContainerStarted","Data":"e1ff39bba2246d48892f511e8ffd09708981a2f2b7d3499394d4ba86dd63aa67"}
Jul 06 21:29:07.586252 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.586171    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:29:07.746337 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.746311    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-service-ca\") pod \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") "
Jul 06 21:29:07.746337 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.746343    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-serving-cert\") pod \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") "
Jul 06 21:29:07.746809 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.746376    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-oauth-config\") pod \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") "
Jul 06 21:29:07.746809 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.746417    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-oauth-serving-cert\") pod \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") "
Jul 06 21:29:07.746809 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.746479    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-trusted-ca-bundle\") pod \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") "
Jul 06 21:29:07.746809 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.746501    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-config\") pod \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") "
Jul 06 21:29:07.746809 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.746528    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnfmm\" (UniqueName: \"kubernetes.io/projected/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-kube-api-access-bnfmm\") pod \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\" (UID: \"95cb4418-ddd1-4d0c-a83f-faa1a062a39a\") "
Jul 06 21:29:07.746809 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.746793    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-service-ca" (OuterVolumeSpecName: "service-ca") pod "95cb4418-ddd1-4d0c-a83f-faa1a062a39a" (UID: "95cb4418-ddd1-4d0c-a83f-faa1a062a39a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:29:07.747157 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.747096    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "95cb4418-ddd1-4d0c-a83f-faa1a062a39a" (UID: "95cb4418-ddd1-4d0c-a83f-faa1a062a39a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:29:07.747218 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.747169    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-config" (OuterVolumeSpecName: "console-config") pod "95cb4418-ddd1-4d0c-a83f-faa1a062a39a" (UID: "95cb4418-ddd1-4d0c-a83f-faa1a062a39a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:29:07.747332 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.747306    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "95cb4418-ddd1-4d0c-a83f-faa1a062a39a" (UID: "95cb4418-ddd1-4d0c-a83f-faa1a062a39a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:29:07.748636 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.748614    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "95cb4418-ddd1-4d0c-a83f-faa1a062a39a" (UID: "95cb4418-ddd1-4d0c-a83f-faa1a062a39a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:29:07.748770 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.748750    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "95cb4418-ddd1-4d0c-a83f-faa1a062a39a" (UID: "95cb4418-ddd1-4d0c-a83f-faa1a062a39a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:29:07.748845 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.748823    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-kube-api-access-bnfmm" (OuterVolumeSpecName: "kube-api-access-bnfmm") pod "95cb4418-ddd1-4d0c-a83f-faa1a062a39a" (UID: "95cb4418-ddd1-4d0c-a83f-faa1a062a39a"). InnerVolumeSpecName "kube-api-access-bnfmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:29:07.847307 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.847222    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-oauth-serving-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:29:07.847307 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.847251    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-trusted-ca-bundle\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:29:07.847307 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.847267    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-config\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:29:07.847307 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.847279    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnfmm\" (UniqueName: \"kubernetes.io/projected/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-kube-api-access-bnfmm\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:29:07.847307 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.847295    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-service-ca\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:29:07.847307 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.847308    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-serving-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:29:07.847604 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:07.847321    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95cb4418-ddd1-4d0c-a83f-faa1a062a39a-console-oauth-config\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:29:08.355566 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:08.355533    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c56f5778d-7tk7x"
Jul 06 21:29:08.355566 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:08.355562    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c56f5778d-7tk7x" event={"ID":"95cb4418-ddd1-4d0c-a83f-faa1a062a39a","Type":"ContainerDied","Data":"b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912"}
Jul 06 21:29:08.355812 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:08.355617    2564 scope.go:117] "RemoveContainer" containerID="b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912"
Jul 06 21:29:08.355812 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:08.355532    2564 generic.go:356] "Generic (PLEG): container finished" podID="95cb4418-ddd1-4d0c-a83f-faa1a062a39a" containerID="b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912" exitCode=0
Jul 06 21:29:08.355812 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:08.355727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c56f5778d-7tk7x" event={"ID":"95cb4418-ddd1-4d0c-a83f-faa1a062a39a","Type":"ContainerDied","Data":"958fbe676672e6b04b8f3a3f4ba30e6c6d46aa2a3d8266f02f1eb1d6fc03251a"}
Jul 06 21:29:08.366478 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:08.366461    2564 scope.go:117] "RemoveContainer" containerID="b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912"
Jul 06 21:29:08.366759 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:29:08.366736    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912\": container with ID starting with b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912 not found: ID does not exist" containerID="b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912"
Jul 06 21:29:08.366838 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:08.366770    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912"} err="failed to get container status \"b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912\": rpc error: code = NotFound desc = could not find container \"b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912\": container with ID starting with b8ed6e8a2d153985d4adb496fde819e47d70c4aef75e7067973e80ceeed45912 not found: ID does not exist"
Jul 06 21:29:08.375638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:08.375613    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c56f5778d-7tk7x"]
Jul 06 21:29:08.379993 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:08.379971    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c56f5778d-7tk7x"]
Jul 06 21:29:10.062533 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:10.062504    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95cb4418-ddd1-4d0c-a83f-faa1a062a39a" path="/var/lib/kubelet/pods/95cb4418-ddd1-4d0c-a83f-faa1a062a39a/volumes"
Jul 06 21:29:10.075639 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:10.075608    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:29:10.075740 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:10.075675    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:29:10.075740 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:10.075702    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:29:10.369253 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:10.369168    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52" event={"ID":"ecdddab9-5299-48fc-bf59-668e81e04b5b","Type":"ContainerStarted","Data":"787c2b1f3c1e17ebec711cc3d86b7906bbef39d4742d9cf18e85041451ec37be"}
Jul 06 21:29:10.393998 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:10.393949    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52" podStartSLOduration=1.511740993 podStartE2EDuration="4.393929396s" totalImagesPullingTime="2.882188403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:29:10.391612401 +0000 UTC m=+458.864810043" watchObservedRunningTime="2026-07-06 21:29:10.393929396 +0000 UTC m=+458.867127015"
Jul 06 21:29:11.032664 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.032625    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:11.040830 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.040804    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:11.374575 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.374485    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:11.375361 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.375343    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:29:11.975226 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.975193    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:29:11.975619 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.975604    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95cb4418-ddd1-4d0c-a83f-faa1a062a39a" containerName="console"
Jul 06 21:29:11.975733 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.975622    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="95cb4418-ddd1-4d0c-a83f-faa1a062a39a" containerName="console"
Jul 06 21:29:11.975733 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.975717    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="95cb4418-ddd1-4d0c-a83f-faa1a062a39a" containerName="console"
Jul 06 21:29:11.979049 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.979029    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w"
Jul 06 21:29:11.981923 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.981906    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 21:29:11.987780 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.987726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/64d6340e-81e1-48b8-a8e0-859b8abe06dc-config-file\") pod \"limitador-limitador-54d6d988d5-wf78w\" (UID: \"64d6340e-81e1-48b8-a8e0-859b8abe06dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w"
Jul 06 21:29:11.987871 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.987789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnv7c\" (UniqueName: \"kubernetes.io/projected/64d6340e-81e1-48b8-a8e0-859b8abe06dc-kube-api-access-gnv7c\") pod \"limitador-limitador-54d6d988d5-wf78w\" (UID: \"64d6340e-81e1-48b8-a8e0-859b8abe06dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w"
Jul 06 21:29:11.991471 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:11.991447    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:29:12.035093 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:12.035063    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:29:12.088524 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:12.088487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/64d6340e-81e1-48b8-a8e0-859b8abe06dc-config-file\") pod \"limitador-limitador-54d6d988d5-wf78w\" (UID: \"64d6340e-81e1-48b8-a8e0-859b8abe06dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w"
Jul 06 21:29:12.088690 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:12.088548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnv7c\" (UniqueName: \"kubernetes.io/projected/64d6340e-81e1-48b8-a8e0-859b8abe06dc-kube-api-access-gnv7c\") pod \"limitador-limitador-54d6d988d5-wf78w\" (UID: \"64d6340e-81e1-48b8-a8e0-859b8abe06dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w"
Jul 06 21:29:12.089149 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:12.089129    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/64d6340e-81e1-48b8-a8e0-859b8abe06dc-config-file\") pod \"limitador-limitador-54d6d988d5-wf78w\" (UID: \"64d6340e-81e1-48b8-a8e0-859b8abe06dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w"
Jul 06 21:29:12.098058 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:12.098033    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnv7c\" (UniqueName: \"kubernetes.io/projected/64d6340e-81e1-48b8-a8e0-859b8abe06dc-kube-api-access-gnv7c\") pod \"limitador-limitador-54d6d988d5-wf78w\" (UID: \"64d6340e-81e1-48b8-a8e0-859b8abe06dc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w"
Jul 06 21:29:12.289747 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:12.289647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w"
Jul 06 21:29:12.432477 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:12.432454    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:29:12.435033 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:29:12.435004    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d6340e_81e1_48b8_a8e0_859b8abe06dc.slice/crio-7445f9d4355b5ee1d336c2ae93091eb07a164a4bebca939654d1ca6fd4ab175c WatchSource:0}: Error finding container 7445f9d4355b5ee1d336c2ae93091eb07a164a4bebca939654d1ca6fd4ab175c: Status 404 returned error can't find the container with id 7445f9d4355b5ee1d336c2ae93091eb07a164a4bebca939654d1ca6fd4ab175c
Jul 06 21:29:13.388576 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:13.388532    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w" event={"ID":"64d6340e-81e1-48b8-a8e0-859b8abe06dc","Type":"ContainerStarted","Data":"7445f9d4355b5ee1d336c2ae93091eb07a164a4bebca939654d1ca6fd4ab175c"}
Jul 06 21:29:15.403645 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:15.403552    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w" event={"ID":"64d6340e-81e1-48b8-a8e0-859b8abe06dc","Type":"ContainerStarted","Data":"74b90061ff6099e08024a528914218a0d05c5c10ad47fd258b9d34876d383eaa"}
Jul 06 21:29:15.403645 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:15.403605    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w"
Jul 06 21:29:15.423834 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:15.423787    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w" podStartSLOduration=1.8564206859999999 podStartE2EDuration="4.423772797s" totalImagesPullingTime="2.567352111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:29:15.422131688 +0000 UTC m=+463.895329311" watchObservedRunningTime="2026-07-06 21:29:15.423772797 +0000 UTC m=+463.896970474"
Jul 06 21:29:26.410201 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:29:26.410172    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wf78w"
Jul 06 21:30:36.177993 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.177914    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-lgd4r"]
Jul 06 21:30:36.181335 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.181315    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r"
Jul 06 21:30:36.184784 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.184766    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sgnnv\""
Jul 06 21:30:36.185347 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.185329    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 21:30:36.209254 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.209226    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-lgd4r"]
Jul 06 21:30:36.305831 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.305801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkvhm\" (UniqueName: \"kubernetes.io/projected/d440a3c8-d5c7-4f74-a6f4-c4245ac40844-kube-api-access-mkvhm\") pod \"payload-pre-processing-7964457696-lgd4r\" (UID: \"d440a3c8-d5c7-4f74-a6f4-c4245ac40844\") " pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r"
Jul 06 21:30:36.306038 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.305844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d440a3c8-d5c7-4f74-a6f4-c4245ac40844-plugins-config-volume\") pod \"payload-pre-processing-7964457696-lgd4r\" (UID: \"d440a3c8-d5c7-4f74-a6f4-c4245ac40844\") " pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r"
Jul 06 21:30:36.371643 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.371609    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:30:36.407138 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.407103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d440a3c8-d5c7-4f74-a6f4-c4245ac40844-plugins-config-volume\") pod \"payload-pre-processing-7964457696-lgd4r\" (UID: \"d440a3c8-d5c7-4f74-a6f4-c4245ac40844\") " pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r"
Jul 06 21:30:36.407313 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.407267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkvhm\" (UniqueName: \"kubernetes.io/projected/d440a3c8-d5c7-4f74-a6f4-c4245ac40844-kube-api-access-mkvhm\") pod \"payload-pre-processing-7964457696-lgd4r\" (UID: \"d440a3c8-d5c7-4f74-a6f4-c4245ac40844\") " pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r"
Jul 06 21:30:36.407802 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.407781    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d440a3c8-d5c7-4f74-a6f4-c4245ac40844-plugins-config-volume\") pod \"payload-pre-processing-7964457696-lgd4r\" (UID: \"d440a3c8-d5c7-4f74-a6f4-c4245ac40844\") " pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r"
Jul 06 21:30:36.416195 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.416162    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkvhm\" (UniqueName: \"kubernetes.io/projected/d440a3c8-d5c7-4f74-a6f4-c4245ac40844-kube-api-access-mkvhm\") pod \"payload-pre-processing-7964457696-lgd4r\" (UID: \"d440a3c8-d5c7-4f74-a6f4-c4245ac40844\") " pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r"
Jul 06 21:30:36.491907 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.491866    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r"
Jul 06 21:30:36.631749 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.631728    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-lgd4r"]
Jul 06 21:30:36.634083 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:30:36.634056    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd440a3c8_d5c7_4f74_a6f4_c4245ac40844.slice/crio-8a6136fe14e02118ba6d2f25fcce228a74419d4412a7016292a7de888847ac44 WatchSource:0}: Error finding container 8a6136fe14e02118ba6d2f25fcce228a74419d4412a7016292a7de888847ac44: Status 404 returned error can't find the container with id 8a6136fe14e02118ba6d2f25fcce228a74419d4412a7016292a7de888847ac44
Jul 06 21:30:36.810598 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:36.810511    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r" event={"ID":"d440a3c8-d5c7-4f74-a6f4-c4245ac40844","Type":"ContainerStarted","Data":"8a6136fe14e02118ba6d2f25fcce228a74419d4412a7016292a7de888847ac44"}
Jul 06 21:30:38.823376 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:38.823338    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r" event={"ID":"d440a3c8-d5c7-4f74-a6f4-c4245ac40844","Type":"ContainerStarted","Data":"1d2542170f788674fcd15f554e45a9ddc51edd38145e649fbe7308eacdf73aee"}
Jul 06 21:30:38.823826 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:38.823462    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r"
Jul 06 21:30:38.846818 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:38.846752    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r" podStartSLOduration=1.384972684 podStartE2EDuration="2.846730336s" totalImagesPullingTime="1.461757652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:30:38.843335865 +0000 UTC m=+547.316533486" watchObservedRunningTime="2026-07-06 21:30:38.846730336 +0000 UTC m=+547.319927957"
Jul 06 21:30:42.416111 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:42.416070    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6kl52 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 06 21:30:42.416597 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:42.416144    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52" podUID="ecdddab9-5299-48fc-bf59-668e81e04b5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 06 21:30:43.859096 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:43.859060    2564 generic.go:356] "Generic (PLEG): container finished" podID="ecdddab9-5299-48fc-bf59-668e81e04b5b" containerID="787c2b1f3c1e17ebec711cc3d86b7906bbef39d4742d9cf18e85041451ec37be" exitCode=0
Jul 06 21:30:43.859659 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:43.859123    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52" event={"ID":"ecdddab9-5299-48fc-bf59-668e81e04b5b","Type":"ContainerDied","Data":"787c2b1f3c1e17ebec711cc3d86b7906bbef39d4742d9cf18e85041451ec37be"}
Jul 06 21:30:43.859659 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:43.859635    2564 scope.go:117] "RemoveContainer" containerID="787c2b1f3c1e17ebec711cc3d86b7906bbef39d4742d9cf18e85041451ec37be"
Jul 06 21:30:43.860751 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:43.860721    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:30:43.860858 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:43.860800    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:30:43.860858 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:43.860846    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:30:44.869494 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:44.869462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52" event={"ID":"ecdddab9-5299-48fc-bf59-668e81e04b5b","Type":"ContainerStarted","Data":"27f04d4ec985585ce66275bf6101438f25c9f655575528537e13813073475a59"}
Jul 06 21:30:45.033166 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:45.033138    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:30:45.033386 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:45.033364    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6kl52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 21:30:45.033473 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:45.033432    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52" podUID="ecdddab9-5299-48fc-bf59-668e81e04b5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 21:30:46.032812 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:46.032777    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6kl52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 21:30:46.033221 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:46.032829    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52" podUID="ecdddab9-5299-48fc-bf59-668e81e04b5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 21:30:47.033169 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:47.033124    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6kl52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 21:30:47.033557 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:47.033196    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52" podUID="ecdddab9-5299-48fc-bf59-668e81e04b5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 21:30:48.032927 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:48.032853    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-6kl52 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 06 21:30:48.033138 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:48.032957    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52" podUID="ecdddab9-5299-48fc-bf59-668e81e04b5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 06 21:30:49.036242 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:49.036215    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:30:49.036677 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:49.036654    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:30:49.037292 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:49.037277    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-6kl52"
Jul 06 21:30:49.831464 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:30:49.831434    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-lgd4r"
Jul 06 21:31:04.608113 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:04.608081    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:31:12.895473 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:12.895432    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:31:21.604930 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:21.604879    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:31:31.949926 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:31.949884    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:31:31.950821 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:31.950802    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:31:47.121067 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.121028    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"]
Jul 06 21:31:47.125325 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.125304    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.129007 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.128985    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 06 21:31:47.129136 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.129023    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b5mbx\""
Jul 06 21:31:47.129136 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.128992    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 21:31:47.129136 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.129029    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 21:31:47.134887 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.134868    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"]
Jul 06 21:31:47.239152 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.239122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/432107b9-1e22-495f-ad70-ae0c98ddf8d1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.239651 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.239189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.239651 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.239289    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.239651 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.239317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.239651 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.239341    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtqtj\" (UniqueName: \"kubernetes.io/projected/432107b9-1e22-495f-ad70-ae0c98ddf8d1-kube-api-access-vtqtj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.239651 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.239410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.340893 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.340849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.341110 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.340940    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.341110 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.340973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtqtj\" (UniqueName: \"kubernetes.io/projected/432107b9-1e22-495f-ad70-ae0c98ddf8d1-kube-api-access-vtqtj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.341110 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.341026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.341110 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.341067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/432107b9-1e22-495f-ad70-ae0c98ddf8d1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.341332 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.341143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.341395 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.341349    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.341451 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.341396    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.341872 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.341838    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.343607 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.343581    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/432107b9-1e22-495f-ad70-ae0c98ddf8d1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.344189 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.344162    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/432107b9-1e22-495f-ad70-ae0c98ddf8d1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.349958 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.349934    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtqtj\" (UniqueName: \"kubernetes.io/projected/432107b9-1e22-495f-ad70-ae0c98ddf8d1-kube-api-access-vtqtj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56\" (UID: \"432107b9-1e22-495f-ad70-ae0c98ddf8d1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.436025 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.435944    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:47.581440 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.581273    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"]
Jul 06 21:31:47.583798 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:31:47.583770    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432107b9_1e22_495f_ad70_ae0c98ddf8d1.slice/crio-2b9c76818e56f0d46f4858104380321d9920277603bce46bbd94c76701bb3a64 WatchSource:0}: Error finding container 2b9c76818e56f0d46f4858104380321d9920277603bce46bbd94c76701bb3a64: Status 404 returned error can't find the container with id 2b9c76818e56f0d46f4858104380321d9920277603bce46bbd94c76701bb3a64
Jul 06 21:31:47.585211 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:47.585196    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 21:31:48.198451 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:48.198414    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56" event={"ID":"432107b9-1e22-495f-ad70-ae0c98ddf8d1","Type":"ContainerStarted","Data":"2b9c76818e56f0d46f4858104380321d9920277603bce46bbd94c76701bb3a64"}
Jul 06 21:31:48.912176 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:48.909348    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:31:49.205446 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:49.205350    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56" event={"ID":"432107b9-1e22-495f-ad70-ae0c98ddf8d1","Type":"ContainerStarted","Data":"9c8d34e661e62b991879b7e4ddb21a38510e1032a614ec1213298e43063e5588"}
Jul 06 21:31:49.226801 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:49.226755    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56" podStartSLOduration=1.204264098 podStartE2EDuration="2.226739465s" totalImagesPullingTime="1.022475367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:31:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:31:49.22626425 +0000 UTC m=+617.699461871" watchObservedRunningTime="2026-07-06 21:31:49.226739465 +0000 UTC m=+617.699937085"
Jul 06 21:31:54.506127 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:54.506045    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:31:57.436878 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:57.436840    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:57.437343 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:57.436931    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:57.449994 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:57.449970    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:31:58.263543 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:31:58.263519    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56"
Jul 06 21:32:00.307422 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.307389    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"]
Jul 06 21:32:00.310968 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.310947    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.313567 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.313544    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 21:32:00.321590 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.321565    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"]
Jul 06 21:32:00.358761 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.358710    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d0fc303-2115-4dcb-a076-362340393e93-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.358761 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.358762    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.359051 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.358817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.359051 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.358844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7x9w\" (UniqueName: \"kubernetes.io/projected/7d0fc303-2115-4dcb-a076-362340393e93-kube-api-access-x7x9w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.359051 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.358891    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.359051 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.358943    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.460310 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.460273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d0fc303-2115-4dcb-a076-362340393e93-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.460485 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.460327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.460485 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.460401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.460574 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.460535    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7x9w\" (UniqueName: \"kubernetes.io/projected/7d0fc303-2115-4dcb-a076-362340393e93-kube-api-access-x7x9w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.460635 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.460601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.460686 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.460637    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.460871 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.460843    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.461037 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.461001    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.461037 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.461015    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.462783 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.462759    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d0fc303-2115-4dcb-a076-362340393e93-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.463059 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.463040    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d0fc303-2115-4dcb-a076-362340393e93-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.469066 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.469043    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7x9w\" (UniqueName: \"kubernetes.io/projected/7d0fc303-2115-4dcb-a076-362340393e93-kube-api-access-x7x9w\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh\" (UID: \"7d0fc303-2115-4dcb-a076-362340393e93\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.622684 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.622598    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:00.763958 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:00.763934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"]
Jul 06 21:32:00.765581 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:32:00.765559    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d0fc303_2115_4dcb_a076_362340393e93.slice/crio-cb527b520a16e7912a28c85c8214342ce75fac31546ffc789446fd4a91971dc9 WatchSource:0}: Error finding container cb527b520a16e7912a28c85c8214342ce75fac31546ffc789446fd4a91971dc9: Status 404 returned error can't find the container with id cb527b520a16e7912a28c85c8214342ce75fac31546ffc789446fd4a91971dc9
Jul 06 21:32:01.268974 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:01.268938    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh" event={"ID":"7d0fc303-2115-4dcb-a076-362340393e93","Type":"ContainerStarted","Data":"e17c9f8660bff65359ddeba6aeb495568e7a9192b207dad3b0a87c4e537808a0"}
Jul 06 21:32:01.269151 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:01.268983    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh" event={"ID":"7d0fc303-2115-4dcb-a076-362340393e93","Type":"ContainerStarted","Data":"cb527b520a16e7912a28c85c8214342ce75fac31546ffc789446fd4a91971dc9"}
Jul 06 21:32:01.287538 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:01.287488    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh" podStartSLOduration=1.083657693 podStartE2EDuration="1.287471835s" totalImagesPullingTime="203.814142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:32:01.286508376 +0000 UTC m=+629.759706011" watchObservedRunningTime="2026-07-06 21:32:01.287471835 +0000 UTC m=+629.760669455"
Jul 06 21:32:03.308101 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:03.308071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:32:10.623194 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:10.623155    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:10.623194 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:10.623204    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:10.635707 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:10.635682    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:32:11.333471 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:32:11.333439    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh"
Jul 06 21:33:25.512232 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:33:25.512151    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:33:36.202130 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:33:36.202096    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:33:46.102774 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:33:46.102745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:33:55.714572 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:33:55.714540    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:34:06.507770 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:34:06.507735    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:34:35.003971 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:34:35.003936    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:34:46.599919 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:34:46.599871    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:35:20.493383 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:35:20.493345    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:35:27.303671 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:35:27.303634    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:35:37.296104 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:35:37.296068    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:35:44.301840 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:35:44.301798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:35:54.511320 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:35:54.511284    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:36:03.699097 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:36:03.699064    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:36:15.207450 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:36:15.207417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:36:24.791820 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:36:24.791737    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:36:31.980004 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:36:31.979970    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:36:31.982644 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:36:31.982623    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:36:47.701571 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:36:47.701534    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:36:57.496009 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:36:57.495973    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:37:20.906497 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:37:20.906467    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:37:31.995713 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:37:31.995676    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:37:47.324993 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:37:47.324959    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:37:57.361194 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:37:57.361105    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:38:07.795861 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:07.795829    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:38:17.396024 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:17.395985    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:38:26.629553 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:26.629516    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:38:53.143671 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:53.143633    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"]
Jul 06 21:38:53.144249 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:53.143830    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd" podUID="ffe9de0d-4d53-43d4-8df3-e03e43977235" containerName="manager" containerID="cri-o://cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db" gracePeriod=10
Jul 06 21:38:55.717228 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:55.717202    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:38:55.783210 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:55.783183    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76dzj\" (UniqueName: \"kubernetes.io/projected/ffe9de0d-4d53-43d4-8df3-e03e43977235-kube-api-access-76dzj\") pod \"ffe9de0d-4d53-43d4-8df3-e03e43977235\" (UID: \"ffe9de0d-4d53-43d4-8df3-e03e43977235\") "
Jul 06 21:38:55.783399 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:55.783250    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffe9de0d-4d53-43d4-8df3-e03e43977235-extensions-socket-volume\") pod \"ffe9de0d-4d53-43d4-8df3-e03e43977235\" (UID: \"ffe9de0d-4d53-43d4-8df3-e03e43977235\") "
Jul 06 21:38:55.783637 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:55.783614    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffe9de0d-4d53-43d4-8df3-e03e43977235-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ffe9de0d-4d53-43d4-8df3-e03e43977235" (UID: "ffe9de0d-4d53-43d4-8df3-e03e43977235"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:38:55.785568 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:55.785544    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffe9de0d-4d53-43d4-8df3-e03e43977235-kube-api-access-76dzj" (OuterVolumeSpecName: "kube-api-access-76dzj") pod "ffe9de0d-4d53-43d4-8df3-e03e43977235" (UID: "ffe9de0d-4d53-43d4-8df3-e03e43977235"). InnerVolumeSpecName "kube-api-access-76dzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:38:55.884256 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:55.884174    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76dzj\" (UniqueName: \"kubernetes.io/projected/ffe9de0d-4d53-43d4-8df3-e03e43977235-kube-api-access-76dzj\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:38:55.884256 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:55.884200    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ffe9de0d-4d53-43d4-8df3-e03e43977235-extensions-socket-volume\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:38:56.399793 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:56.399758    2564 generic.go:356] "Generic (PLEG): container finished" podID="ffe9de0d-4d53-43d4-8df3-e03e43977235" containerID="cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db" exitCode=0
Jul 06 21:38:56.399995 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:56.399817    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"
Jul 06 21:38:56.399995 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:56.399846    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd" event={"ID":"ffe9de0d-4d53-43d4-8df3-e03e43977235","Type":"ContainerDied","Data":"cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db"}
Jul 06 21:38:56.399995 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:56.399952    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd" event={"ID":"ffe9de0d-4d53-43d4-8df3-e03e43977235","Type":"ContainerDied","Data":"91e027859eba0b316daff476f7bca379998709f21e851d871d3cc9249f285960"}
Jul 06 21:38:56.399995 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:56.399981    2564 scope.go:117] "RemoveContainer" containerID="cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db"
Jul 06 21:38:56.411307 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:56.411236    2564 scope.go:117] "RemoveContainer" containerID="cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db"
Jul 06 21:38:56.411763 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:38:56.411732    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db\": container with ID starting with cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db not found: ID does not exist" containerID="cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db"
Jul 06 21:38:56.411869 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:56.411769    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db"} err="failed to get container status \"cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db\": rpc error: code = NotFound desc = could not find container \"cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db\": container with ID starting with cad2341f5bf37c05d62f8b0e9cd4330bc6627614f8d9124d99f8f09e35d379db not found: ID does not exist"
Jul 06 21:38:56.422410 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:56.422377    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"]
Jul 06 21:38:56.426743 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:56.426721    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ww7pd"]
Jul 06 21:38:58.063213 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:38:58.063180    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffe9de0d-4d53-43d4-8df3-e03e43977235" path="/var/lib/kubelet/pods/ffe9de0d-4d53-43d4-8df3-e03e43977235/volumes"
Jul 06 21:39:54.299333 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.299299    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"]
Jul 06 21:39:54.299792 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.299703    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffe9de0d-4d53-43d4-8df3-e03e43977235" containerName="manager"
Jul 06 21:39:54.299792 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.299714    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffe9de0d-4d53-43d4-8df3-e03e43977235" containerName="manager"
Jul 06 21:39:54.299792 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.299793    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffe9de0d-4d53-43d4-8df3-e03e43977235" containerName="manager"
Jul 06 21:39:54.304323 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.304306    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"
Jul 06 21:39:54.307157 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.307136    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ndxgg\""
Jul 06 21:39:54.323412 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.323390    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"]
Jul 06 21:39:54.406360 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.406330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8x22\" (UniqueName: \"kubernetes.io/projected/7fa916b4-7a09-4e3d-af09-118e3162a248-kube-api-access-k8x22\") pod \"kuadrant-operator-controller-manager-86878c769f-n6fdt\" (UID: \"7fa916b4-7a09-4e3d-af09-118e3162a248\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"
Jul 06 21:39:54.406595 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.406376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fa916b4-7a09-4e3d-af09-118e3162a248-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6fdt\" (UID: \"7fa916b4-7a09-4e3d-af09-118e3162a248\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"
Jul 06 21:39:54.507288 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.507251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8x22\" (UniqueName: \"kubernetes.io/projected/7fa916b4-7a09-4e3d-af09-118e3162a248-kube-api-access-k8x22\") pod \"kuadrant-operator-controller-manager-86878c769f-n6fdt\" (UID: \"7fa916b4-7a09-4e3d-af09-118e3162a248\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"
Jul 06 21:39:54.507468 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.507308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fa916b4-7a09-4e3d-af09-118e3162a248-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6fdt\" (UID: \"7fa916b4-7a09-4e3d-af09-118e3162a248\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"
Jul 06 21:39:54.507710 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.507689    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7fa916b4-7a09-4e3d-af09-118e3162a248-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6fdt\" (UID: \"7fa916b4-7a09-4e3d-af09-118e3162a248\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"
Jul 06 21:39:54.522101 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.522079    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8x22\" (UniqueName: \"kubernetes.io/projected/7fa916b4-7a09-4e3d-af09-118e3162a248-kube-api-access-k8x22\") pod \"kuadrant-operator-controller-manager-86878c769f-n6fdt\" (UID: \"7fa916b4-7a09-4e3d-af09-118e3162a248\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"
Jul 06 21:39:54.615035 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.614957    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"
Jul 06 21:39:54.764593 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:54.764563    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"]
Jul 06 21:39:54.767947 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:39:54.767923    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa916b4_7a09_4e3d_af09_118e3162a248.slice/crio-c42ec72d4c9460f0f62c254e399b9dac58eb0e6bdcdcd910b474353f5c126669 WatchSource:0}: Error finding container c42ec72d4c9460f0f62c254e399b9dac58eb0e6bdcdcd910b474353f5c126669: Status 404 returned error can't find the container with id c42ec72d4c9460f0f62c254e399b9dac58eb0e6bdcdcd910b474353f5c126669
Jul 06 21:39:55.701655 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:55.701624    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt" event={"ID":"7fa916b4-7a09-4e3d-af09-118e3162a248","Type":"ContainerStarted","Data":"5bd134ae235ed651c276fd0182aed675e119570968b85c1237d44630f7c0c2f9"}
Jul 06 21:39:55.702060 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:55.701683    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"
Jul 06 21:39:55.702060 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:55.701698    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt" event={"ID":"7fa916b4-7a09-4e3d-af09-118e3162a248","Type":"ContainerStarted","Data":"c42ec72d4c9460f0f62c254e399b9dac58eb0e6bdcdcd910b474353f5c126669"}
Jul 06 21:39:55.732062 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:39:55.732010    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt" podStartSLOduration=1.731994388 podStartE2EDuration="1.731994388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:39:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:39:55.729937834 +0000 UTC m=+1104.203135453" watchObservedRunningTime="2026-07-06 21:39:55.731994388 +0000 UTC m=+1104.205192007"
Jul 06 21:40:06.708556 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:40:06.708529    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6fdt"
Jul 06 21:40:14.304675 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:40:14.304640    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:40:23.103935 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:40:23.103887    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:40:35.302395 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:40:35.302360    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:40:46.993839 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:40:46.993807    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:40:57.911832 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:40:57.911745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:41:09.297376 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:41:09.297340    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:41:18.103757 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:41:18.103722    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:41:28.095888 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:41:28.095854    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:41:32.009878 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:41:32.009852    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:41:32.013891 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:41:32.013870    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:41:39.606052 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:41:39.606013    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:41:49.094800 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:41:49.094765    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:41:59.315721 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:41:59.315685    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:42:24.506744 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:42:24.506663    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:42:31.612070 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:42:31.612038    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:42:40.623288 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:42:40.623252    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:42:51.919514 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:42:51.919472    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:43:07.316208 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:43:07.316173    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:43:17.696201 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:43:17.696162    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:43:26.804189 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:43:26.804155    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:43:35.301768 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:43:35.301732    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:43:45.110967 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:43:45.110931    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:43:54.099650 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:43:54.099573    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:44:05.516974 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:44:05.516941    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:44:12.807280 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:44:12.807248    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:44:22.107968 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:44:22.107935    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:44:31.507381 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:44:31.507346    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:44:43.499458 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:44:43.499424    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:44:55.301444 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:44:55.301409    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:45:04.201214 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:45:04.201180    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:45:15.305358 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:45:15.305321    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:45:23.309949 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:45:23.309852    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:45:33.202343 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:45:33.202305    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:45:40.701714 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:45:40.701682    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:45:53.403872 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:45:53.403828    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:46:01.905348 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:01.905314    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:46:11.511237 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:11.511205    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:46:23.792294 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.792260    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"]
Jul 06 21:46:23.796040 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.796010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.799500 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.799480    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7e20a6c0-openshift-default-dockercfg-cgwpj\""
Jul 06 21:46:23.817123 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.817097    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"]
Jul 06 21:46:23.861099 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.861070    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-certs\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.861297 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.861104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-envoy\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.861297 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.861140    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istiod-ca-cert\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.861297 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.861256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-credential-socket\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.861478 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.861356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-podinfo\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.861478 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.861390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-token\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.861478 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.861418    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdpr4\" (UniqueName: \"kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-kube-api-access-jdpr4\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.861478 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.861454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-socket\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.861668 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.861500    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-data\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.962455 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.962420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-podinfo\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.962455 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.962453    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-token\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.962697 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.962477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdpr4\" (UniqueName: \"kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-kube-api-access-jdpr4\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.962697 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.962601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-socket\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.962697 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.962670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-data\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.962859 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.962702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-certs\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.962859 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.962729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-envoy\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.962985 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.962880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istiod-ca-cert\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.963042 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.962984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-credential-socket\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.963152 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.963125    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-data\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.963273 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.963172    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-certs\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.963273 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.963262    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-socket\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.963371 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.963358    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-credential-socket\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.963605 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.963587    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istiod-ca-cert\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.965205 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.965189    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-envoy\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.965506 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.965486    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-podinfo\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.978207 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.978179    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-token\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:23.978566 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:23.978542    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdpr4\" (UniqueName: \"kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-kube-api-access-jdpr4\") pod \"e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") " pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:24.107124 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:24.107043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:24.255473 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:24.255446    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"]
Jul 06 21:46:24.257249 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:46:24.257211    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11bbc94_dd76_40e3_a8a1_fe822ee55018.slice/crio-41a18bdbde805e5bd27d07d6deece835c26bb2f1132af96a2d52523e94c614c9 WatchSource:0}: Error finding container 41a18bdbde805e5bd27d07d6deece835c26bb2f1132af96a2d52523e94c614c9: Status 404 returned error can't find the container with id 41a18bdbde805e5bd27d07d6deece835c26bb2f1132af96a2d52523e94c614c9
Jul 06 21:46:24.259731 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:24.259702    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:46:24.259840 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:24.259790    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:46:24.259840 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:24.259834    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:46:24.718561 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:24.718526    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c" event={"ID":"c11bbc94-dd76-40e3-a8a1-fe822ee55018","Type":"ContainerStarted","Data":"079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847"}
Jul 06 21:46:24.718753 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:24.718578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c" event={"ID":"c11bbc94-dd76-40e3-a8a1-fe822ee55018","Type":"ContainerStarted","Data":"41a18bdbde805e5bd27d07d6deece835c26bb2f1132af96a2d52523e94c614c9"}
Jul 06 21:46:24.741529 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:24.741475    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c" podStartSLOduration=1.741455161 podStartE2EDuration="1.741455161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:46:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:46:24.740614167 +0000 UTC m=+1493.213811789" watchObservedRunningTime="2026-07-06 21:46:24.741455161 +0000 UTC m=+1493.214652781"
Jul 06 21:46:25.108072 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:25.108033    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:25.113025 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:25.113000    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:25.724428 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:25.724391    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:25.725375 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:25.725353    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:27.602325 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:27.602289    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:46:32.070800 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:32.070771    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:46:32.075877 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:32.075861    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:46:35.793567 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:35.793530    2564 generic.go:356] "Generic (PLEG): container finished" podID="c11bbc94-dd76-40e3-a8a1-fe822ee55018" containerID="079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847" exitCode=0
Jul 06 21:46:35.794002 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:35.793604    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c" event={"ID":"c11bbc94-dd76-40e3-a8a1-fe822ee55018","Type":"ContainerDied","Data":"079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847"}
Jul 06 21:46:35.794054 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:35.794006    2564 scope.go:117] "RemoveContainer" containerID="079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847"
Jul 06 21:46:35.794993 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:35.794970    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:46:35.795064 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:35.795046    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:46:35.795112 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:35.795096    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:46:36.217309 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:36.217220    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"]
Jul 06 21:46:36.801870 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:36.801836    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c" event={"ID":"c11bbc94-dd76-40e3-a8a1-fe822ee55018","Type":"ContainerStarted","Data":"e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa"}
Jul 06 21:46:36.802302 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:36.801937    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c" podUID="c11bbc94-dd76-40e3-a8a1-fe822ee55018" containerName="istio-proxy" containerID="cri-o://e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa" gracePeriod=30
Jul 06 21:46:38.998545 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:38.998509    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:46:40.724985 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:40.724958    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:42.065102 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.065040    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:42.160864 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.160836    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-certs\") pod \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") "
Jul 06 21:46:42.161276 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.160870    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-data\") pod \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") "
Jul 06 21:46:42.161276 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.160980    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-podinfo\") pod \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") "
Jul 06 21:46:42.161276 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161009    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istiod-ca-cert\") pod \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") "
Jul 06 21:46:42.161276 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161070    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdpr4\" (UniqueName: \"kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-kube-api-access-jdpr4\") pod \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") "
Jul 06 21:46:42.161276 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161114    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-socket\") pod \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") "
Jul 06 21:46:42.161276 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161175    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c11bbc94-dd76-40e3-a8a1-fe822ee55018" (UID: "c11bbc94-dd76-40e3-a8a1-fe822ee55018"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:42.161276 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161189    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-envoy\") pod \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") "
Jul 06 21:46:42.161276 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161255    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-token\") pod \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") "
Jul 06 21:46:42.161715 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161297    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-credential-socket\") pod \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\" (UID: \"c11bbc94-dd76-40e3-a8a1-fe822ee55018\") "
Jul 06 21:46:42.161715 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161395    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c11bbc94-dd76-40e3-a8a1-fe822ee55018" (UID: "c11bbc94-dd76-40e3-a8a1-fe822ee55018"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:42.161715 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161556    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-socket\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:46:42.161715 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161573    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-workload-certs\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:46:42.161715 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161695    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c11bbc94-dd76-40e3-a8a1-fe822ee55018" (UID: "c11bbc94-dd76-40e3-a8a1-fe822ee55018"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:42.162024 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161927    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c11bbc94-dd76-40e3-a8a1-fe822ee55018" (UID: "c11bbc94-dd76-40e3-a8a1-fe822ee55018"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:46:42.162024 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.161913    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-data" (OuterVolumeSpecName: "istio-data") pod "c11bbc94-dd76-40e3-a8a1-fe822ee55018" (UID: "c11bbc94-dd76-40e3-a8a1-fe822ee55018"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:42.163581 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.163555    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c11bbc94-dd76-40e3-a8a1-fe822ee55018" (UID: "c11bbc94-dd76-40e3-a8a1-fe822ee55018"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 21:46:42.163712 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.163666    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-kube-api-access-jdpr4" (OuterVolumeSpecName: "kube-api-access-jdpr4") pod "c11bbc94-dd76-40e3-a8a1-fe822ee55018" (UID: "c11bbc94-dd76-40e3-a8a1-fe822ee55018"). InnerVolumeSpecName "kube-api-access-jdpr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:46:42.163712 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.163689    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c11bbc94-dd76-40e3-a8a1-fe822ee55018" (UID: "c11bbc94-dd76-40e3-a8a1-fe822ee55018"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:46:42.163808 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.163762    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-token" (OuterVolumeSpecName: "istio-token") pod "c11bbc94-dd76-40e3-a8a1-fe822ee55018" (UID: "c11bbc94-dd76-40e3-a8a1-fe822ee55018"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:46:42.262418 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.262385    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-credential-socket\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:46:42.262418 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.262409    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-data\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:46:42.262418 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.262420    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-podinfo\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:46:42.262418 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.262428    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istiod-ca-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:46:42.262738 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.262438    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdpr4\" (UniqueName: \"kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-kube-api-access-jdpr4\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:46:42.262738 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.262447    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-envoy\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:46:42.262738 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.262456    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c11bbc94-dd76-40e3-a8a1-fe822ee55018-istio-token\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:46:42.835185 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.835099    2564 generic.go:356] "Generic (PLEG): container finished" podID="c11bbc94-dd76-40e3-a8a1-fe822ee55018" containerID="e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa" exitCode=0
Jul 06 21:46:42.835185 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.835139    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c" event={"ID":"c11bbc94-dd76-40e3-a8a1-fe822ee55018","Type":"ContainerDied","Data":"e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa"}
Jul 06 21:46:42.835185 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.835147    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"
Jul 06 21:46:42.835185 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.835181    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c" event={"ID":"c11bbc94-dd76-40e3-a8a1-fe822ee55018","Type":"ContainerDied","Data":"41a18bdbde805e5bd27d07d6deece835c26bb2f1132af96a2d52523e94c614c9"}
Jul 06 21:46:42.835461 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.835202    2564 scope.go:117] "RemoveContainer" containerID="e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa"
Jul 06 21:46:42.845681 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.845664    2564 scope.go:117] "RemoveContainer" containerID="079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847"
Jul 06 21:46:42.853915 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.853878    2564 scope.go:117] "RemoveContainer" containerID="e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa"
Jul 06 21:46:42.854185 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:46:42.854164    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa\": container with ID starting with e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa not found: ID does not exist" containerID="e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa"
Jul 06 21:46:42.854266 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.854194    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa"} err="failed to get container status \"e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa\": rpc error: code = NotFound desc = could not find container \"e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa\": container with ID starting with e504a4da732fc6e2caa74e18a13c9b2d0feaeb9775a987b1e285d3617fdf4daa not found: ID does not exist"
Jul 06 21:46:42.854266 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.854213    2564 scope.go:117] "RemoveContainer" containerID="079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847"
Jul 06 21:46:42.854452 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:46:42.854438    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847\": container with ID starting with 079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847 not found: ID does not exist" containerID="079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847"
Jul 06 21:46:42.854499 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.854457    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847"} err="failed to get container status \"079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847\": rpc error: code = NotFound desc = could not find container \"079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847\": container with ID starting with 079def7a2db5203cbe008171c5c0fd641e5f8a84adff8ee3a7e5228f9c676847 not found: ID does not exist"
Jul 06 21:46:42.859159 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.859136    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"]
Jul 06 21:46:42.862797 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:42.862774    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7e20a6c0-openshift-default-96dbd969f-ghz7c"]
Jul 06 21:46:44.063490 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:44.063457    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c11bbc94-dd76-40e3-a8a1-fe822ee55018" path="/var/lib/kubelet/pods/c11bbc94-dd76-40e3-a8a1-fe822ee55018/volumes"
Jul 06 21:46:46.598672 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:46.598632    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:46:54.502762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:46:54.502684    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:48:18.605788 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:48:18.605743    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:48:27.012343 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:48:27.012270    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:48:41.205476 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:48:41.205443    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:48:49.304361 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:48:49.304329    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:49:20.801085 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:20.801052    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:49:27.107757 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.107728    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"]
Jul 06 21:49:27.108214 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.108145    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c11bbc94-dd76-40e3-a8a1-fe822ee55018" containerName="istio-proxy"
Jul 06 21:49:27.108214 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.108156    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c11bbc94-dd76-40e3-a8a1-fe822ee55018" containerName="istio-proxy"
Jul 06 21:49:27.108214 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.108163    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c11bbc94-dd76-40e3-a8a1-fe822ee55018" containerName="istio-proxy"
Jul 06 21:49:27.108214 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.108169    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c11bbc94-dd76-40e3-a8a1-fe822ee55018" containerName="istio-proxy"
Jul 06 21:49:27.108350 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.108230    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c11bbc94-dd76-40e3-a8a1-fe822ee55018" containerName="istio-proxy"
Jul 06 21:49:27.108350 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.108241    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c11bbc94-dd76-40e3-a8a1-fe822ee55018" containerName="istio-proxy"
Jul 06 21:49:27.111495 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.111480    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.115084 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.115059    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f377e18b\"/\"kube-root-ca.crt\""
Jul 06 21:49:27.115084 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.115073    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f377e18b\"/\"default-dockercfg-4cd9p\""
Jul 06 21:49:27.115297 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.115061    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f377e18b\"/\"openshift-service-ca.crt\""
Jul 06 21:49:27.115297 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.115191    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f377e18b\"/\"e2e-lifecycle-model-f377e18b-kserve-self-signed-certs\""
Jul 06 21:49:27.121954 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.121932    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"]
Jul 06 21:49:27.227340 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.227309    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-dshm\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.227517 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.227350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/197df952-7611-4aef-bf64-9a6eef46109d-tls-certs\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.227517 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.227374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-home\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.227517 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.227474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-tmp-dir\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.227635 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.227518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zzp7\" (UniqueName: \"kubernetes.io/projected/197df952-7611-4aef-bf64-9a6eef46109d-kube-api-access-7zzp7\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.227635 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.227548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-model-cache\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.328960 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.328922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-dshm\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.329153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.328981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/197df952-7611-4aef-bf64-9a6eef46109d-tls-certs\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.329153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.329010    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-home\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.329153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.329054    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-tmp-dir\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.329153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.329073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zzp7\" (UniqueName: \"kubernetes.io/projected/197df952-7611-4aef-bf64-9a6eef46109d-kube-api-access-7zzp7\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.329153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.329091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-model-cache\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.329435 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.329406    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-home\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.329482 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.329450    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-tmp-dir\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.329560 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.329508    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-model-cache\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.331371 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.331353    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-dshm\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.331532 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.331517    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/197df952-7611-4aef-bf64-9a6eef46109d-tls-certs\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.340073 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.339804    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zzp7\" (UniqueName: \"kubernetes.io/projected/197df952-7611-4aef-bf64-9a6eef46109d-kube-api-access-7zzp7\") pod \"e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") " pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.421801 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.421717    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:27.569033 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.569008    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"]
Jul 06 21:49:27.571063 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:49:27.571035    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod197df952_7611_4aef_bf64_9a6eef46109d.slice/crio-52b2ffd9ccd9d973d574e41518a93426a3d3a4dade05292d8bc156a97fbd4e8d WatchSource:0}: Error finding container 52b2ffd9ccd9d973d574e41518a93426a3d3a4dade05292d8bc156a97fbd4e8d: Status 404 returned error can't find the container with id 52b2ffd9ccd9d973d574e41518a93426a3d3a4dade05292d8bc156a97fbd4e8d
Jul 06 21:49:27.706742 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.706658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg" event={"ID":"197df952-7611-4aef-bf64-9a6eef46109d","Type":"ContainerStarted","Data":"95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622"}
Jul 06 21:49:27.706742 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.706695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg" event={"ID":"197df952-7611-4aef-bf64-9a6eef46109d","Type":"ContainerStarted","Data":"52b2ffd9ccd9d973d574e41518a93426a3d3a4dade05292d8bc156a97fbd4e8d"}
Jul 06 21:49:27.726726 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:27.726675    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg" podStartSLOduration=0.726660775 podStartE2EDuration="726.660775ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:49:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:49:27.725643138 +0000 UTC m=+1676.198840759" watchObservedRunningTime="2026-07-06 21:49:27.726660775 +0000 UTC m=+1676.199858433"
Jul 06 21:49:32.102401 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:32.102364    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:49:37.422265 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:37.422224    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:37.422728 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:37.422302    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:37.434858 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:37.434830    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:37.771698 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:37.771674    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:49:58.808725 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:49:58.808630    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:50:10.606852 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:10.606817    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:50:10.612280 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:10.612258    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"]
Jul 06 21:50:25.634039 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:25.633976    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg" podUID="197df952-7611-4aef-bf64-9a6eef46109d" containerName="main" containerID="cri-o://95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622" gracePeriod=45
Jul 06 21:50:25.888138 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:25.888075    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:50:26.006000 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.005950    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-model-cache\") pod \"197df952-7611-4aef-bf64-9a6eef46109d\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") "
Jul 06 21:50:26.006000 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.006013    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-dshm\") pod \"197df952-7611-4aef-bf64-9a6eef46109d\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") "
Jul 06 21:50:26.006220 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.006039    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/197df952-7611-4aef-bf64-9a6eef46109d-tls-certs\") pod \"197df952-7611-4aef-bf64-9a6eef46109d\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") "
Jul 06 21:50:26.006220 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.006086    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-home\") pod \"197df952-7611-4aef-bf64-9a6eef46109d\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") "
Jul 06 21:50:26.006220 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.006181    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-tmp-dir\") pod \"197df952-7611-4aef-bf64-9a6eef46109d\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") "
Jul 06 21:50:26.006353 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.006232    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zzp7\" (UniqueName: \"kubernetes.io/projected/197df952-7611-4aef-bf64-9a6eef46109d-kube-api-access-7zzp7\") pod \"197df952-7611-4aef-bf64-9a6eef46109d\" (UID: \"197df952-7611-4aef-bf64-9a6eef46109d\") "
Jul 06 21:50:26.006353 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.006280    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-model-cache" (OuterVolumeSpecName: "model-cache") pod "197df952-7611-4aef-bf64-9a6eef46109d" (UID: "197df952-7611-4aef-bf64-9a6eef46109d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:50:26.006466 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.006443    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-home" (OuterVolumeSpecName: "home") pod "197df952-7611-4aef-bf64-9a6eef46109d" (UID: "197df952-7611-4aef-bf64-9a6eef46109d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:50:26.006533 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.006472    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "197df952-7611-4aef-bf64-9a6eef46109d" (UID: "197df952-7611-4aef-bf64-9a6eef46109d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:50:26.006533 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.006497    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-model-cache\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:50:26.008467 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.008407    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-dshm" (OuterVolumeSpecName: "dshm") pod "197df952-7611-4aef-bf64-9a6eef46109d" (UID: "197df952-7611-4aef-bf64-9a6eef46109d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:50:26.008581 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.008538    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/197df952-7611-4aef-bf64-9a6eef46109d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "197df952-7611-4aef-bf64-9a6eef46109d" (UID: "197df952-7611-4aef-bf64-9a6eef46109d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:50:26.008581 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.008542    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/197df952-7611-4aef-bf64-9a6eef46109d-kube-api-access-7zzp7" (OuterVolumeSpecName: "kube-api-access-7zzp7") pod "197df952-7611-4aef-bf64-9a6eef46109d" (UID: "197df952-7611-4aef-bf64-9a6eef46109d"). InnerVolumeSpecName "kube-api-access-7zzp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:50:26.014682 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.014648    2564 generic.go:356] "Generic (PLEG): container finished" podID="197df952-7611-4aef-bf64-9a6eef46109d" containerID="95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622" exitCode=0
Jul 06 21:50:26.014817 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.014686    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg" event={"ID":"197df952-7611-4aef-bf64-9a6eef46109d","Type":"ContainerDied","Data":"95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622"}
Jul 06 21:50:26.014817 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.014707    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"
Jul 06 21:50:26.014817 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.014743    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg" event={"ID":"197df952-7611-4aef-bf64-9a6eef46109d","Type":"ContainerDied","Data":"52b2ffd9ccd9d973d574e41518a93426a3d3a4dade05292d8bc156a97fbd4e8d"}
Jul 06 21:50:26.014817 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.014768    2564 scope.go:117] "RemoveContainer" containerID="95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622"
Jul 06 21:50:26.029333 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.029319    2564 scope.go:117] "RemoveContainer" containerID="95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622"
Jul 06 21:50:26.029632 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:50:26.029613    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622\": container with ID starting with 95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622 not found: ID does not exist" containerID="95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622"
Jul 06 21:50:26.029689 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.029642    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622"} err="failed to get container status \"95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622\": rpc error: code = NotFound desc = could not find container \"95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622\": container with ID starting with 95764cd776678a9c4646301a7f1e776a67594e5360fb493261b922c3e276c622 not found: ID does not exist"
Jul 06 21:50:26.039323 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.039304    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"]
Jul 06 21:50:26.043034 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.043015    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f377e18b/e2e-lifecycle-model-f377e18b-kserve-7df466dcb7-c2zfg"]
Jul 06 21:50:26.063440 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.063412    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="197df952-7611-4aef-bf64-9a6eef46109d" path="/var/lib/kubelet/pods/197df952-7611-4aef-bf64-9a6eef46109d/volumes"
Jul 06 21:50:26.107733 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.107710    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-dshm\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:50:26.107860 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.107748    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/197df952-7611-4aef-bf64-9a6eef46109d-tls-certs\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:50:26.107860 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.107757    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-home\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:50:26.107860 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.107765    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/197df952-7611-4aef-bf64-9a6eef46109d-tmp-dir\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:50:26.107860 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:26.107773    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zzp7\" (UniqueName: \"kubernetes.io/projected/197df952-7611-4aef-bf64-9a6eef46109d-kube-api-access-7zzp7\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:50:50.304628 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:50.304593    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:50:58.910820 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:50:58.910788    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:51:11.903519 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:11.903479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:51:32.102460 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:32.102432    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:51:32.108607 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:32.108587    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:51:57.751695 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.751664    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"]
Jul 06 21:51:57.752336 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.752096    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="197df952-7611-4aef-bf64-9a6eef46109d" containerName="main"
Jul 06 21:51:57.752336 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.752108    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="197df952-7611-4aef-bf64-9a6eef46109d" containerName="main"
Jul 06 21:51:57.752336 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.752172    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="197df952-7611-4aef-bf64-9a6eef46109d" containerName="main"
Jul 06 21:51:57.755153 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.755138    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.760650 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.760628    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f79c56-openshift-default-dockercfg-mkv8v\""
Jul 06 21:51:57.772825 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.772798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"]
Jul 06 21:51:57.845993 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.845958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-credential-socket\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.846184 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.846002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-token\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.846184 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.846069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-socket\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.846184 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.846093    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-podinfo\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.846184 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.846133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istiod-ca-cert\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.846399 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.846190    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-envoy\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.846399 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.846226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6vgh\" (UniqueName: \"kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-kube-api-access-c6vgh\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.846399 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.846260    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-certs\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.846399 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.846288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-data\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947157 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6vgh\" (UniqueName: \"kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-kube-api-access-c6vgh\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947157 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947162    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-certs\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947395 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-data\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947395 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-credential-socket\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947491    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-data\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947576 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947560    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-certs\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947633 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947565    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-token\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947694 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947631    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-credential-socket\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947694 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-socket\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947694 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947683    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-podinfo\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947843 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istiod-ca-cert\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947843 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947832    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-envoy\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.947974 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.947857    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-socket\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.948406 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.948388    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istiod-ca-cert\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.950838 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.950810    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-podinfo\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.950967 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.950936    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-envoy\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.956102 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.956084    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-token\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:57.956270 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:57.956252    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6vgh\" (UniqueName: \"kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-kube-api-access-c6vgh\") pod \"e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") " pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:58.065046 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:58.064955    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:58.223245 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:58.223204    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"]
Jul 06 21:51:58.226865 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:51:58.226835    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4543e79a_0a0a_4ea2_8041_0a21119d7b2d.slice/crio-018129417e8c5c01fdc1bdddfa334fe7524e476686d8e6be058445596d15b970 WatchSource:0}: Error finding container 018129417e8c5c01fdc1bdddfa334fe7524e476686d8e6be058445596d15b970: Status 404 returned error can't find the container with id 018129417e8c5c01fdc1bdddfa334fe7524e476686d8e6be058445596d15b970
Jul 06 21:51:58.229258 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:58.229219    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:51:58.229329 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:58.229310    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:51:58.229374 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:58.229354    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:51:58.519075 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:58.519044    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" event={"ID":"4543e79a-0a0a-4ea2-8041-0a21119d7b2d","Type":"ContainerStarted","Data":"5a129ce54054217b332745eead8f8b9ddc06605b429a188b0fb92e46db590448"}
Jul 06 21:51:58.519250 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:58.519099    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" event={"ID":"4543e79a-0a0a-4ea2-8041-0a21119d7b2d","Type":"ContainerStarted","Data":"018129417e8c5c01fdc1bdddfa334fe7524e476686d8e6be058445596d15b970"}
Jul 06 21:51:58.545530 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:58.545472    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" podStartSLOduration=1.5454537720000001 podStartE2EDuration="1.545453772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:51:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:51:58.542022891 +0000 UTC m=+1827.015220513" watchObservedRunningTime="2026-07-06 21:51:58.545453772 +0000 UTC m=+1827.018651396"
Jul 06 21:51:59.065832 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:59.065792    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:59.071018 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:59.070997    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:59.524180 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:59.524155    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:51:59.525130 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:51:59.525112    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:52:00.529777 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:00.529749    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:52:12.501163 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:12.501124    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:52:14.525495 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:14.525462    2564 patch_prober.go:28] interesting pod/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 06 21:52:14.525971 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:14.525526    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 06 21:52:14.609471 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:14.609435    2564 generic.go:356] "Generic (PLEG): container finished" podID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerID="5a129ce54054217b332745eead8f8b9ddc06605b429a188b0fb92e46db590448" exitCode=0
Jul 06 21:52:14.609644 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:14.609508    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" event={"ID":"4543e79a-0a0a-4ea2-8041-0a21119d7b2d","Type":"ContainerDied","Data":"5a129ce54054217b332745eead8f8b9ddc06605b429a188b0fb92e46db590448"}
Jul 06 21:52:14.609947 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:14.609934    2564 scope.go:117] "RemoveContainer" containerID="5a129ce54054217b332745eead8f8b9ddc06605b429a188b0fb92e46db590448"
Jul 06 21:52:14.610938 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:14.610910    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:52:14.611041 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:14.610983    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:52:14.611041 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:14.611017    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:52:15.616984 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:15.616948    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" event={"ID":"4543e79a-0a0a-4ea2-8041-0a21119d7b2d","Type":"ContainerStarted","Data":"5ec3124992f5215396c2cdfe2570e1bfb11814a589046e3d2386955ecbb945ed"}
Jul 06 21:52:16.065331 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:16.065290    2564 patch_prober.go:28] interesting pod/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 06 21:52:16.065545 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:16.065355    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 06 21:52:16.068739 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:16.068708    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:52:17.065409 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:17.065365    2564 patch_prober.go:28] interesting pod/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 06 21:52:17.065954 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:17.065455    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 06 21:52:18.068279 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:18.068247    2564 patch_prober.go:28] interesting pod/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 06 21:52:18.068861 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:18.068829    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 06 21:52:19.065752 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:19.065703    2564 patch_prober.go:28] interesting pod/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 06 21:52:19.065963 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:19.065786    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 06 21:52:20.070423 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:20.070397    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:52:20.070872 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:20.070666    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:52:20.071344 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:20.071330    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:52:27.819602 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:27.819565    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:52:55.019291 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.019208    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"]
Jul 06 21:52:55.025052 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.023763    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.028301 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.028279    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f79c56\"/\"openshift-service-ca.crt\""
Jul 06 21:52:55.029250 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.029232    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f79c56\"/\"default-dockercfg-bj452\""
Jul 06 21:52:55.029411 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.029264    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-f79c56\"/\"kube-root-ca.crt\""
Jul 06 21:52:55.029577 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.029305    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-f79c56\"/\"test-model-f79c56-kserve-self-signed-certs\""
Jul 06 21:52:55.036292 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.036271    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"]
Jul 06 21:52:55.091985 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.091954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-model-cache\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.092172 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.091994    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-home\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.092172 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.092100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2685bb39-680e-4e35-97ff-2df05549b421-tls-certs\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.092172 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.092129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j59qp\" (UniqueName: \"kubernetes.io/projected/2685bb39-680e-4e35-97ff-2df05549b421-kube-api-access-j59qp\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.092337 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.092263    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-tmp-dir\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.092337 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.092297    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-dshm\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.193508 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.193457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-tmp-dir\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.193717 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.193526    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-dshm\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.194026 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.193998    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-tmp-dir\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.194170 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.194042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-model-cache\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.194170 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.194106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-home\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.194352 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.194326    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-model-cache\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.194470 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.194414    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-home\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.194470 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.194451    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2685bb39-680e-4e35-97ff-2df05549b421-tls-certs\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.194589 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.194493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j59qp\" (UniqueName: \"kubernetes.io/projected/2685bb39-680e-4e35-97ff-2df05549b421-kube-api-access-j59qp\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.196511 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.196492    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-dshm\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.196754 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.196737    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2685bb39-680e-4e35-97ff-2df05549b421-tls-certs\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.203770 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.203739    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j59qp\" (UniqueName: \"kubernetes.io/projected/2685bb39-680e-4e35-97ff-2df05549b421-kube-api-access-j59qp\") pod \"test-model-f79c56-kserve-768dc646f7-dwhj5\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") " pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.336847 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.336751    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:52:55.481049 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.481026    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"]
Jul 06 21:52:55.482831 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:52:55.482797    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2685bb39_680e_4e35_97ff_2df05549b421.slice/crio-b24f10ee36b3593ec19dfde84b1deef1e899c0b199d19938e2916c9917f8c852 WatchSource:0}: Error finding container b24f10ee36b3593ec19dfde84b1deef1e899c0b199d19938e2916c9917f8c852: Status 404 returned error can't find the container with id b24f10ee36b3593ec19dfde84b1deef1e899c0b199d19938e2916c9917f8c852
Jul 06 21:52:55.827819 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.827786    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5" event={"ID":"2685bb39-680e-4e35-97ff-2df05549b421","Type":"ContainerStarted","Data":"d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c"}
Jul 06 21:52:55.827819 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.827831    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5" event={"ID":"2685bb39-680e-4e35-97ff-2df05549b421","Type":"ContainerStarted","Data":"b24f10ee36b3593ec19dfde84b1deef1e899c0b199d19938e2916c9917f8c852"}
Jul 06 21:52:55.848598 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:55.848546    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5" podStartSLOduration=1.8485291 podStartE2EDuration="1.8485291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:52:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:52:55.846812502 +0000 UTC m=+1884.320010122" watchObservedRunningTime="2026-07-06 21:52:55.8485291 +0000 UTC m=+1884.321726719"
Jul 06 21:52:59.456105 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:52:59.456074    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:53:05.337324 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:05.337295    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:53:05.337712 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:05.337341    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:53:05.350581 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:05.350558    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:53:05.892722 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:05.892693    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:53:11.999390 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:11.999352    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:53:14.883434 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:14.883399    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"]
Jul 06 21:53:27.208973 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:27.208939    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:53:29.904599 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:29.904543    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5" podUID="2685bb39-680e-4e35-97ff-2df05549b421" containerName="main" containerID="cri-o://d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c" gracePeriod=45
Jul 06 21:53:30.158210 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.158143    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:53:30.239341 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.239311    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-home\") pod \"2685bb39-680e-4e35-97ff-2df05549b421\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") "
Jul 06 21:53:30.239503 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.239352    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-tmp-dir\") pod \"2685bb39-680e-4e35-97ff-2df05549b421\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") "
Jul 06 21:53:30.239503 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.239398    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-dshm\") pod \"2685bb39-680e-4e35-97ff-2df05549b421\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") "
Jul 06 21:53:30.239503 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.239432    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2685bb39-680e-4e35-97ff-2df05549b421-tls-certs\") pod \"2685bb39-680e-4e35-97ff-2df05549b421\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") "
Jul 06 21:53:30.239503 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.239466    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j59qp\" (UniqueName: \"kubernetes.io/projected/2685bb39-680e-4e35-97ff-2df05549b421-kube-api-access-j59qp\") pod \"2685bb39-680e-4e35-97ff-2df05549b421\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") "
Jul 06 21:53:30.239503 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.239499    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-model-cache\") pod \"2685bb39-680e-4e35-97ff-2df05549b421\" (UID: \"2685bb39-680e-4e35-97ff-2df05549b421\") "
Jul 06 21:53:30.239771 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.239651    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-home" (OuterVolumeSpecName: "home") pod "2685bb39-680e-4e35-97ff-2df05549b421" (UID: "2685bb39-680e-4e35-97ff-2df05549b421"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:53:30.239771 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.239707    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2685bb39-680e-4e35-97ff-2df05549b421" (UID: "2685bb39-680e-4e35-97ff-2df05549b421"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:53:30.239881 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.239847    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-tmp-dir\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:53:30.239881 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.239859    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-home\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:53:30.239881 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.239855    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-model-cache" (OuterVolumeSpecName: "model-cache") pod "2685bb39-680e-4e35-97ff-2df05549b421" (UID: "2685bb39-680e-4e35-97ff-2df05549b421"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:53:30.241876 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.241855    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-dshm" (OuterVolumeSpecName: "dshm") pod "2685bb39-680e-4e35-97ff-2df05549b421" (UID: "2685bb39-680e-4e35-97ff-2df05549b421"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:53:30.241975 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.241944    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2685bb39-680e-4e35-97ff-2df05549b421-kube-api-access-j59qp" (OuterVolumeSpecName: "kube-api-access-j59qp") pod "2685bb39-680e-4e35-97ff-2df05549b421" (UID: "2685bb39-680e-4e35-97ff-2df05549b421"). InnerVolumeSpecName "kube-api-access-j59qp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:53:30.242018 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.241977    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2685bb39-680e-4e35-97ff-2df05549b421-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2685bb39-680e-4e35-97ff-2df05549b421" (UID: "2685bb39-680e-4e35-97ff-2df05549b421"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:53:30.340848 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.340806    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2685bb39-680e-4e35-97ff-2df05549b421-tls-certs\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:53:30.340848 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.340842    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j59qp\" (UniqueName: \"kubernetes.io/projected/2685bb39-680e-4e35-97ff-2df05549b421-kube-api-access-j59qp\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:53:30.340848 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.340852    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-model-cache\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:53:30.340848 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:30.340861    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2685bb39-680e-4e35-97ff-2df05549b421-dshm\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:53:31.023133 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:31.023101    2564 generic.go:356] "Generic (PLEG): container finished" podID="2685bb39-680e-4e35-97ff-2df05549b421" containerID="d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c" exitCode=0
Jul 06 21:53:31.023545 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:31.023149    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"
Jul 06 21:53:31.023545 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:31.023200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5" event={"ID":"2685bb39-680e-4e35-97ff-2df05549b421","Type":"ContainerDied","Data":"d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c"}
Jul 06 21:53:31.023545 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:31.023241    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5" event={"ID":"2685bb39-680e-4e35-97ff-2df05549b421","Type":"ContainerDied","Data":"b24f10ee36b3593ec19dfde84b1deef1e899c0b199d19938e2916c9917f8c852"}
Jul 06 21:53:31.023545 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:31.023260    2564 scope.go:117] "RemoveContainer" containerID="d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c"
Jul 06 21:53:31.040751 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:31.040731    2564 scope.go:117] "RemoveContainer" containerID="d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c"
Jul 06 21:53:31.041100 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:53:31.041080    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c\": container with ID starting with d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c not found: ID does not exist" containerID="d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c"
Jul 06 21:53:31.041183 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:31.041107    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c"} err="failed to get container status \"d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c\": rpc error: code = NotFound desc = could not find container \"d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c\": container with ID starting with d8edf1e298b70a538ffbe7c6e2c0422e8bf971ecaf65682d293eadb85230ae6c not found: ID does not exist"
Jul 06 21:53:31.052197 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:31.052177    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"]
Jul 06 21:53:31.056500 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:31.056479    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-f79c56/test-model-f79c56-kserve-768dc646f7-dwhj5"]
Jul 06 21:53:32.063705 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:53:32.063671    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2685bb39-680e-4e35-97ff-2df05549b421" path="/var/lib/kubelet/pods/2685bb39-680e-4e35-97ff-2df05549b421/volumes"
Jul 06 21:54:02.099911 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:02.099870    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:54:05.044311 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:05.044276    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"]
Jul 06 21:54:05.044804 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:05.044572    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy" containerID="cri-o://5ec3124992f5215396c2cdfe2570e1bfb11814a589046e3d2386955ecbb945ed" gracePeriod=30
Jul 06 21:54:05.073930 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:05.073874    2564 patch_prober.go:28] interesting pod/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 21:54:05.074119 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:05.073968    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 21:54:10.249827 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.249794    2564 generic.go:356] "Generic (PLEG): container finished" podID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerID="5ec3124992f5215396c2cdfe2570e1bfb11814a589046e3d2386955ecbb945ed" exitCode=0
Jul 06 21:54:10.250238 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.249866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" event={"ID":"4543e79a-0a0a-4ea2-8041-0a21119d7b2d","Type":"ContainerDied","Data":"5ec3124992f5215396c2cdfe2570e1bfb11814a589046e3d2386955ecbb945ed"}
Jul 06 21:54:10.250238 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.250002    2564 scope.go:117] "RemoveContainer" containerID="5a129ce54054217b332745eead8f8b9ddc06605b429a188b0fb92e46db590448"
Jul 06 21:54:10.311567 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.311510    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:54:10.425432 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425392    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-credential-socket\") pod \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") "
Jul 06 21:54:10.425618 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425463    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-socket\") pod \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") "
Jul 06 21:54:10.425618 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425497    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-token\") pod \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") "
Jul 06 21:54:10.425618 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425519    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-data\") pod \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") "
Jul 06 21:54:10.425618 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425537    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-envoy\") pod \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") "
Jul 06 21:54:10.425618 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425562    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-certs\") pod \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") "
Jul 06 21:54:10.425618 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425597    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6vgh\" (UniqueName: \"kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-kube-api-access-c6vgh\") pod \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") "
Jul 06 21:54:10.425969 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425699    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-podinfo\") pod \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") "
Jul 06 21:54:10.425969 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425709    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4543e79a-0a0a-4ea2-8041-0a21119d7b2d" (UID: "4543e79a-0a0a-4ea2-8041-0a21119d7b2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:10.425969 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425721    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4543e79a-0a0a-4ea2-8041-0a21119d7b2d" (UID: "4543e79a-0a0a-4ea2-8041-0a21119d7b2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:10.425969 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425730    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istiod-ca-cert\") pod \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\" (UID: \"4543e79a-0a0a-4ea2-8041-0a21119d7b2d\") "
Jul 06 21:54:10.425969 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.425925    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4543e79a-0a0a-4ea2-8041-0a21119d7b2d" (UID: "4543e79a-0a0a-4ea2-8041-0a21119d7b2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:10.426220 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.426104    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-credential-socket\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:10.426220 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.426125    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-socket\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:10.426220 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.426139    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-workload-certs\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:10.426220 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.426163    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4543e79a-0a0a-4ea2-8041-0a21119d7b2d" (UID: "4543e79a-0a0a-4ea2-8041-0a21119d7b2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:54:10.426584 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.426391    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "4543e79a-0a0a-4ea2-8041-0a21119d7b2d" (UID: "4543e79a-0a0a-4ea2-8041-0a21119d7b2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:10.428142 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.428115    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4543e79a-0a0a-4ea2-8041-0a21119d7b2d" (UID: "4543e79a-0a0a-4ea2-8041-0a21119d7b2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 21:54:10.428259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.428185    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-kube-api-access-c6vgh" (OuterVolumeSpecName: "kube-api-access-c6vgh") pod "4543e79a-0a0a-4ea2-8041-0a21119d7b2d" (UID: "4543e79a-0a0a-4ea2-8041-0a21119d7b2d"). InnerVolumeSpecName "kube-api-access-c6vgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:54:10.428390 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.428370    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "4543e79a-0a0a-4ea2-8041-0a21119d7b2d" (UID: "4543e79a-0a0a-4ea2-8041-0a21119d7b2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:54:10.428446 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.428369    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4543e79a-0a0a-4ea2-8041-0a21119d7b2d" (UID: "4543e79a-0a0a-4ea2-8041-0a21119d7b2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:10.526959 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.526925    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-token\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:10.526959 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.526953    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-data\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:10.526959 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.526962    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-envoy\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:10.527185 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.526971    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6vgh\" (UniqueName: \"kubernetes.io/projected/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-kube-api-access-c6vgh\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:10.527185 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.526980    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istio-podinfo\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:10.527185 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:10.526988    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4543e79a-0a0a-4ea2-8041-0a21119d7b2d-istiod-ca-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:11.257324 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:11.257290    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"
Jul 06 21:54:11.257764 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:11.257285    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl" event={"ID":"4543e79a-0a0a-4ea2-8041-0a21119d7b2d","Type":"ContainerDied","Data":"018129417e8c5c01fdc1bdddfa334fe7524e476686d8e6be058445596d15b970"}
Jul 06 21:54:11.257764 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:11.257430    2564 scope.go:117] "RemoveContainer" containerID="5ec3124992f5215396c2cdfe2570e1bfb11814a589046e3d2386955ecbb945ed"
Jul 06 21:54:11.287455 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:11.287427    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"]
Jul 06 21:54:11.295300 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:11.295278    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f79c56-openshift-default-ffbf497f9-5hppl"]
Jul 06 21:54:12.064145 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:12.064110    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" path="/var/lib/kubelet/pods/4543e79a-0a0a-4ea2-8041-0a21119d7b2d/volumes"
Jul 06 21:54:14.673316 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.673282    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"]
Jul 06 21:54:14.673874 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.673857    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy"
Jul 06 21:54:14.673874 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.673877    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy"
Jul 06 21:54:14.674071 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.673928    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2685bb39-680e-4e35-97ff-2df05549b421" containerName="main"
Jul 06 21:54:14.674071 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.673936    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2685bb39-680e-4e35-97ff-2df05549b421" containerName="main"
Jul 06 21:54:14.674071 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.674019    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy"
Jul 06 21:54:14.674071 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.674026    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2685bb39-680e-4e35-97ff-2df05549b421" containerName="main"
Jul 06 21:54:14.674071 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.674037    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy"
Jul 06 21:54:14.678953 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.678932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.681480 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.681458    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-70ee2a-openshift-default-dockercfg-hlkdw\""
Jul 06 21:54:14.691150 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.691132    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"]
Jul 06 21:54:14.769019 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.768989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-data\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.769232 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.769040    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-socket\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.769232 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.769103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpfl6\" (UniqueName: \"kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-kube-api-access-cpfl6\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.769232 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.769188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-token\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.769232 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.769228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-certs\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.769499 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.769266    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-credential-socket\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.769499 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.769312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-podinfo\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.769499 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.769349    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f8c3ee7-a783-482e-bd8b-61f89582b815-istiod-ca-cert\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.769499 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.769383    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-envoy\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.869871 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.869832    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-socket\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.869871 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.869872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpfl6\" (UniqueName: \"kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-kube-api-access-cpfl6\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870135 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.869960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-token\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870135 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.869992    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-certs\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870135 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.870027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-credential-socket\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870135 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.870053    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-podinfo\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870135 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.870084    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f8c3ee7-a783-482e-bd8b-61f89582b815-istiod-ca-cert\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870135 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.870111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-envoy\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870439 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.870179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-data\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870439 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.870358    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-certs\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870548 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.870457    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-credential-socket\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870548 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.870539    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-data\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870640 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.870567    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-socket\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.870855 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.870836    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f8c3ee7-a783-482e-bd8b-61f89582b815-istiod-ca-cert\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.872716 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.872693    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-podinfo\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.872845 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.872828    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-envoy\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.878571 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.878543    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-token\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.878702 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.878683    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpfl6\" (UniqueName: \"kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-kube-api-access-cpfl6\") pod \"e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") " pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:14.991312 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:14.991279    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:15.146424 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:15.146398    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"]
Jul 06 21:54:15.149273 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:54:15.149245    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8c3ee7_a783_482e_bd8b_61f89582b815.slice/crio-89dfadfd1ea3f3bb4deb08472cc1f948f5c5b9ca5e958cc4eeef69b50407bd86 WatchSource:0}: Error finding container 89dfadfd1ea3f3bb4deb08472cc1f948f5c5b9ca5e958cc4eeef69b50407bd86: Status 404 returned error can't find the container with id 89dfadfd1ea3f3bb4deb08472cc1f948f5c5b9ca5e958cc4eeef69b50407bd86
Jul 06 21:54:15.151391 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:15.151348    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:54:15.151478 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:15.151427    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:54:15.151478 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:15.151461    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:54:15.282555 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:15.282471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" event={"ID":"7f8c3ee7-a783-482e-bd8b-61f89582b815","Type":"ContainerStarted","Data":"6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241"}
Jul 06 21:54:15.282555 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:15.282536    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" event={"ID":"7f8c3ee7-a783-482e-bd8b-61f89582b815","Type":"ContainerStarted","Data":"89dfadfd1ea3f3bb4deb08472cc1f948f5c5b9ca5e958cc4eeef69b50407bd86"}
Jul 06 21:54:15.306238 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:15.306184    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" podStartSLOduration=1.306168076 podStartE2EDuration="1.306168076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:54:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:54:15.303727823 +0000 UTC m=+1963.776925445" watchObservedRunningTime="2026-07-06 21:54:15.306168076 +0000 UTC m=+1963.779365696"
Jul 06 21:54:15.992137 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:15.992104    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:16.212024 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:16.211986    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:54:16.997392 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:16.997365    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:17.293971 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:17.293880    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:17.294855 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:17.294833    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:28.430461 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:28.430419    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:54:30.366756 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:30.366677    2564 generic.go:356] "Generic (PLEG): container finished" podID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerID="6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241" exitCode=0
Jul 06 21:54:30.367251 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:30.366753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" event={"ID":"7f8c3ee7-a783-482e-bd8b-61f89582b815","Type":"ContainerDied","Data":"6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241"}
Jul 06 21:54:30.367251 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:30.367208    2564 scope.go:117] "RemoveContainer" containerID="6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241"
Jul 06 21:54:30.368253 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:30.368228    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:54:30.368314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:30.368301    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:54:30.368378 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:30.368357    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:54:31.374252 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:31.374219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" event={"ID":"7f8c3ee7-a783-482e-bd8b-61f89582b815","Type":"ContainerStarted","Data":"6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b"}
Jul 06 21:54:31.991727 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:31.991691    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:31.992761 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:31.992729    2564 patch_prober.go:28] interesting pod/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 21:54:31.992888 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:31.992780    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 21:54:32.294060 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:32.293975    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:32.992090 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:32.992059    2564 patch_prober.go:28] interesting pod/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 21:54:32.992513 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:32.992114    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 21:54:33.992236 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:33.992200    2564 patch_prober.go:28] interesting pod/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 21:54:33.992690 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:33.992254    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 21:54:34.992522 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:34.992490    2564 patch_prober.go:28] interesting pod/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 21:54:34.992928 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:34.992543    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 21:54:35.996196 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:35.996164    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:35.997428 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:35.997406    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:42.505012 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:42.504971    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:54:44.605863 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:44.605831    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"]
Jul 06 21:54:44.606326 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:44.606099    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerName="istio-proxy" containerID="cri-o://6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b" gracePeriod=30
Jul 06 21:54:49.879975 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:49.879915    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:50.026338 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026305    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-credential-socket\") pod \"7f8c3ee7-a783-482e-bd8b-61f89582b815\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") "
Jul 06 21:54:50.026338 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026340    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f8c3ee7-a783-482e-bd8b-61f89582b815-istiod-ca-cert\") pod \"7f8c3ee7-a783-482e-bd8b-61f89582b815\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") "
Jul 06 21:54:50.026600 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026366    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-certs\") pod \"7f8c3ee7-a783-482e-bd8b-61f89582b815\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") "
Jul 06 21:54:50.026600 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026414    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-data\") pod \"7f8c3ee7-a783-482e-bd8b-61f89582b815\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") "
Jul 06 21:54:50.026600 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026470    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpfl6\" (UniqueName: \"kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-kube-api-access-cpfl6\") pod \"7f8c3ee7-a783-482e-bd8b-61f89582b815\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") "
Jul 06 21:54:50.026600 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026489    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-socket\") pod \"7f8c3ee7-a783-482e-bd8b-61f89582b815\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") "
Jul 06 21:54:50.026600 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026516    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-envoy\") pod \"7f8c3ee7-a783-482e-bd8b-61f89582b815\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") "
Jul 06 21:54:50.026600 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026576    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-token\") pod \"7f8c3ee7-a783-482e-bd8b-61f89582b815\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") "
Jul 06 21:54:50.026942 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026609    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-podinfo\") pod \"7f8c3ee7-a783-482e-bd8b-61f89582b815\" (UID: \"7f8c3ee7-a783-482e-bd8b-61f89582b815\") "
Jul 06 21:54:50.026942 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026671    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f8c3ee7-a783-482e-bd8b-61f89582b815" (UID: "7f8c3ee7-a783-482e-bd8b-61f89582b815"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:50.026942 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026724    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f8c3ee7-a783-482e-bd8b-61f89582b815" (UID: "7f8c3ee7-a783-482e-bd8b-61f89582b815"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:50.027117 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026951    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f8c3ee7-a783-482e-bd8b-61f89582b815" (UID: "7f8c3ee7-a783-482e-bd8b-61f89582b815"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:50.027117 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.026983    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f8c3ee7-a783-482e-bd8b-61f89582b815-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f8c3ee7-a783-482e-bd8b-61f89582b815" (UID: "7f8c3ee7-a783-482e-bd8b-61f89582b815"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 21:54:50.027117 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.027019    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-credential-socket\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:50.027117 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.027040    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-certs\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:50.028224 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.028197    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f8c3ee7-a783-482e-bd8b-61f89582b815" (UID: "7f8c3ee7-a783-482e-bd8b-61f89582b815"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:50.028968 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.028950    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f8c3ee7-a783-482e-bd8b-61f89582b815" (UID: "7f8c3ee7-a783-482e-bd8b-61f89582b815"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:54:50.029169 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.029140    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f8c3ee7-a783-482e-bd8b-61f89582b815" (UID: "7f8c3ee7-a783-482e-bd8b-61f89582b815"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:54:50.029381 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.029363    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f8c3ee7-a783-482e-bd8b-61f89582b815" (UID: "7f8c3ee7-a783-482e-bd8b-61f89582b815"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 21:54:50.029442 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.029392    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-kube-api-access-cpfl6" (OuterVolumeSpecName: "kube-api-access-cpfl6") pod "7f8c3ee7-a783-482e-bd8b-61f89582b815" (UID: "7f8c3ee7-a783-482e-bd8b-61f89582b815"). InnerVolumeSpecName "kube-api-access-cpfl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:54:50.128566 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.128530    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-envoy\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:50.128566 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.128560    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-token\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:50.128566 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.128568    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-podinfo\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:50.128566 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.128576    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f8c3ee7-a783-482e-bd8b-61f89582b815-istiod-ca-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:50.128825 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.128585    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-istio-data\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:50.128825 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.128593    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpfl6\" (UniqueName: \"kubernetes.io/projected/7f8c3ee7-a783-482e-bd8b-61f89582b815-kube-api-access-cpfl6\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:50.128825 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.128602    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f8c3ee7-a783-482e-bd8b-61f89582b815-workload-socket\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:54:50.478966 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.478934    2564 generic.go:356] "Generic (PLEG): container finished" podID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerID="6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b" exitCode=0
Jul 06 21:54:50.479149 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.478982    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" event={"ID":"7f8c3ee7-a783-482e-bd8b-61f89582b815","Type":"ContainerDied","Data":"6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b"}
Jul 06 21:54:50.479149 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.479002    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"
Jul 06 21:54:50.479149 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.479024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5" event={"ID":"7f8c3ee7-a783-482e-bd8b-61f89582b815","Type":"ContainerDied","Data":"89dfadfd1ea3f3bb4deb08472cc1f948f5c5b9ca5e958cc4eeef69b50407bd86"}
Jul 06 21:54:50.479149 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.479048    2564 scope.go:117] "RemoveContainer" containerID="6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b"
Jul 06 21:54:50.488205 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.488190    2564 scope.go:117] "RemoveContainer" containerID="6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241"
Jul 06 21:54:50.496072 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.496055    2564 scope.go:117] "RemoveContainer" containerID="6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b"
Jul 06 21:54:50.496363 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:54:50.496343    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b\": container with ID starting with 6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b not found: ID does not exist" containerID="6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b"
Jul 06 21:54:50.496420 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.496379    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b"} err="failed to get container status \"6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b\": rpc error: code = NotFound desc = could not find container \"6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b\": container with ID starting with 6030d98f58da6aae8cbe8b3b8d608df03b3b1b47bc81fc44d8509b4d1020d24b not found: ID does not exist"
Jul 06 21:54:50.496420 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.496397    2564 scope.go:117] "RemoveContainer" containerID="6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241"
Jul 06 21:54:50.496644 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:54:50.496626    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241\": container with ID starting with 6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241 not found: ID does not exist" containerID="6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241"
Jul 06 21:54:50.496698 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.496650    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241"} err="failed to get container status \"6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241\": rpc error: code = NotFound desc = could not find container \"6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241\": container with ID starting with 6fe3fcdd99834aea0be3bf8fe9981b8d5b4b03c5346ddf2afa90c9dcda205241 not found: ID does not exist"
Jul 06 21:54:50.506170 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.506149    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"]
Jul 06 21:54:50.511416 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:50.511393    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-70ee2a-openshift-default-85d8658cc-p4pv5"]
Jul 06 21:54:52.063457 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:52.063423    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" path="/var/lib/kubelet/pods/7f8c3ee7-a783-482e-bd8b-61f89582b815/volumes"
Jul 06 21:54:53.527802 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.527769    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"]
Jul 06 21:54:53.528309 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.528200    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy"
Jul 06 21:54:53.528309 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.528212    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4543e79a-0a0a-4ea2-8041-0a21119d7b2d" containerName="istio-proxy"
Jul 06 21:54:53.528309 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.528220    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerName="istio-proxy"
Jul 06 21:54:53.528309 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.528225    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerName="istio-proxy"
Jul 06 21:54:53.528309 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.528235    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerName="istio-proxy"
Jul 06 21:54:53.528309 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.528242    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerName="istio-proxy"
Jul 06 21:54:53.528653 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.528316    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerName="istio-proxy"
Jul 06 21:54:53.528653 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.528325    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f8c3ee7-a783-482e-bd8b-61f89582b815" containerName="istio-proxy"
Jul 06 21:54:53.532685 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.532668    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.535758 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.535731    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d392e3-openshift-default-dockercfg-v6g2f\""
Jul 06 21:54:53.545480 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.545458    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"]
Jul 06 21:54:53.661364 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.661331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-token\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.661540 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.661376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-certs\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.661540 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.661442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-data\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.661540 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.661479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0668b6c-8973-4ccb-bb70-aad858f64495-istiod-ca-cert\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.661540 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.661523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-podinfo\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.661709 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.661596    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-credential-socket\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.661709 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.661623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmxh9\" (UniqueName: \"kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-kube-api-access-zmxh9\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.661709 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.661654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-socket\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.661709 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.661682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-envoy\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.762303 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.762272    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-envoy\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.762494 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.762320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-token\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.762494 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.762343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-certs\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.762494 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.762469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-data\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.762661 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.762514    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0668b6c-8973-4ccb-bb70-aad858f64495-istiod-ca-cert\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.762661 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.762578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-podinfo\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.762762 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.762717    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-certs\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.762826 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.762797    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-data\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.763087 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.763045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-credential-socket\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.763184 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.763111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmxh9\" (UniqueName: \"kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-kube-api-access-zmxh9\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.763248 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.763178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-socket\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.763470 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.763285    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-credential-socket\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.763470 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.763318    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0668b6c-8973-4ccb-bb70-aad858f64495-istiod-ca-cert\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.763470 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.763411    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-socket\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.764797 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.764777    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-envoy\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.765222 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.765200    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-podinfo\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.774773 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.774735    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-token\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.777774 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.777748    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmxh9\" (UniqueName: \"kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-kube-api-access-zmxh9\") pod \"e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") " pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.845205 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.845111    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:53.919698 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.919669    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:54:53.997465 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:53.997440    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"]
Jul 06 21:54:53.998584 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:54:53.998556    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0668b6c_8973_4ccb_bb70_aad858f64495.slice/crio-b6aef5b75a1597a4765475450873bd39743caa4b2f7f992297d60e2e71f0030b WatchSource:0}: Error finding container b6aef5b75a1597a4765475450873bd39743caa4b2f7f992297d60e2e71f0030b: Status 404 returned error can't find the container with id b6aef5b75a1597a4765475450873bd39743caa4b2f7f992297d60e2e71f0030b
Jul 06 21:54:54.000772 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:54.000744    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:54:54.000849 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:54.000802    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:54:54.000849 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:54.000830    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:54:54.503204 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:54.503171    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" event={"ID":"f0668b6c-8973-4ccb-bb70-aad858f64495","Type":"ContainerStarted","Data":"c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937"}
Jul 06 21:54:54.503391 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:54.503220    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" event={"ID":"f0668b6c-8973-4ccb-bb70-aad858f64495","Type":"ContainerStarted","Data":"b6aef5b75a1597a4765475450873bd39743caa4b2f7f992297d60e2e71f0030b"}
Jul 06 21:54:54.526850 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:54.526796    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" podStartSLOduration=1.526779806 podStartE2EDuration="1.526779806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:54:54.524730506 +0000 UTC m=+2002.997928125" watchObservedRunningTime="2026-07-06 21:54:54.526779806 +0000 UTC m=+2002.999977427"
Jul 06 21:54:54.845953 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:54.845877    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:55.851397 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:55.851368    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:56.517337 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:56.517307    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:54:56.518332 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:54:56.518308    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:55:06.903082 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:06.903047    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:55:07.587382 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:07.587349    2564 generic.go:356] "Generic (PLEG): container finished" podID="f0668b6c-8973-4ccb-bb70-aad858f64495" containerID="c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937" exitCode=0
Jul 06 21:55:07.587586 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:07.587421    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" event={"ID":"f0668b6c-8973-4ccb-bb70-aad858f64495","Type":"ContainerDied","Data":"c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937"}
Jul 06 21:55:07.587826 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:07.587813    2564 scope.go:117] "RemoveContainer" containerID="c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937"
Jul 06 21:55:07.588838 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:07.588813    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:55:07.588928 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:07.588893    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:55:07.588975 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:07.588959    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 06 21:55:08.594142 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:08.594105    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" event={"ID":"f0668b6c-8973-4ccb-bb70-aad858f64495","Type":"ContainerStarted","Data":"df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485"}
Jul 06 21:55:08.845636 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:08.845538    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:55:08.846980 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:08.846949    2564 patch_prober.go:28] interesting pod/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 06 21:55:08.847120 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:08.847022    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" podUID="f0668b6c-8973-4ccb-bb70-aad858f64495" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 06 21:55:09.846131 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:09.846088    2564 patch_prober.go:28] interesting pod/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 06 21:55:09.846749 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:09.846155    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" podUID="f0668b6c-8973-4ccb-bb70-aad858f64495" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 06 21:55:10.846342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:10.846296    2564 patch_prober.go:28] interesting pod/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 06 21:55:10.846870 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:10.846380    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" podUID="f0668b6c-8973-4ccb-bb70-aad858f64495" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 06 21:55:11.517264 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:11.517234    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:55:11.846164 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:11.846065    2564 patch_prober.go:28] interesting pod/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 06 21:55:11.846164 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:11.846151    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" podUID="f0668b6c-8973-4ccb-bb70-aad858f64495" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 06 21:55:12.850182 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:12.850151    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:55:12.851264 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:12.851246    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 21:55:20.505852 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:20.505817    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:55:55.027516 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.027433    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"]
Jul 06 21:55:55.032368 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.032342    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.035563 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.035545    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"auth-test-model-d392e3-kserve-self-signed-certs\""
Jul 06 21:55:55.036532 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.036513    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"openshift-service-ca.crt\""
Jul 06 21:55:55.036633 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.036587    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"kube-root-ca.crt\""
Jul 06 21:55:55.036697 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.036587    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"default-dockercfg-g624z\""
Jul 06 21:55:55.040952 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.040929    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"]
Jul 06 21:55:55.138294 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.138259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-home\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.138294 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.138296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-dshm\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.138487 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.138367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tls-certs\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.138487 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.138402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv77t\" (UniqueName: \"kubernetes.io/projected/ef90f80e-fc81-4a02-81b0-2253b869fbe3-kube-api-access-fv77t\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.138487 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.138454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-model-cache\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.138593 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.138491    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tmp-dir\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.239566 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.239534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-home\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.239566 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.239571    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-dshm\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.239833 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.239611    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tls-certs\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.239833 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.239631    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv77t\" (UniqueName: \"kubernetes.io/projected/ef90f80e-fc81-4a02-81b0-2253b869fbe3-kube-api-access-fv77t\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.239833 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.239677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-model-cache\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.239833 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.239734    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tmp-dir\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.240089 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.240021    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-home\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.240155 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.240122    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-model-cache\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.240456 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.240430    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tmp-dir\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.242639 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.242612    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-dshm\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.242893 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.242871    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tls-certs\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.251268 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.251230    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv77t\" (UniqueName: \"kubernetes.io/projected/ef90f80e-fc81-4a02-81b0-2253b869fbe3-kube-api-access-fv77t\") pod \"auth-test-model-d392e3-kserve-6686bdd4cf-p72q7\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") " pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.343010 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.342914    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:55:55.484687 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.484662    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"]
Jul 06 21:55:55.486704 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:55:55.486678    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef90f80e_fc81_4a02_81b0_2253b869fbe3.slice/crio-9d09efeb51d26236593b4df590f3447071d75bdfb41dce5ac599b7765f3a60cb WatchSource:0}: Error finding container 9d09efeb51d26236593b4df590f3447071d75bdfb41dce5ac599b7765f3a60cb: Status 404 returned error can't find the container with id 9d09efeb51d26236593b4df590f3447071d75bdfb41dce5ac599b7765f3a60cb
Jul 06 21:55:55.842830 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.842795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7" event={"ID":"ef90f80e-fc81-4a02-81b0-2253b869fbe3","Type":"ContainerStarted","Data":"f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69"}
Jul 06 21:55:55.843053 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.842840    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7" event={"ID":"ef90f80e-fc81-4a02-81b0-2253b869fbe3","Type":"ContainerStarted","Data":"9d09efeb51d26236593b4df590f3447071d75bdfb41dce5ac599b7765f3a60cb"}
Jul 06 21:55:55.862001 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:55.861951    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7" podStartSLOduration=0.861936663 podStartE2EDuration="861.936663ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:55:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:55:55.860880308 +0000 UTC m=+2064.334077929" watchObservedRunningTime="2026-07-06 21:55:55.861936663 +0000 UTC m=+2064.335134282"
Jul 06 21:55:58.505870 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:55:58.505834    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:56:05.343561 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:56:05.343523    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:56:05.344082 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:56:05.343577    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:56:05.356534 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:56:05.356512    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:56:05.914342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:56:05.914309    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:56:15.016066 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:56:15.016033    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:56:29.021379 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:56:29.021344    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:56:32.132973 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:56:32.132944    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:56:32.140924 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:56:32.140880    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 21:56:45.303892 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:56:45.303844    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:56:58.704302 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:56:58.704261    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:57:15.600727 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:57:15.600697    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:57:32.502809 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:57:32.502716    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:57:47.807512 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:57:47.807479    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"]
Jul 06 21:57:49.697883 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:57:49.697847    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:58:02.829124 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:02.829064    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7" podUID="ef90f80e-fc81-4a02-81b0-2253b869fbe3" containerName="main" containerID="cri-o://f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69" gracePeriod=45
Jul 06 21:58:03.094203 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.094146    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:58:03.202437 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.202406    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-model-cache\") pod \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") "
Jul 06 21:58:03.202616 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.202455    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-dshm\") pod \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") "
Jul 06 21:58:03.202616 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.202483    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-home\") pod \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") "
Jul 06 21:58:03.202616 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.202518    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tmp-dir\") pod \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") "
Jul 06 21:58:03.202616 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.202583    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv77t\" (UniqueName: \"kubernetes.io/projected/ef90f80e-fc81-4a02-81b0-2253b869fbe3-kube-api-access-fv77t\") pod \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") "
Jul 06 21:58:03.202829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.202631    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tls-certs\") pod \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\" (UID: \"ef90f80e-fc81-4a02-81b0-2253b869fbe3\") "
Jul 06 21:58:03.202829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.202653    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef90f80e-fc81-4a02-81b0-2253b869fbe3" (UID: "ef90f80e-fc81-4a02-81b0-2253b869fbe3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:58:03.202829 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.202763    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-home" (OuterVolumeSpecName: "home") pod "ef90f80e-fc81-4a02-81b0-2253b869fbe3" (UID: "ef90f80e-fc81-4a02-81b0-2253b869fbe3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:58:03.203013 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.202878    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef90f80e-fc81-4a02-81b0-2253b869fbe3" (UID: "ef90f80e-fc81-4a02-81b0-2253b869fbe3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:58:03.203013 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.202980    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-model-cache\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:58:03.203013 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.202993    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-home\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:58:03.203013 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.203001    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tmp-dir\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:58:03.204881 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.204858    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-dshm" (OuterVolumeSpecName: "dshm") pod "ef90f80e-fc81-4a02-81b0-2253b869fbe3" (UID: "ef90f80e-fc81-4a02-81b0-2253b869fbe3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:58:03.205009 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.204926    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef90f80e-fc81-4a02-81b0-2253b869fbe3" (UID: "ef90f80e-fc81-4a02-81b0-2253b869fbe3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:58:03.205009 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.204934    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef90f80e-fc81-4a02-81b0-2253b869fbe3-kube-api-access-fv77t" (OuterVolumeSpecName: "kube-api-access-fv77t") pod "ef90f80e-fc81-4a02-81b0-2253b869fbe3" (UID: "ef90f80e-fc81-4a02-81b0-2253b869fbe3"). InnerVolumeSpecName "kube-api-access-fv77t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:58:03.303983 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.303951    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef90f80e-fc81-4a02-81b0-2253b869fbe3-dshm\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:58:03.303983 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.303977    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv77t\" (UniqueName: \"kubernetes.io/projected/ef90f80e-fc81-4a02-81b0-2253b869fbe3-kube-api-access-fv77t\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:58:03.303983 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.303988    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef90f80e-fc81-4a02-81b0-2253b869fbe3-tls-certs\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:58:03.508558 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.508530    2564 generic.go:356] "Generic (PLEG): container finished" podID="ef90f80e-fc81-4a02-81b0-2253b869fbe3" containerID="f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69" exitCode=0
Jul 06 21:58:03.508728 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.508572    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"
Jul 06 21:58:03.508728 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.508611    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7" event={"ID":"ef90f80e-fc81-4a02-81b0-2253b869fbe3","Type":"ContainerDied","Data":"f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69"}
Jul 06 21:58:03.508728 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.508653    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7" event={"ID":"ef90f80e-fc81-4a02-81b0-2253b869fbe3","Type":"ContainerDied","Data":"9d09efeb51d26236593b4df590f3447071d75bdfb41dce5ac599b7765f3a60cb"}
Jul 06 21:58:03.508728 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.508670    2564 scope.go:117] "RemoveContainer" containerID="f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69"
Jul 06 21:58:03.518482 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.518468    2564 scope.go:117] "RemoveContainer" containerID="f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69"
Jul 06 21:58:03.518732 ip-10-0-128-90 kubenswrapper[2564]: E0706 21:58:03.518712    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69\": container with ID starting with f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69 not found: ID does not exist" containerID="f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69"
Jul 06 21:58:03.518804 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.518740    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69"} err="failed to get container status \"f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69\": rpc error: code = NotFound desc = could not find container \"f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69\": container with ID starting with f20a0c941a31dde5a45bd650922a38288daf6ee240e1b8918074059f2c727a69 not found: ID does not exist"
Jul 06 21:58:03.530427 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.530402    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"]
Jul 06 21:58:03.534669 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.534651    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/auth-test-model-d392e3-kserve-6686bdd4cf-p72q7"]
Jul 06 21:58:03.800111 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:03.800031    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:58:04.063950 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:04.063855    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef90f80e-fc81-4a02-81b0-2253b869fbe3" path="/var/lib/kubelet/pods/ef90f80e-fc81-4a02-81b0-2253b869fbe3/volumes"
Jul 06 21:58:15.202638 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:15.202600    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:58:37.810053 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.810017    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"]
Jul 06 21:58:37.810524 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.810424    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef90f80e-fc81-4a02-81b0-2253b869fbe3" containerName="main"
Jul 06 21:58:37.810524 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.810435    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef90f80e-fc81-4a02-81b0-2253b869fbe3" containerName="main"
Jul 06 21:58:37.810524 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.810508    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef90f80e-fc81-4a02-81b0-2253b869fbe3" containerName="main"
Jul 06 21:58:37.813547 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.813532    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:37.817281 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.817257    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"sub-test-model-d392e3-kserve-self-signed-certs\""
Jul 06 21:58:37.817424 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.817291    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"openshift-service-ca.crt\""
Jul 06 21:58:37.817424 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.817265    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"kube-root-ca.crt\""
Jul 06 21:58:37.817540 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.817434    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d392e3\"/\"default-dockercfg-g624z\""
Jul 06 21:58:37.823094 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.823073    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"]
Jul 06 21:58:37.921167 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.921132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce520938-cf48-4fb4-979d-ffad69a551e8-tls-certs\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:37.921357 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.921193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-tmp-dir\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:37.921357 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.921286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-home\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:37.921357 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.921314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bcqh\" (UniqueName: \"kubernetes.io/projected/ce520938-cf48-4fb4-979d-ffad69a551e8-kube-api-access-4bcqh\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:37.921489 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.921370    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-dshm\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:37.921489 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:37.921432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-model-cache\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.022980 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.022949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-tmp-dir\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.023184 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.023000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-home\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.023184 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.023130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bcqh\" (UniqueName: \"kubernetes.io/projected/ce520938-cf48-4fb4-979d-ffad69a551e8-kube-api-access-4bcqh\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.023316 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.023239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-dshm\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.023375 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.023328    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-model-cache\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.023375 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.023362    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-tmp-dir\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.023481 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.023366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce520938-cf48-4fb4-979d-ffad69a551e8-tls-certs\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.023481 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.023404    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-home\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.023730 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.023703    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-model-cache\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.025776 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.025749    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-dshm\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.025935 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.025915    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce520938-cf48-4fb4-979d-ffad69a551e8-tls-certs\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.031723 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.031702    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bcqh\" (UniqueName: \"kubernetes.io/projected/ce520938-cf48-4fb4-979d-ffad69a551e8-kube-api-access-4bcqh\") pod \"sub-test-model-d392e3-kserve-9dff5c56c-v4vhs\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") " pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.124729 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.124647    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:38.265693 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.265667    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"]
Jul 06 21:58:38.267071 ip-10-0-128-90 kubenswrapper[2564]: W0706 21:58:38.267043    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce520938_cf48_4fb4_979d_ffad69a551e8.slice/crio-2522b0d3e528cac554c3d5059dc2923ccc867330069966b1d37eb86740d0c26d WatchSource:0}: Error finding container 2522b0d3e528cac554c3d5059dc2923ccc867330069966b1d37eb86740d0c26d: Status 404 returned error can't find the container with id 2522b0d3e528cac554c3d5059dc2923ccc867330069966b1d37eb86740d0c26d
Jul 06 21:58:38.699217 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.699179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs" event={"ID":"ce520938-cf48-4fb4-979d-ffad69a551e8","Type":"ContainerStarted","Data":"850c3fd8572137024b18034efe8adf42f2fcbf8241af54ad9471cd48ebaad24f"}
Jul 06 21:58:38.699396 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.699223    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs" event={"ID":"ce520938-cf48-4fb4-979d-ffad69a551e8","Type":"ContainerStarted","Data":"2522b0d3e528cac554c3d5059dc2923ccc867330069966b1d37eb86740d0c26d"}
Jul 06 21:58:38.722000 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:38.721950    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs" podStartSLOduration=1.7219356160000001 podStartE2EDuration="1.721935616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 21:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 21:58:38.721585217 +0000 UTC m=+2227.194782837" watchObservedRunningTime="2026-07-06 21:58:38.721935616 +0000 UTC m=+2227.195133230"
Jul 06 21:58:41.906062 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:41.906025    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:58:48.125487 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:48.125438    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:48.125487 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:48.125490    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:48.138112 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:48.138090    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:48.763004 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:48.762977    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:58:55.424301 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:58:55.424221    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:59:12.787810 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:12.787768    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"]
Jul 06 21:59:16.109746 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:16.109714    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 21:59:27.808779 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:27.808718    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs" podUID="ce520938-cf48-4fb4-979d-ffad69a551e8" containerName="main" containerID="cri-o://850c3fd8572137024b18034efe8adf42f2fcbf8241af54ad9471cd48ebaad24f" gracePeriod=45
Jul 06 21:59:27.960871 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:27.960841    2564 generic.go:356] "Generic (PLEG): container finished" podID="ce520938-cf48-4fb4-979d-ffad69a551e8" containerID="850c3fd8572137024b18034efe8adf42f2fcbf8241af54ad9471cd48ebaad24f" exitCode=0
Jul 06 21:59:27.961051 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:27.960918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs" event={"ID":"ce520938-cf48-4fb4-979d-ffad69a551e8","Type":"ContainerDied","Data":"850c3fd8572137024b18034efe8adf42f2fcbf8241af54ad9471cd48ebaad24f"}
Jul 06 21:59:28.058154 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.058127    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:59:28.099856 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.099794    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-home\") pod \"ce520938-cf48-4fb4-979d-ffad69a551e8\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") "
Jul 06 21:59:28.099856 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.099850    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce520938-cf48-4fb4-979d-ffad69a551e8-tls-certs\") pod \"ce520938-cf48-4fb4-979d-ffad69a551e8\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") "
Jul 06 21:59:28.100070 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.099885    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bcqh\" (UniqueName: \"kubernetes.io/projected/ce520938-cf48-4fb4-979d-ffad69a551e8-kube-api-access-4bcqh\") pod \"ce520938-cf48-4fb4-979d-ffad69a551e8\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") "
Jul 06 21:59:28.100070 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.099967    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-tmp-dir\") pod \"ce520938-cf48-4fb4-979d-ffad69a551e8\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") "
Jul 06 21:59:28.100070 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.100002    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-model-cache\") pod \"ce520938-cf48-4fb4-979d-ffad69a551e8\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") "
Jul 06 21:59:28.100070 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.100042    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-dshm\") pod \"ce520938-cf48-4fb4-979d-ffad69a551e8\" (UID: \"ce520938-cf48-4fb4-979d-ffad69a551e8\") "
Jul 06 21:59:28.100324 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.100128    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-home" (OuterVolumeSpecName: "home") pod "ce520938-cf48-4fb4-979d-ffad69a551e8" (UID: "ce520938-cf48-4fb4-979d-ffad69a551e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:59:28.100324 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.100244    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ce520938-cf48-4fb4-979d-ffad69a551e8" (UID: "ce520938-cf48-4fb4-979d-ffad69a551e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:59:28.100445 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.100318    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "ce520938-cf48-4fb4-979d-ffad69a551e8" (UID: "ce520938-cf48-4fb4-979d-ffad69a551e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:59:28.100655 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.100638    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-home\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:59:28.100744 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.100658    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-tmp-dir\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:59:28.100802 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.100756    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-model-cache\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:59:28.102314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.102285    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce520938-cf48-4fb4-979d-ffad69a551e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ce520938-cf48-4fb4-979d-ffad69a551e8" (UID: "ce520938-cf48-4fb4-979d-ffad69a551e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 21:59:28.102314 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.102300    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-dshm" (OuterVolumeSpecName: "dshm") pod "ce520938-cf48-4fb4-979d-ffad69a551e8" (UID: "ce520938-cf48-4fb4-979d-ffad69a551e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 21:59:28.102445 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.102384    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce520938-cf48-4fb4-979d-ffad69a551e8-kube-api-access-4bcqh" (OuterVolumeSpecName: "kube-api-access-4bcqh") pod "ce520938-cf48-4fb4-979d-ffad69a551e8" (UID: "ce520938-cf48-4fb4-979d-ffad69a551e8"). InnerVolumeSpecName "kube-api-access-4bcqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 21:59:28.202059 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.202030    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce520938-cf48-4fb4-979d-ffad69a551e8-tls-certs\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:59:28.202059 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.202056    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bcqh\" (UniqueName: \"kubernetes.io/projected/ce520938-cf48-4fb4-979d-ffad69a551e8-kube-api-access-4bcqh\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:59:28.202059 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.202065    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce520938-cf48-4fb4-979d-ffad69a551e8-dshm\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 21:59:28.967720 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.967682    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs" event={"ID":"ce520938-cf48-4fb4-979d-ffad69a551e8","Type":"ContainerDied","Data":"2522b0d3e528cac554c3d5059dc2923ccc867330069966b1d37eb86740d0c26d"}
Jul 06 21:59:28.967720 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.967704    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"
Jul 06 21:59:28.968259 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.967733    2564 scope.go:117] "RemoveContainer" containerID="850c3fd8572137024b18034efe8adf42f2fcbf8241af54ad9471cd48ebaad24f"
Jul 06 21:59:28.991174 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.991145    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"]
Jul 06 21:59:28.993037 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:28.993017    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d392e3/sub-test-model-d392e3-kserve-9dff5c56c-v4vhs"]
Jul 06 21:59:30.063342 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:30.063310    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce520938-cf48-4fb4-979d-ffad69a551e8" path="/var/lib/kubelet/pods/ce520938-cf48-4fb4-979d-ffad69a551e8/volumes"
Jul 06 21:59:40.207265 ip-10-0-128-90 kubenswrapper[2564]: I0706 21:59:40.207228    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 22:00:00.137781 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.137749    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722920-5dwvq"]
Jul 06 22:00:00.138213 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.138172    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce520938-cf48-4fb4-979d-ffad69a551e8" containerName="main"
Jul 06 22:00:00.138213 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.138183    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce520938-cf48-4fb4-979d-ffad69a551e8" containerName="main"
Jul 06 22:00:00.138289 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.138252    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce520938-cf48-4fb4-979d-ffad69a551e8" containerName="main"
Jul 06 22:00:00.142749 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.142729    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq"
Jul 06 22:00:00.145527 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.145510    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cxwgs\""
Jul 06 22:00:00.152194 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.152169    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722920-5dwvq"]
Jul 06 22:00:00.306035 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.305996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j69h\" (UniqueName: \"kubernetes.io/projected/6b4594cf-3471-44bd-b37c-1e74fcfc7694-kube-api-access-6j69h\") pod \"maas-api-key-cleanup-29722920-5dwvq\" (UID: \"6b4594cf-3471-44bd-b37c-1e74fcfc7694\") " pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq"
Jul 06 22:00:00.407791 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.407701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j69h\" (UniqueName: \"kubernetes.io/projected/6b4594cf-3471-44bd-b37c-1e74fcfc7694-kube-api-access-6j69h\") pod \"maas-api-key-cleanup-29722920-5dwvq\" (UID: \"6b4594cf-3471-44bd-b37c-1e74fcfc7694\") " pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq"
Jul 06 22:00:00.418131 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.418099    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j69h\" (UniqueName: \"kubernetes.io/projected/6b4594cf-3471-44bd-b37c-1e74fcfc7694-kube-api-access-6j69h\") pod \"maas-api-key-cleanup-29722920-5dwvq\" (UID: \"6b4594cf-3471-44bd-b37c-1e74fcfc7694\") " pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq"
Jul 06 22:00:00.453855 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.453831    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq"
Jul 06 22:00:00.591921 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.591855    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722920-5dwvq"]
Jul 06 22:00:00.594039 ip-10-0-128-90 kubenswrapper[2564]: W0706 22:00:00.594005    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4594cf_3471_44bd_b37c_1e74fcfc7694.slice/crio-604cfb5828ed96e3b73ace98602ff26584f898cf53fb076c44ef725e71b27bcf WatchSource:0}: Error finding container 604cfb5828ed96e3b73ace98602ff26584f898cf53fb076c44ef725e71b27bcf: Status 404 returned error can't find the container with id 604cfb5828ed96e3b73ace98602ff26584f898cf53fb076c44ef725e71b27bcf
Jul 06 22:00:00.596474 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:00.596448    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 22:00:01.140085 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:01.140049    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq" event={"ID":"6b4594cf-3471-44bd-b37c-1e74fcfc7694","Type":"ContainerStarted","Data":"604cfb5828ed96e3b73ace98602ff26584f898cf53fb076c44ef725e71b27bcf"}
Jul 06 22:00:06.171020 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:06.170983    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq" event={"ID":"6b4594cf-3471-44bd-b37c-1e74fcfc7694","Type":"ContainerStarted","Data":"b66314c1ae8aaf24a2be79d87c2fc102100851d00b5cb7f5e81ea704e38dccb7"}
Jul 06 22:00:06.189635 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:06.189583    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq" podStartSLOduration=1.391977015 podStartE2EDuration="6.189566659s" totalImagesPullingTime="4.797589644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 22:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:00:06.188163556 +0000 UTC m=+2314.661361172" watchObservedRunningTime="2026-07-06 22:00:06.189566659 +0000 UTC m=+2314.662764279"
Jul 06 22:00:06.904523 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:06.904488    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 22:00:07.178538 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:07.178364    2564 generic.go:356] "Generic (PLEG): container finished" podID="6b4594cf-3471-44bd-b37c-1e74fcfc7694" containerID="b66314c1ae8aaf24a2be79d87c2fc102100851d00b5cb7f5e81ea704e38dccb7" exitCode=0
Jul 06 22:00:07.178538 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:07.178445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq" event={"ID":"6b4594cf-3471-44bd-b37c-1e74fcfc7694","Type":"ContainerDied","Data":"b66314c1ae8aaf24a2be79d87c2fc102100851d00b5cb7f5e81ea704e38dccb7"}
Jul 06 22:00:08.325805 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:08.325780    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq"
Jul 06 22:00:08.377405 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:08.377372    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j69h\" (UniqueName: \"kubernetes.io/projected/6b4594cf-3471-44bd-b37c-1e74fcfc7694-kube-api-access-6j69h\") pod \"6b4594cf-3471-44bd-b37c-1e74fcfc7694\" (UID: \"6b4594cf-3471-44bd-b37c-1e74fcfc7694\") "
Jul 06 22:00:08.379600 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:08.379574    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b4594cf-3471-44bd-b37c-1e74fcfc7694-kube-api-access-6j69h" (OuterVolumeSpecName: "kube-api-access-6j69h") pod "6b4594cf-3471-44bd-b37c-1e74fcfc7694" (UID: "6b4594cf-3471-44bd-b37c-1e74fcfc7694"). InnerVolumeSpecName "kube-api-access-6j69h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:00:08.478140 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:08.478111    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j69h\" (UniqueName: \"kubernetes.io/projected/6b4594cf-3471-44bd-b37c-1e74fcfc7694-kube-api-access-6j69h\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 22:00:09.191510 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:09.191484    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq"
Jul 06 22:00:09.191679 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:09.191529    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722920-5dwvq" event={"ID":"6b4594cf-3471-44bd-b37c-1e74fcfc7694","Type":"ContainerDied","Data":"604cfb5828ed96e3b73ace98602ff26584f898cf53fb076c44ef725e71b27bcf"}
Jul 06 22:00:09.191679 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:09.191575    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="604cfb5828ed96e3b73ace98602ff26584f898cf53fb076c44ef725e71b27bcf"
Jul 06 22:00:21.003671 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:21.003638    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 22:00:35.202224 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:35.202143    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 22:00:47.809129 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:00:47.809091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 22:01:30.200013 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:30.199981    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wf78w"]
Jul 06 22:01:32.169975 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:32.169950    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 22:01:32.178874 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:32.178853    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d2nlk_f7957755-15f5-4903-b1e7-b434c3fdecee/ovn-acl-logging/0.log"
Jul 06 22:01:34.143990 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:34.143952    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"]
Jul 06 22:01:34.144420 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:34.144277    2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" podUID="f0668b6c-8973-4ccb-bb70-aad858f64495" containerName="istio-proxy" containerID="cri-o://df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485" gracePeriod=30
Jul 06 22:01:39.404089 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.404067    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 22:01:39.430712 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.430638    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0668b6c-8973-4ccb-bb70-aad858f64495-istiod-ca-cert\") pod \"f0668b6c-8973-4ccb-bb70-aad858f64495\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") "
Jul 06 22:01:39.430712 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.430686    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-data\") pod \"f0668b6c-8973-4ccb-bb70-aad858f64495\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") "
Jul 06 22:01:39.430970 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.430723    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmxh9\" (UniqueName: \"kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-kube-api-access-zmxh9\") pod \"f0668b6c-8973-4ccb-bb70-aad858f64495\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") "
Jul 06 22:01:39.430970 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.430745    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-credential-socket\") pod \"f0668b6c-8973-4ccb-bb70-aad858f64495\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") "
Jul 06 22:01:39.430970 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.430770    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-certs\") pod \"f0668b6c-8973-4ccb-bb70-aad858f64495\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") "
Jul 06 22:01:39.430970 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.430797    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-podinfo\") pod \"f0668b6c-8973-4ccb-bb70-aad858f64495\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") "
Jul 06 22:01:39.430970 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.430844    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-envoy\") pod \"f0668b6c-8973-4ccb-bb70-aad858f64495\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") "
Jul 06 22:01:39.430970 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.430872    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-token\") pod \"f0668b6c-8973-4ccb-bb70-aad858f64495\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") "
Jul 06 22:01:39.430970 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.430954    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-socket\") pod \"f0668b6c-8973-4ccb-bb70-aad858f64495\" (UID: \"f0668b6c-8973-4ccb-bb70-aad858f64495\") "
Jul 06 22:01:39.431337 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.431059    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f0668b6c-8973-4ccb-bb70-aad858f64495" (UID: "f0668b6c-8973-4ccb-bb70-aad858f64495"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:01:39.431337 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.431078    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f0668b6c-8973-4ccb-bb70-aad858f64495" (UID: "f0668b6c-8973-4ccb-bb70-aad858f64495"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:01:39.431337 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.431125    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0668b6c-8973-4ccb-bb70-aad858f64495-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f0668b6c-8973-4ccb-bb70-aad858f64495" (UID: "f0668b6c-8973-4ccb-bb70-aad858f64495"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 22:01:39.431337 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.431272    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f0668b6c-8973-4ccb-bb70-aad858f64495" (UID: "f0668b6c-8973-4ccb-bb70-aad858f64495"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:01:39.431724 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.431359    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-socket\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 22:01:39.431724 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.431378    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f0668b6c-8973-4ccb-bb70-aad858f64495-istiod-ca-cert\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 22:01:39.431724 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.431393    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-credential-socket\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 22:01:39.431724 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.431406    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-workload-certs\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 22:01:39.431724 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.431534    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-data" (OuterVolumeSpecName: "istio-data") pod "f0668b6c-8973-4ccb-bb70-aad858f64495" (UID: "f0668b6c-8973-4ccb-bb70-aad858f64495"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:01:39.433316 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.433289    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-kube-api-access-zmxh9" (OuterVolumeSpecName: "kube-api-access-zmxh9") pod "f0668b6c-8973-4ccb-bb70-aad858f64495" (UID: "f0668b6c-8973-4ccb-bb70-aad858f64495"). InnerVolumeSpecName "kube-api-access-zmxh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:01:39.433316 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.433296    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-token" (OuterVolumeSpecName: "istio-token") pod "f0668b6c-8973-4ccb-bb70-aad858f64495" (UID: "f0668b6c-8973-4ccb-bb70-aad858f64495"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 22:01:39.433316 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.433306    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f0668b6c-8973-4ccb-bb70-aad858f64495" (UID: "f0668b6c-8973-4ccb-bb70-aad858f64495"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 22:01:39.433495 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.433342    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f0668b6c-8973-4ccb-bb70-aad858f64495" (UID: "f0668b6c-8973-4ccb-bb70-aad858f64495"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 22:01:39.532471 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.532441    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-podinfo\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 22:01:39.532471 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.532467    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-envoy\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 22:01:39.532471 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.532476    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-token\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 22:01:39.532717 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.532483    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f0668b6c-8973-4ccb-bb70-aad858f64495-istio-data\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 22:01:39.532717 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.532509    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmxh9\" (UniqueName: \"kubernetes.io/projected/f0668b6c-8973-4ccb-bb70-aad858f64495-kube-api-access-zmxh9\") on node \"ip-10-0-128-90.ec2.internal\" DevicePath \"\""
Jul 06 22:01:39.575657 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.575613    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qfxbw_c5f08460-315d-4ad6-b50d-58ccb852e4c6/manager/0.log"
Jul 06 22:01:39.682357 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.682260    2564 generic.go:356] "Generic (PLEG): container finished" podID="f0668b6c-8973-4ccb-bb70-aad858f64495" containerID="df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485" exitCode=0
Jul 06 22:01:39.682357 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.682337    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"
Jul 06 22:01:39.682357 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.682346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" event={"ID":"f0668b6c-8973-4ccb-bb70-aad858f64495","Type":"ContainerDied","Data":"df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485"}
Jul 06 22:01:39.682577 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.682426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph" event={"ID":"f0668b6c-8973-4ccb-bb70-aad858f64495","Type":"ContainerDied","Data":"b6aef5b75a1597a4765475450873bd39743caa4b2f7f992297d60e2e71f0030b"}
Jul 06 22:01:39.682577 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.682450    2564 scope.go:117] "RemoveContainer" containerID="df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485"
Jul 06 22:01:39.693668 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.693648    2564 scope.go:117] "RemoveContainer" containerID="c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937"
Jul 06 22:01:39.695071 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.695053    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mmrnl_a331790a-702d-44b2-b49f-b3320b3b8789/manager/0.log"
Jul 06 22:01:39.702149 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.702127    2564 scope.go:117] "RemoveContainer" containerID="df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485"
Jul 06 22:01:39.702397 ip-10-0-128-90 kubenswrapper[2564]: E0706 22:01:39.702378    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485\": container with ID starting with df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485 not found: ID does not exist" containerID="df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485"
Jul 06 22:01:39.702448 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.702406    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485"} err="failed to get container status \"df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485\": rpc error: code = NotFound desc = could not find container \"df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485\": container with ID starting with df76a42ab8de3dfd6d1abe704fe0cb608c4190c5dc4e616e54915fedad6b5485 not found: ID does not exist"
Jul 06 22:01:39.702448 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.702423    2564 scope.go:117] "RemoveContainer" containerID="c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937"
Jul 06 22:01:39.702666 ip-10-0-128-90 kubenswrapper[2564]: E0706 22:01:39.702648    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937\": container with ID starting with c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937 not found: ID does not exist" containerID="c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937"
Jul 06 22:01:39.702706 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.702671    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937"} err="failed to get container status \"c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937\": rpc error: code = NotFound desc = could not find container \"c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937\": container with ID starting with c25310631e37d9be05ccb3a67c9487b335170db869700703781b26025611f937 not found: ID does not exist"
Jul 06 22:01:39.706569 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.706549    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"]
Jul 06 22:01:39.710061 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:39.710040    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d392e3-openshift-default-65575b9c87-5tbph"]
Jul 06 22:01:40.035558 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:40.035531    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722920-5dwvq_6b4594cf-3471-44bd-b37c-1e74fcfc7694/cleanup/0.log"
Jul 06 22:01:40.062835 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:40.062803    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0668b6c-8973-4ccb-bb70-aad858f64495" path="/var/lib/kubelet/pods/f0668b6c-8973-4ccb-bb70-aad858f64495/volumes"
Jul 06 22:01:40.384031 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:40.383964    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2drdg_a4f68832-5144-4146-bdc0-7783c67b74e5/manager/0.log"
Jul 06 22:01:40.627770 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:40.627743    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757974bfb6-hcnwv_ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19/copy-manifests/0.log"
Jul 06 22:01:40.635612 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:40.635546    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757974bfb6-hcnwv_ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19/manager/0.log"
Jul 06 22:01:42.329528 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:42.329501    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8djv4_da58a622-d50a-4d4e-8d1c-134c273fb397/manager/0.log"
Jul 06 22:01:42.438933 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:42.438889    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hmqs6_1a5a96aa-45dc-4ad1-a5b1-0f32daa25cdb/manager/0.log"
Jul 06 22:01:42.548946 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:42.548920    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bqz4p_2e9e4276-e1e3-4e7a-9bbe-54893475c73f/kuadrant-console-plugin/0.log"
Jul 06 22:01:42.666817 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:42.666748    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8sxn6_4328c690-be8e-4438-9276-0a7a0a438f71/registry-server/0.log"
Jul 06 22:01:42.785290 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:42.785266    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-n6fdt_7fa916b4-7a09-4e3d-af09-118e3162a248/manager/0.log"
Jul 06 22:01:42.896073 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:42.896048    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wf78w_64d6340e-81e1-48b8-a8e0-859b8abe06dc/limitador/0.log"
Jul 06 22:01:43.010772 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:43.010735    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-j6r9z_d00d4ec6-c72f-45d6-ac52-24c6def349a5/manager/0.log"
Jul 06 22:01:43.585132 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:43.585105    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4d5f5648-l6748_5df0e545-a7fd-4efe-93f1-456606cb740d/kube-auth-proxy/0.log"
Jul 06 22:01:43.823731 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:43.823699    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6kl52_ecdddab9-5299-48fc-bf59-668e81e04b5b/istio-proxy/1.log"
Jul 06 22:01:43.941124 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:43.941052    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-lgd4r_d440a3c8-d5c7-4f74-a6f4-c4245ac40844/payload-pre-processing/0.log"
Jul 06 22:01:44.843614 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:44.843585    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbjpc56_432107b9-1e22-495f-ad70-ae0c98ddf8d1/main/0.log"
Jul 06 22:01:45.071336 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:45.071310    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-hn9fh_7d0fc303-2115-4dcb-a076-362340393e93/main/0.log"
Jul 06 22:01:52.445693 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:52.445611    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9c4l2_71a13f26-90e5-41fe-abc1-49d5cfd57701/global-pull-secret-syncer/0.log"
Jul 06 22:01:52.557823 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:52.557790    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gbsx5_4f9c936d-426b-4bb4-b9e3-de34c4269a89/konnectivity-agent/0.log"
Jul 06 22:01:52.620104 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:52.620075    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-90.ec2.internal_a8965c7d69ec2392d3020ca0546d1c79/haproxy/0.log"
Jul 06 22:01:57.971618 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:57.971587    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8djv4_da58a622-d50a-4d4e-8d1c-134c273fb397/manager/0.log"
Jul 06 22:01:57.999623 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:57.999598    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hmqs6_1a5a96aa-45dc-4ad1-a5b1-0f32daa25cdb/manager/0.log"
Jul 06 22:01:58.028310 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:58.028283    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-bqz4p_2e9e4276-e1e3-4e7a-9bbe-54893475c73f/kuadrant-console-plugin/0.log"
Jul 06 22:01:58.077761 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:58.077729    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8sxn6_4328c690-be8e-4438-9276-0a7a0a438f71/registry-server/0.log"
Jul 06 22:01:58.181511 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:58.181482    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-n6fdt_7fa916b4-7a09-4e3d-af09-118e3162a248/manager/0.log"
Jul 06 22:01:58.201795 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:58.201776    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wf78w_64d6340e-81e1-48b8-a8e0-859b8abe06dc/limitador/0.log"
Jul 06 22:01:58.262688 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:01:58.262664    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-j6r9z_d00d4ec6-c72f-45d6-ac52-24c6def349a5/manager/0.log"
Jul 06 22:02:00.217780 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.217755    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5fbbc479db-kwt25_ab23f5eb-930e-4f74-8a80-79c89ba3519e/metrics-server/0.log"
Jul 06 22:02:00.363488 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.363460    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ph7gd_dfbbe407-cb5e-4f13-9f38-a0b4a58b2508/node-exporter/0.log"
Jul 06 22:02:00.389020 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.388993    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ph7gd_dfbbe407-cb5e-4f13-9f38-a0b4a58b2508/kube-rbac-proxy/0.log"
Jul 06 22:02:00.408250 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.408223    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ph7gd_dfbbe407-cb5e-4f13-9f38-a0b4a58b2508/init-textfile/0.log"
Jul 06 22:02:00.504185 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.504145    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-gpdjj_7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5/kube-rbac-proxy-main/0.log"
Jul 06 22:02:00.524973 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.524956    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-gpdjj_7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5/kube-rbac-proxy-self/0.log"
Jul 06 22:02:00.545960 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.545941    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-gpdjj_7f4e1a4d-3008-4654-8c69-7ed60f3e4fc5/openshift-state-metrics/0.log"
Jul 06 22:02:00.788761 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.788677    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-m9qlh_adee7de3-b969-4b11-ac4d-298f7f149dd0/prometheus-operator-admission-webhook/0.log"
Jul 06 22:02:00.816866 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.816841    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dbb4f6d4c-8v2x5_e696d22d-9eed-4771-911b-064144d6ee05/telemeter-client/0.log"
Jul 06 22:02:00.837885 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.837859    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dbb4f6d4c-8v2x5_e696d22d-9eed-4771-911b-064144d6ee05/reload/0.log"
Jul 06 22:02:00.858716 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.858694    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dbb4f6d4c-8v2x5_e696d22d-9eed-4771-911b-064144d6ee05/kube-rbac-proxy/0.log"
Jul 06 22:02:00.885487 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.885461    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f857fb4-zqj7r_d59d0586-c0ff-4824-bb84-16b683e755b4/thanos-query/0.log"
Jul 06 22:02:00.907509 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.907491    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f857fb4-zqj7r_d59d0586-c0ff-4824-bb84-16b683e755b4/kube-rbac-proxy-web/0.log"
Jul 06 22:02:00.929368 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.929350    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f857fb4-zqj7r_d59d0586-c0ff-4824-bb84-16b683e755b4/kube-rbac-proxy/0.log"
Jul 06 22:02:00.951578 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.951560    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f857fb4-zqj7r_d59d0586-c0ff-4824-bb84-16b683e755b4/prom-label-proxy/0.log"
Jul 06 22:02:00.972660 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.972640    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f857fb4-zqj7r_d59d0586-c0ff-4824-bb84-16b683e755b4/kube-rbac-proxy-rules/0.log"
Jul 06 22:02:00.998597 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:00.998560    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-56f857fb4-zqj7r_d59d0586-c0ff-4824-bb84-16b683e755b4/kube-rbac-proxy-metrics/0.log"
Jul 06 22:02:02.202870 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:02.202847    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-lc4dx_d9dab0c6-0a68-4e67-8b47-4698ae7ae3ec/networking-console-plugin/0.log"
Jul 06 22:02:03.024984 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.024948    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"]
Jul 06 22:02:03.025384 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.025371    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0668b6c-8973-4ccb-bb70-aad858f64495" containerName="istio-proxy"
Jul 06 22:02:03.025436 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.025386    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0668b6c-8973-4ccb-bb70-aad858f64495" containerName="istio-proxy"
Jul 06 22:02:03.025436 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.025403    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b4594cf-3471-44bd-b37c-1e74fcfc7694" containerName="cleanup"
Jul 06 22:02:03.025436 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.025409    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b4594cf-3471-44bd-b37c-1e74fcfc7694" containerName="cleanup"
Jul 06 22:02:03.025529 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.025475    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0668b6c-8973-4ccb-bb70-aad858f64495" containerName="istio-proxy"
Jul 06 22:02:03.025529 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.025484    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b4594cf-3471-44bd-b37c-1e74fcfc7694" containerName="cleanup"
Jul 06 22:02:03.025529 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.025492    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0668b6c-8973-4ccb-bb70-aad858f64495" containerName="istio-proxy"
Jul 06 22:02:03.030197 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.030178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.032526 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.032508    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gx6gm\"/\"kube-root-ca.crt\""
Jul 06 22:02:03.033731 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.033711    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gx6gm\"/\"openshift-service-ca.crt\""
Jul 06 22:02:03.033849 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.033766    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gx6gm\"/\"default-dockercfg-c9jwm\""
Jul 06 22:02:03.040069 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.040045    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"]
Jul 06 22:02:03.163416 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.163378    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-lib-modules\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.163416 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.163417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5bgm\" (UniqueName: \"kubernetes.io/projected/38993d31-4e32-4110-9c39-2eec7f7b88a3-kube-api-access-g5bgm\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.163630 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.163511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-podres\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.163630 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.163579    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-proc\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.163630 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.163621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-sys\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.264145 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.264105    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-sys\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.264566 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.264154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-lib-modules\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.264566 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.264174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5bgm\" (UniqueName: \"kubernetes.io/projected/38993d31-4e32-4110-9c39-2eec7f7b88a3-kube-api-access-g5bgm\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.264566 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.264216    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-podres\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.264566 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.264254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-proc\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.264566 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.264252    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-sys\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.264566 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.264300    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-lib-modules\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.264566 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.264357    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-proc\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.264566 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.264376    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38993d31-4e32-4110-9c39-2eec7f7b88a3-podres\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.272022 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.271994    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5bgm\" (UniqueName: \"kubernetes.io/projected/38993d31-4e32-4110-9c39-2eec7f7b88a3-kube-api-access-g5bgm\") pod \"perf-node-gather-daemonset-89rl8\" (UID: \"38993d31-4e32-4110-9c39-2eec7f7b88a3\") " pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.310109 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.310038    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-665945f5b5-k2tck_cead3696-e447-4038-9328-fd9fd1c2e3a5/console/0.log"
Jul 06 22:02:03.341363 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.341328    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.343159 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.343138    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-z596j_2986c8b9-b265-40a9-8c0c-62d3711daa05/download-server/0.log"
Jul 06 22:02:03.478840 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.478815    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"]
Jul 06 22:02:03.480736 ip-10-0-128-90 kubenswrapper[2564]: W0706 22:02:03.480704    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod38993d31_4e32_4110_9c39_2eec7f7b88a3.slice/crio-c2ca00a6b0bd8f4ec65324bf0d626b6c2cfdf03a8a05e306b77cdf41122aaf68 WatchSource:0}: Error finding container c2ca00a6b0bd8f4ec65324bf0d626b6c2cfdf03a8a05e306b77cdf41122aaf68: Status 404 returned error can't find the container with id c2ca00a6b0bd8f4ec65324bf0d626b6c2cfdf03a8a05e306b77cdf41122aaf68
Jul 06 22:02:03.809933 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.809877    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8" event={"ID":"38993d31-4e32-4110-9c39-2eec7f7b88a3","Type":"ContainerStarted","Data":"ff209a727fc3a779e9139d09b472b35cfa0734d9991688bb25c4e55a1b454c81"}
Jul 06 22:02:03.809933 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.809940    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8" event={"ID":"38993d31-4e32-4110-9c39-2eec7f7b88a3","Type":"ContainerStarted","Data":"c2ca00a6b0bd8f4ec65324bf0d626b6c2cfdf03a8a05e306b77cdf41122aaf68"}
Jul 06 22:02:03.810148 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.809963    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:03.830908 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:03.830847    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8" podStartSLOduration=1.830833162 podStartE2EDuration="1.830833162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 22:02:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 22:02:03.829229612 +0000 UTC m=+2432.302427232" watchObservedRunningTime="2026-07-06 22:02:03.830833162 +0000 UTC m=+2432.304030781"
Jul 06 22:02:04.960079 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:04.960054    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jfzrw_078ef4f4-78e7-481c-8203-bbdaf87ebfc2/dns/0.log"
Jul 06 22:02:04.980838 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:04.980808    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jfzrw_078ef4f4-78e7-481c-8203-bbdaf87ebfc2/kube-rbac-proxy/0.log"
Jul 06 22:02:05.096608 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:05.096572    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pkdw8_8b652d91-c369-4441-95fb-ebc6bd1a4cf3/dns-node-resolver/0.log"
Jul 06 22:02:05.666093 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:05.666058    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68f69cf476-lcrph_cb1694cf-f7de-4310-b471-e8bf2c29bad1/registry/0.log"
Jul 06 22:02:05.685941 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:05.685915    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6j9h5_f757d911-9917-454b-a588-22665813cd3f/node-ca/0.log"
Jul 06 22:02:06.835148 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:06.835119    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4d5f5648-l6748_5df0e545-a7fd-4efe-93f1-456606cb740d/kube-auth-proxy/0.log"
Jul 06 22:02:06.888634 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:06.888590    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6kl52_ecdddab9-5299-48fc-bf59-668e81e04b5b/istio-proxy/0.log"
Jul 06 22:02:06.915709 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:06.915683    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6kl52_ecdddab9-5299-48fc-bf59-668e81e04b5b/istio-proxy/1.log"
Jul 06 22:02:06.944472 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:06.944449    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-lgd4r_d440a3c8-d5c7-4f74-a6f4-c4245ac40844/payload-pre-processing/0.log"
Jul 06 22:02:07.702335 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:07.702298    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n8lt5_4bc14ea5-8b5e-450a-805d-2ac426d61f0f/serve-healthcheck-canary/0.log"
Jul 06 22:02:08.216986 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:08.216958    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-624xr_dfb1b6bf-f4c8-4e61-9099-e6173a60fe77/kube-rbac-proxy/0.log"
Jul 06 22:02:08.238018 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:08.237992    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-624xr_dfb1b6bf-f4c8-4e61-9099-e6173a60fe77/exporter/0.log"
Jul 06 22:02:08.257174 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:08.257152    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-624xr_dfb1b6bf-f4c8-4e61-9099-e6173a60fe77/extractor/0.log"
Jul 06 22:02:09.825483 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:09.825456    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gx6gm/perf-node-gather-daemonset-89rl8"
Jul 06 22:02:10.503114 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:10.503089    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qfxbw_c5f08460-315d-4ad6-b50d-58ccb852e4c6/manager/0.log"
Jul 06 22:02:10.631553 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:10.631524    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mmrnl_a331790a-702d-44b2-b49f-b3320b3b8789/manager/0.log"
Jul 06 22:02:10.710387 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:10.710360    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722920-5dwvq_6b4594cf-3471-44bd-b37c-1e74fcfc7694/cleanup/0.log"
Jul 06 22:02:10.894055 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:10.893960    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2drdg_a4f68832-5144-4146-bdc0-7783c67b74e5/manager/0.log"
Jul 06 22:02:11.053971 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:11.053946    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757974bfb6-hcnwv_ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19/manager/0.log"
Jul 06 22:02:11.074576 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:11.074557    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-757974bfb6-hcnwv_ba1ac5cd-6bc1-4b8f-85c0-52994c82ed19/copy-manifests/0.log"
Jul 06 22:02:13.349653 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:13.349623    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4d5f5648-l6748_5df0e545-a7fd-4efe-93f1-456606cb740d/kube-auth-proxy/0.log"
Jul 06 22:02:13.382348 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:13.382314    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6kl52_ecdddab9-5299-48fc-bf59-668e81e04b5b/istio-proxy/0.log"
Jul 06 22:02:13.408170 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:13.408142    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6kl52_ecdddab9-5299-48fc-bf59-668e81e04b5b/istio-proxy/1.log"
Jul 06 22:02:13.426121 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:13.426092    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-lgd4r_d440a3c8-d5c7-4f74-a6f4-c4245ac40844/payload-pre-processing/0.log"
Jul 06 22:02:14.750788 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:14.750708    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b4d5f5648-l6748_5df0e545-a7fd-4efe-93f1-456606cb740d/kube-auth-proxy/0.log"
Jul 06 22:02:14.790104 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:14.790074    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6kl52_ecdddab9-5299-48fc-bf59-668e81e04b5b/istio-proxy/0.log"
Jul 06 22:02:14.821757 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:14.821730    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-6kl52_ecdddab9-5299-48fc-bf59-668e81e04b5b/istio-proxy/1.log"
Jul 06 22:02:14.844728 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:14.844695    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-lgd4r_d440a3c8-d5c7-4f74-a6f4-c4245ac40844/payload-pre-processing/0.log"
Jul 06 22:02:19.525459 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:19.525428    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cm6sd_e6b28796-6170-410a-a51d-888fcda16922/kube-multus-additional-cni-plugins/0.log"
Jul 06 22:02:19.546364 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:19.546337    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cm6sd_e6b28796-6170-410a-a51d-888fcda16922/egress-router-binary-copy/0.log"
Jul 06 22:02:19.569017 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:19.568994    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cm6sd_e6b28796-6170-410a-a51d-888fcda16922/cni-plugins/0.log"
Jul 06 22:02:19.588728 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:19.588708    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cm6sd_e6b28796-6170-410a-a51d-888fcda16922/bond-cni-plugin/0.log"
Jul 06 22:02:19.608640 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:19.608618    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cm6sd_e6b28796-6170-410a-a51d-888fcda16922/routeoverride-cni/0.log"
Jul 06 22:02:19.628161 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:19.628138    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cm6sd_e6b28796-6170-410a-a51d-888fcda16922/whereabouts-cni-bincopy/0.log"
Jul 06 22:02:19.648472 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:19.648452    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cm6sd_e6b28796-6170-410a-a51d-888fcda16922/whereabouts-cni/0.log"
Jul 06 22:02:19.904708 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:19.904634    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xwnjx_83a702da-0cfc-4565-9019-7c55b2b58677/kube-multus/0.log"
Jul 06 22:02:19.925123 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:19.925097    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5vcrb_0d9b6160-3c08-45a1-a0b3-dc682e2ac510/network-metrics-daemon/0.log"
Jul 06 22:02:19.948667 ip-10-0-128-90 kubenswrapper[2564]: I0706 22:02:19.948640    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5vcrb_0d9b6160-3c08-45a1-a0b3-dc682e2ac510/kube-rbac-proxy/0.log"